Towards Real-Time On-Drone Pedestrian Tracking in 4K Inputs

Autor: Chanyoung Oh, Moonsoo Lee, Chaedeok Lim
Jazyk: angličtina
Rok vydání: 2023
Předmět:
Zdroj: Drones, Vol 7, Iss 10, p 623 (2023)
Druh dokumentu: article
ISSN: 2504-446X
DOI: 10.3390/drones7100623
Popis: Over the past several years, significant progress has been made in object tracking, but challenges persist in tracking objects in high-resolution images captured from drones. Such images usually contain very tiny objects, and the movement of the drone causes rapid changes in the scene. In addition, the computing power of mission computers on drones is often insufficient to achieve real-time processing of deep learning-based object tracking. This paper presents a real-time on-drone pedestrian tracker that takes as the input 4K aerial images. The proposed tracker effectively hides the long latency required for deep learning-based detection (e.g., YOLO) by exploiting both the CPU and GPU equipped in the mission computer. We also propose techniques to minimize detection loss in drone-captured images, including a tracker-assisted confidence boosting and an ensemble for identity association. In our experiments, using real-world inputs captured by drones at a height of 50 m, the proposed method with an NVIDIA Jetson TX2 proves its efficacy by achieving real-time detection and tracking in 4K video streams.
Databáze: Directory of Open Access Journals