导航

ACTA AERONAUTICAET ASTRONAUTICA SINICA

    Next Articles

Research progress of UAV aerial video multi-object detection and tracking based on deep learning

  

  • Received:2022-11-29 Revised:2023-03-17 Online:2023-03-21 Published:2023-03-21
  • Contact: Yi-Quan WU

Abstract: With the increasing convenience of data acquisition for aerial photography of Unmanned Aerial Vehicle (UAV), the multi-target detection and tracking technology based on the UAV platform has developed rapidly and has broad application prospects in civil and military fields. In recent years, the rapid progress of in-depth learning has also provided a variety of more effective solutions. However, such challenging problems as sudden changes in the appearance of the target, serious occlusion of the target area, and disappearance and reappearance of the target from the perspective of UAV have not been completely solved. In this paper, we summarize the algorithms of multi-target detection and tracking in UAV aerial video based on depth learning, and summarize the latest progress in this field, including multi-target detection and multi-object tracking. The multi-object detection module is divided into two parts: Two-stage and One-stage. For the multi-object tracking module, according to the two classical frameworks of Tracking Based on Detection and Joint Detection Tracking, the principles of the two kinds of algorithms are described and their advantages and disadvantages are analyzed. Then, the existing public data sets are statistically analyzed, and the optimal schemes of the benchmark challenge VisDrone Challenge in the field of multi-target detection and tracking based on UAV aerial video in recent years are compared and analyzed. Finally, the paper summarizes the urgent problems of multi-object detection and tracking from the perspective of UAV and looks forward to the possible research directions in the future, providing a reference for the follow-up researchers.

Key words: UAV aerial video, Multi object detection, Multi target tracking, Deep learning, One stage detection, Two stage detection, Tracking Based on detection, Joint Detection Tracking

CLC Number: