航空学报 > 2025, Vol. 46 Issue (17): 331799-331799   doi: 10.7527/S1000-6893.2025.31799

无人机航拍图像拼接方法研究进展

姜筱巍, 吴一全()   

  1. 南京航空航天大学 电子信息工程学院,南京 211106
  • 收稿日期:2025-01-13 修回日期:2025-03-26 接受日期:2025-04-28 出版日期:2025-05-12 发布日期:2025-05-08
  • 通讯作者: 吴一全 E-mail:nuaaimage@163.com
  • 基金资助:
    国家自然科学基金(61573183)

Research progress of UAV aerial image mosaic methods

Xiaowei JIANG, Yiquan WU()   

  1. College of Electronic and Information Engineering,Nanjing University of Aeronautics and Astronautics,Nanjing 211106,China
  • Received:2025-01-13 Revised:2025-03-26 Accepted:2025-04-28 Online:2025-05-12 Published:2025-05-08
  • Contact: Yiquan WU E-mail:nuaaimage@163.com
  • Supported by:
    National Natural Science Foundation of China(61573183)

摘要:

无人机因其轻便灵活、拍摄覆盖面广、成本较低等优势,在军事侦察、农业监测、城市规划与管理等领域发挥了重大作用。在这些应用中,无人机航拍因视野受限,无法得到完整目标区域的高清全景图像,因此图像拼接技术必不可少。近年来,深度学习的发展使得无人机航拍图像拼接技术再度受到关注。综述了近10年来无人机航拍图像拼接方法的研究进展。首先简介无人机航拍图像拼接方法的发展历程及主要流程。然后按图像预处理、图像配准、图像融合3大步骤详细说明无人机航拍图像拼接的传统方法,并对比每个步骤所采用方法的优缺点。接着阐述了基于深度学习的无人机航拍图像拼接方法,从基于深度学习的语义分割、图像配准、图像拼接框架这3个方面进行详细说明。随后梳理了常见无人机航拍图像拼接数据集与图像拼接性能评价指标,并列举了5项无人机航拍图像拼接技术的典型应用领域。最后指出无人机航拍图像拼接仍面临着多项技术挑战,并对未来工作进行了展望。

关键词: 无人机航拍, 图像拼接, 深度学习, 图像配准, 图像融合

Abstract:

Unmanned Aerial Vehicle (UAV) plays an important role in military reconnaissance, agricultural monitoring, urban planning and management due to its advantages of light weight, flexibility, wide coverage and low cost. In these applications, due to the limited field of view of UAV aerial photography, it is impossible to obtain high-definition panoramic images of the complete target area. Therefore, image mosaic technology is essential. In recent years, the development of deep learning has brought renewed attention to UAV aerial image mosaic technology. This paper reviews the research progress of UAV aerial image mosaic methods in the last 10 years. Firstly, the development process and main process of UAV aerial image mosaic method are introduced. Secondly, the traditional methods of UAV aerial image mosaic are described in detail according to the three steps of image preprocessing, image registration and image fusion. The advantages and disadvantages of the methods used in each step are also compared. This paper then describes in detail the UAV aerial image mosaic method based on deep learning from three aspects: semantic segmentation, image registration, and image mosaic framework which both based on deep learning. Common UAV aerial image mosaic datasets and image mosaic performance evaluation indicators are sorted out, and five typical application fields of UAV aerial image mosaic technology are listed. Finally, this paper highlights several technical challenges that UAV aerial image mosaic still faces and provides an outlook on the future work directions.

Key words: UAV aerial photography, image mosaic, deep learning, image registration, image fusion

中图分类号: