电子电气工程与控制

无人机航拍图像拼接方法研究进展

  • 姜筱巍 ,
  • 吴一全
展开
  • 南京航空航天大学 电子信息工程学院,南京 211106
E-mail: nuaaimage@163.com

收稿日期: 2025-01-13

  修回日期: 2025-03-26

  录用日期: 2025-04-28

  网络出版日期: 2025-05-08

基金资助

国家自然科学基金(61573183)

Research progress of UAV aerial image mosaic methods

  • Xiaowei JIANG ,
  • Yiquan WU
Expand
  • College of Electronic and Information Engineering,Nanjing University of Aeronautics and Astronautics,Nanjing 211106,China
E-mail: nuaaimage@163.com

Received date: 2025-01-13

  Revised date: 2025-03-26

  Accepted date: 2025-04-28

  Online published: 2025-05-08

Supported by

National Natural Science Foundation of China(61573183)

摘要

无人机因其轻便灵活、拍摄覆盖面广、成本较低等优势,在军事侦察、农业监测、城市规划与管理等领域发挥了重大作用。在这些应用中,无人机航拍因视野受限,无法得到完整目标区域的高清全景图像,因此图像拼接技术必不可少。近年来,深度学习的发展使得无人机航拍图像拼接技术再度受到关注。综述了近10年来无人机航拍图像拼接方法的研究进展。首先简介无人机航拍图像拼接方法的发展历程及主要流程。然后按图像预处理、图像配准、图像融合3大步骤详细说明无人机航拍图像拼接的传统方法,并对比每个步骤所采用方法的优缺点。接着阐述了基于深度学习的无人机航拍图像拼接方法,从基于深度学习的语义分割、图像配准、图像拼接框架这3个方面进行详细说明。随后梳理了常见无人机航拍图像拼接数据集与图像拼接性能评价指标,并列举了5项无人机航拍图像拼接技术的典型应用领域。最后指出无人机航拍图像拼接仍面临着多项技术挑战,并对未来工作进行了展望。

本文引用格式

姜筱巍 , 吴一全 . 无人机航拍图像拼接方法研究进展[J]. 航空学报, 2025 , 46(17) : 331799 -331799 . DOI: 10.7527/S1000-6893.2025.31799

Abstract

Unmanned Aerial Vehicle (UAV) plays an important role in military reconnaissance, agricultural monitoring, urban planning and management due to its advantages of light weight, flexibility, wide coverage and low cost. In these applications, due to the limited field of view of UAV aerial photography, it is impossible to obtain high-definition panoramic images of the complete target area. Therefore, image mosaic technology is essential. In recent years, the development of deep learning has brought renewed attention to UAV aerial image mosaic technology. This paper reviews the research progress of UAV aerial image mosaic methods in the last 10 years. Firstly, the development process and main process of UAV aerial image mosaic method are introduced. Secondly, the traditional methods of UAV aerial image mosaic are described in detail according to the three steps of image preprocessing, image registration and image fusion. The advantages and disadvantages of the methods used in each step are also compared. This paper then describes in detail the UAV aerial image mosaic method based on deep learning from three aspects: semantic segmentation, image registration, and image mosaic framework which both based on deep learning. Common UAV aerial image mosaic datasets and image mosaic performance evaluation indicators are sorted out, and five typical application fields of UAV aerial image mosaic technology are listed. Finally, this paper highlights several technical challenges that UAV aerial image mosaic still faces and provides an outlook on the future work directions.

参考文献

[1] 江波, 屈若锟, 李彦冬, 等. 基于深度学习的无人机航拍目标检测研究综述[J]. 航空学报202142(4): 524519.
  JIANG B, QU R K, LI Y D, et al. Object detection in UAV imagery based on deep learning: Review[J]. Acta Aeronautica et Astronautica Sinica202142(4): 524519 (in Chinese).
[2] 李岩山, 裴继红, 谢维信, 等. 一种新的无人机航拍序列图像快速拼接方法[J]. 电子学报201240(5): 935-940.
  LI Y S, PEI J H, XIE W X, et al. A new fast automatic mosaic method on unmanned aerial vehicle images[J]. Acta Electronica Sinica201240(5): 935-940 (in Chinese).
[3] BOUGUETTAYA A, ZARZOUR H, KECHIDA A, et al. Deep learning techniques to classify agricultural crops through UAV imagery: A review[J]. Neural Computing & Applications202234(12): 9511-9536.
[4] 谭翔, 毛海颖, 支晓栋, 等. 基于无人机红外光谱技术的影像数据匹配方法研究[J]. 光谱学与光谱分析201838(2): 413-417.
  TAN X, MAO H Y, ZHI X D, et al. Research on image data matching method based on infrared spectrum technology of UAV[J]. Spectroscopy and Spectral Analysis201838(2): 413-417 (in Chinese).
[5] 吴俣, 余涛, 谢东海. 面向应急响应的无人机图像快速自动拼接[J]. 计算机辅助设计与图形学学报201325(3): 410-416.
  WU Y, YU T, XIE D H. Fast automatic stitching for images of unmanned aerial vehicle in emergency response[J]. Journal of Computer-Aided Design & Computer Graphics201325(3): 410-416 (in Chinese).
[6] 余淮, 杨文. 一种无人机航拍影像快速特征提取与匹配算法[J]. 电子与信息学报201638(3): 509-516.
  YU H, YANG W. A fast feature extraction and matching algorithm for unmanned aerial vehicle images[J]. Journal of Electronics & Information Technology201638(3): 509-516 (in Chinese).
[7] 曹世翔, 江洁, 张广军, 等. 边缘特征点的多分辨率图像拼接[J]. 计算机研究与发展201148(9): 1788-1793.
  CAO S X, JIANG J, ZHANG G J, et al. Multi-scale image mosaic using features from edge[J]. Journal of Computer Research and Development201148(9): 1788-1793 (in Chinese).
[8] LI J, WANG Z M, LAI S M, et al. Parallax-tolerant image stitching based on robust elastic warping[J]. IEEE Transactions on Multimedia201820(7): 1672-1687.
[9] 杨佳宾, 姜永涛, 杨幸彬, 等. 基于Dense SIFT特征的无人机影像快速拼接方法[J]. 地球信息科学学报201921(4): 588-599.
  YANG J B, JIANG Y T, YANG X B, et al. A fast mosaic algorithm of UAV images based on dense SIFT feature matching[J]. Journal of Geo-Information Science201921(4): 588-599 (in Chinese).
[10] 郭璠, 李小虎, 刘文韬, 等. 基于参数回归的快速全景图像拼接算法[J]. 通信学报202344(9): 36-47.
  GUO F, LI X H, LIU W T, et al. Fast panoramic image stitching algorithm based on parameter regression[J]. Journal on Communications202344(9): 36-47 (in Chinese).
[11] 张玲, 穆文鹏, 陈北京. 面向图像拼接检测的自适应残差算法[J]. 中国图象图形学报202429(2): 419-429.
  ZHANG L, MU W P, CHEN B J. Adaptive residual algorithm for image splicing detection[J]. Journal of Image and Graphics202429(2): 419-429 (in Chinese).
[12] DONG C, LOY C C, HE K M, et al. Learning a deep convolutional network for image super-resolution[C]∥Computer Vision-ECCV 2014. Cham: Springer International Publishing, 2014: 184-199.
[13] LIU Z, LIN Y T, CAO Y, et al. Swin transformer: hierarchical vision transformer using shifted windows[C]∥2021 IEEE/CVF International Conference on Computer Vision (ICCV). Piscataway: IEEE Press, 2021: 9992-10002.
[14] 吴付杰, 王博文, 齐静雅, 等. 机载多孔径全景图像合成技术研究进展[J]. 航空学报202546(3): 630505.
  WU F J, WANG B W, QI J Y, et al. A review of airborne multi-aperture panoramic image compositing[J]. Acta Aeronautica et Astronautica Sinica202546(3): 630505 (in Chinese).
[15] 杨利春, 田彬, 党建武. 基于深度学习的图像拼接算法研究综述[J]. 计算机应用研究202441(7): 1930-1939.
  YANG L C, TIAN B, DANG J W. Survey on image stitching algorithm based on deep learning[J]. Application Research of Computers202441(7): 1930-1939 (in Chinese).
[16] 潘维东, 李安虎, 刘兴盛. 基于区域优化的图像拼接技术研究及应用进展[J]. 激光与光电子学进展202461(18): 1800004.
  PAN W D, LI A H, LIU X S. Progress in research and application of image stitching technology based on regional optimization[J]. Laser & Optoelectronics Progress202461(18): 1800004 (in Chinese).
[17] FU M Y, LIANG H, ZHU C H, et al. Image stitching techniques applied to plane or 3-D models: A review[J]. IEEE Sensors Journal202323(8): 8060-8079.
[18] JAGADEESWARI M, MANIKANDABABU C S, SREE DHVIYA M, et al. Review: A comparative study based on video stitching methods[C]∥2021 Second International Conference on Electronics and Sustainable Communication Systems (ICESC). Piscataway: IEEE Press, 2021: 1157-1163.
[19] 狄颖辰, 陈云坪, 陈莹莹, 等. 无人机图像拼接算法综述[J]. 计算机应用201131(1): 170-174.
  DI Y C, CHEN Y P, CHEN Y Y, et al. Survey on image mosaic algorithm of unmanned aerial vehicle[J]. Journal of Computer Applications201131(1): 170-174 (in Chinese).
[20] MERJULAH R, CHANDRA J. Medical image classification using MRI: An investigation[M]∥Proceedings of the International Conference on ISMAC in Computational Vision and Bio-Engineering 2018 (ISMAC-CVB). Cham: Springer International Publishing, 2019: 1135-1146.
[21] GóMEZ-REYES J K, BENíTEZ-RANGEL J P, MORALES-HERNáNDEZ L A, et al. Image mosaicing applied on UAVs survey[J]. Applied Sciences202212(5): 2729.
[22] LOWE D G. Distinctive image features from scale-invariant keypoints[J]. International Journal of Computer Vision200460(2): 91-110.
[23] BAY H, TUYTELAARS T, VAN GOOL L. SURF: Speeded up robust features[M]∥Computer Vision-ECCV 2006. Berlin: Springer, 2006: 404-417.
[24] RUBLEE E, RABAUD V, KONOLIGE K, et al. ORB: An efficient alternative to SIFT or SURF[C]∥2011 International Conference on Computer Vision. Piscataway: IEEE Press, 2011: 2564-2571.
[25] ZARAGOZA J, CHIN T J, BROWN M S, et al. As-projective-as-possible image stitching with moving DLT[C]∥2013 IEEE Conference on Computer Vision and Pattern Recognition. Piscataway: IEEE Press, 2013: 2339-2346.
[26] LIN C C, PANKANTI S U, RAMAMURTHY K N, et al. Adaptive as-natural-as-possible image stitching[C]∥2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). Piscataway: IEEE Press, 2015: 1155-1163.
[27] 王斌, 王伟锋. 一种基于局部灰度匹配的无人机图像拼接算法[J]. 中国石油大学学报(自然科学版)200933(2): 169-173.
  WANG B, WANG W F. Unmanned aerial vehicle image mosaic algorithm based on local gray fitting[J]. Journal of China University of Petroleum (Edition of Natural Science)200933(2): 169-173 (in Chinese).
[28] 曹健, 李侃, 高春晓, 等. 局部特征在航拍图像拼接中的应用[J]. 电子科技大学学报201342(1): 125-129.
  CAO J, LI K, GAO C X, et al. Application of local features in aerial image mosaic[J]. Journal of University of Electronic Science and Technology of China201342(1): 125-129 (in Chinese).
[29] 徐玉华, 龚文全, 苏昂, 等. 近似平面场景多视点图像拼接算法[J]. 国防科技大学学报201436(2): 148-155.
  XU Y H, GONG W Q, SU A, et al. Multi-viewpoint image mosaicing algorithm for roughly planar scenes[J]. Journal of National University of Defense Technology201436(2): 148-155 (in Chinese).
[30] 程争刚, 张利. 一种基于无人机位姿信息的航拍图像拼接方法[J]. 测绘学报201645(6): 698-705.
  CHENG Z G, ZHANG L. An aerial image mosaic method based on UAV position and attitude information[J]. Acta Geodaetica et Cartographica Sinica201645(6): 698-705 (in Chinese).
[31] 赵丽颖, 付强, 黄丹飞, 等. 基于无人机航拍图像快速拼接方法的研究[J]. 长春理工大学学报(自然科学版)202144(6): 39-46.
  ZHAO L Y, FU Q, HUANG D F, et al. Research on fast mosaic method of UAV aerial image[J]. Journal of Changchun University of Science and Technology (Natural Science Edition)202144(6): 39-46 (in Chinese).
[32] 冯向东, 魏春英. 基于覆盖区域自适应优化的无人机航拍拼接方法[J]. 无线电工程202252(11): 1977-1983.
  FENG X D, WEI C Y. UAV captured image stitching based on adaptive optimization of coverage area[J]. Radio Engineering202252(11): 1977-1983 (in Chinese).
[33] 吴晶辉, 严彩萍, 李红, 等. 边缘引导的双注意力图像拼接检测网络[J]. 中国图象图形学报202429(2): 430-443.
  WU J H, YAN C P, LI H, et al. BDA-Net: Boundary-guided dual attention network for image splicing detection[J]. Journal of Image and Graphics202429(2): 430-443 (in Chinese).
[34] 许向阳, 袁杉杉, 王军, 等. 基于全局和局部特征的图像拼接方法[J]. 北京理工大学学报202242(5): 502-510.
  XU X Y, YUAN S S, WANG J, et al. Image stitching method based on global and local features[J]. Transactions of Beijing Institute of Technology202242(5): 502-510 (in Chinese).
[35] YE N J, WANG C, FAN H Q, et al. Motion basis learning for unsupervised deep homography estimation with subspace projection[C]∥2021 IEEE/CVF International Conference on Computer Vision (ICCV). Piscataway: IEEE Press, 2021: 13097-13105.
[36] NIE L, LIN C Y, LIAO K, et al. Unsupervised deep image stitching: Reconstructing stitched features to images[J]. IEEE Transactions on Image Processing202130: 6184-6197.
[37] 梁镇锋, 夏海英, 谭玉枚, 等. 基于无监督深度学习的航拍图像拼接算法[J]. 北京航空航天大学学报202551(7): 2437-2449.
  LIANG Z F, XIA H Y, TAN Y M, et al. Aerial image stitching algorithm based on unsupervised deep learning[J]. Journal of Beijing University of Aeronautics and Astronautics202551(7): 2437-2449 (in Chinese).
[38] 高春晓, 熊鹏, 周暂, 等. 基于预测区域匹配的无人机航拍图像快速拼接[J]. 北京理工大学学报201434(11): 1202-1206.
  GAO C X, XIONG P, ZHOU Z, et al. Fast UAV aerial image stitching based on predicted-region matching[J]. Transactions of Beijing Institute of Technology201434(11): 1202-1206 (in Chinese).
[39] 黄旭龙, 杨晓梅. 含噪无人机图像拼接方法[J]. 计算机工程与设计202142(7): 1973-1980.
  HUANG X L, YANG X M. Image mosaic algorithm of noisy UAV[J]. Computer Engineering and Design202142(7): 1973-1980 (in Chinese).
[40] 孙新博, 孙芹芹, 李英成, 等. 无人机红外影像拼接方法研究[J]. 测绘科学202146(6): 109-113, 120.
  SUN X B, SUN Q Q, LI Y C, et al. Research on UAV infrared images mosaic[J]. Science of Surveying and Mapping202146(6): 109-113, 120 (in Chinese).
[41] 周登科, 郭星辰, 史凯特, 等. 风电场无人机巡检红外叶片图像拼接算法[J]. 红外技术202345(11): 1161-1168.
  ZHOU D K, GUO X C, SHI K T, et al. Infrared blade image stitching algorithm for wind farm UAV inspection[J]. Infrared Technology202345(11): 1161-1168 (in Chinese).
[42] 申浩, 李书晓, 申意萍, 等. 航拍视频帧间快速配准算法[J]. 航空学报201334(6): 1405-1413.
  SHEN H, LI S X, SHEN Y P, et al. Fast interframe registration method in aerial videos[J]. Acta Aeronautica et Astronautica Sinica201334(6): 1405-1413 (in Chinese).
[43] 王文锋, 张焱鑫, 陈瑜, 等. 基于光场深度序列的大视野图像拼接算法[J]. 光学学报201838(9): 0915003.
  WANG W F, ZHANG Y X, CHEN Y, et al. Wide field-of-view image stitching algorithm based on depth sequence of light field[J]. Acta Optica Sinica201838(9): 0915003 (in Chinese).
[44] 邹宇. 基于鱼眼相机的车载全景图像拼接技术研究[D]. 南京: 南京航空航天大学, 2019: 6-7.
  ZOU Y. Research on vehicle-mounted panoramic image mosaic technology based on fisheye camera[D]. Nanjing: Nanjing University of Aeronautics and Astronautics, 2019: 6-7 (in Chinese).
[45] 马旭, 程咏梅, 郝帅, 等. 面向未知区域深度测量的序列图像稠密点特征生成算法[J]. 航空学报201536(2): 596-604.
  MA X, CHENG Y M, HAO S, et al. Dense point feature generation algorithm based on monocular sequence images for depth measurement of unknown zone[J]. Acta Aeronautica et Astronautica Sinica201536(2): 596-604 (in Chinese).
[46] 霍东旭, 朱朦, 任洪娥. 基于改进Harris算法的全自动无缝图像拼接[J]. 黑龙江大学自然科学学报201835(2): 212-217.
  HUO D X, ZHU M, REN H E. Automatic seamless image stitching based on improved Harris algorithm[J]. Journal of Natural Science of Heilongjiang University201835(2): 212-217 (in Chinese).
[47] 吴一全, 谢芬. 基于对比度Harris的快速鲁棒图像配准算法[J]. 北京理工大学学报202040(3): 316-324.
  WU Y Q, XIE F. A fast and robust image registration algorithm based on contrast Harris[J]. Transactions of Beijing Institute of Technology202040(3): 316-324 (in Chinese).
[48] CHENG C, WANG X Z, LI X J. UAV image matching based on surf feature and Harris corner algorithm[C]∥4th International Conference on Smart and Sustainable City (ICSSC 2017). London: IET, 2017: 1-6.
[49] XU Y T, LUO Y, YANG K, et al. Research on image mosaic of low altitude UAV based on Harris corner detection[C]∥2019 14th IEEE International Conference on Electronic Measurement & Instruments (ICEMI). Piscataway: IEEE Press, 2019: 639-645.
[50] 杨娜, 张翀, 李天昊. 基于无人机与计算机视觉的中国古建筑木结构裂缝监测系统设计[J]. 工程力学202138(3): 27-39.
  YANG N, ZHANG C, LI T H. Design of crack monitoring system for Chinese ancient wooden buildings based on uav and cv[J]. Engineering Mechanics202138(3): 27-39 (in Chinese).
[51] 王超, 雷添杰, 张保山, 等. 基于改进SIFT算法的无人机遥感影像快速拼接[J]. 华中师范大学学报(自然科学版)202357(2): 302-309.
  WANG C, LEI T J, ZHANG B S, et al. Quick stitching of unmanned aerial vehicle remote sensing images based on an improved SIFT algorithm[J]. Journal of Central China Normal University (Natural Sciences)202357(2): 302-309 (in Chinese).
[52] 王艳, 祁萌. 基于GA-SIFT算法的无人机航拍图像实时拼接[J]. 测绘通报2021(8): 28-32, 47.
  WANG Y, QI M. Real-time stitching of unmanned vehicle images based on GA-SIFT algorithm[J]. Bulletin of Surveying and Mapping2021(8): 28-32, 47 (in Chinese).
[53] 杨祥, 周楠. 改进SIFT的特征提取与图像拼接方法[J]. 桂林理工大学学报202343(1): 131-136.
  YANG X, ZHOU N. Image mosaic method based on improved SIFT feature extraction[J]. Journal of Guilin University of Technology202343(1): 131-136 (in Chinese).
[54] ZHANG F B, YANG T, LIU L F, et al. Image-only real-time incremental UAV image mosaic for multi-strip flight[J]. IEEE Transactions on Multimedia202023: 1410-1425.
[55] HU D T, WANG Y, HU Q W, et al. The construction method of measurable aerial panorama based on panoramic image and multi-view oblique images matching[C]∥2016 4th International Workshop on Earth Observation and Remote Sensing Applications (EORSA). Piscataway: IEEE Press, 2016: 232-236.
[56] JI X Y, XIANG X J, HUANG J. Real-time panorama stitching method for UAV sensor images based on the feature matching validity prediction of grey relational analysis[C]∥2018 15th International Conference on Control, Automation, Robotics and Vision (ICARCV). Piscataway: IEEE Press, 2018: 1454-1459.
[57] 张文博, 刘卫东, 李乐, 等. 基于自适应图像增强的水下多帧目标图像拼接融合方法[J]. 西北工业大学学报202240(5): 997-1003.
  ZHANG W B, LIU W D, LI L, et al. Underwater multi-frame target images mosaic method based on adaptive image enhancement[J]. Journal of Northwestern Polytechnical University202240(5): 997-1003 (in Chinese).
[58] 韩天庆, 赵银娣, 刘善磊, 等. 空间约束的无人机影像SURF特征点匹配[J]. 中国图象图形学报201318(6): 669-676.
  HAN T Q, ZHAO Y D, LIU S L, et al. Spatially constrained SURF feature point matching for UAV images[J]. Journal of Image and Graphics201318(6): 669-676 (in Chinese).
[59] ZHU X K, LI Z B, SUN C S, et al. Fast aerial image stitching algorithm for UAV based on improved SURF[C]∥2023 China Automation Congress (CAC). Piscataway: IEEE Press, 2023: 7598-7604.
[60] 曾国奇, 牛子凡, 郑丽丽, 等. 基于球形变换的无人机视频图像实时拼接方法[J]. 航空学报202344(24): 328364.
  ZENG G Q, NIU Z F, ZHENG L L, et al. A real time video image stitching method for UAV based on spherical transformation[J]. Acta Aeronautica et Astronautica Sinica202344(24): 328364 (in Chinese).
[61] 江智, 江德港, 黄子杰, 等. 基于IB-SURF算法的无人机图像拼接技术研究[J]. 计算机工程与应用202460(3): 263-269.
  JIANG Z, JIANG D G, HUANG Z J, et al. Research on UAV image stitching technology based on IB-SURF algorithm[J]. Computer Engineering and Applications202460(3): 263-269 (in Chinese).
[62] 许鑫, 张力, 岳继博, 等. 农田环境下无人机图像并行拼接识别算法[J]. 农业工程学报202440(9): 154-163.
  XU X, ZHANG L, YUE J B, et al. Parallel mosaic recognition algorithm for UAV images in farmland environment[J]. Transactions of the Chinese Society of Agricultural Engineering202440(9): 154-163 (in Chinese).
[63] 毛峡, 李亚豪. 光伏阵列故障检测中的无人机红外图像拼接[J]. 太阳能学报202041(3): 262-269.
  MAO X, LI Y H. Infrared image stitching of UAV in fault detection of photovoltaic array[J]. Acta Energiae Solaris Sinica202041(3): 262-269 (in Chinese).
[64] YUE M K, YAN Q S. UAV remote sensing positioning algorithm based on image registration[C]∥2020 IEEE International Conference on Information Technology, Big Data and Artificial Intelligence (ICIBA). Piscataway: IEEE Press, 2020: 926-931.
[65] 王红君, 刘一鸣, 岳有军, 等. 基于改进ORB算法的无人机遥感图像拼接技术[J]. 科学技术与工程202020(13): 5230-5234.
  WANG H J, LIU Y M, YUE Y J, et al. Image mosaic technology of unmanned aearial vehicle remote sensing based on improved ORB algorithm[J]. Science Technology and Engineering202020(13): 5230-5234 (in Chinese).
[66] WIN K P, KITJAIDURE Y. Biomedical images stitching using orb feature based approach[C]∥2018 International Conference on Intelligent Informatics and Biomedical Sciences (ICIIBMS). Piscataway: IEEE Press, 20183: 221-225.
[67] CHEN J, LUO L B, WANG S W, et al. Automatic panoramic UAV image mosaic using ORB features and robust transformation estimation[C]∥2018 37th Chinese Control Conference (CCC). Piscataway: IEEE Press, 2018: 4265-4270.
[68] YEH C C, CHANG Y L, HSU P H, et al. GPU acceleration of UAV image splicing using oriented fast and rotated brief combined with PCA[C]∥IGARSS 2018-2018 IEEE International Geoscience and Remote Sensing Symposium. Piscataway: IEEE Press, 2018: 5700-5703.
[69] 梁中岩, 戚红雨, 王伟良, 等. 无人机载荷图像地理信息拼接及验证算法[J]. 计算机工程与科学202042(12): 2208-2216.
  LIANG Z Y, QI H Y, WANG W L, et al. UAV image mosaicking and verification algorithm with geographic information processing[J]. Computer Engineering & Science202042(12): 2208-2216 (in Chinese).
[70] 李振宇, 田源, 陈方杰, 等. 基于改进ORB和PROSAC的无人机航拍图像拼接算法[J]. 激光与光电子学进展201956(23): 91-99.
  LI Z Y, TIAN Y, CHEN F J, et al. Aerial image stitching algorithm for unmanned aerial vehicles based on improved ORB and PROSAC[J]. Laser & Optoelectronics Progress201956(23): 91-99 (in Chinese).
[71] ZHANG Y Y, ZHANG J Z, ZHANG L, et al. Research on panorama reconstruction technique of UAV aerial image based on improved ORB algorithm[C]∥2019 3rd International Conference on Electronic Information Technology and Computer Engineering (EITCE). Piscataway: IEEE Press, 2019: 1252-1256.
[72] 叶铮, 朱岱寅, 吴迪. 一种基于重叠子孔径回波信息的SAR图像配准算法[J]. 航空学报202344(8): 327254.
  YE Z, ZHU D Y, WU D. SAR image registration algorithm based on echo information of overlapping subaperture[J]. Acta Aeronautica et Astronautica Sinica202344(8): 327254 (in Chinese).
[73] 程健, 闫鹏鹏, 郁华森, 等. 基于有向线段误匹配剔除的煤矿巷道复杂场景图像拼接方法[J]. 煤炭科学技术202250(9): 179-191.
  CHENG J, YAN P P, YU H S, et al. Image stitching method for the complicated scene of coalmine tunnel based on mismatched elimination with directed line segments[J]. Coal Science and Technology202250(9): 179-191 (in Chinese).
[74] 杜港, 侯凌燕, 佟强, 等. 基于BRISK和改进RANSAC算法的图像拼接[J]. 液晶与显示202237(6): 758-767.
  DU G, HOU L Y, TONG Q, et al. Image mosaicing based on BRISK and improved RANSAC algorithm[J]. Chinese Journal of Liquid Crystals and Displays202237(6): 758-767 (in Chinese).
[75] 孙世宇, 张岩, 胡永江, 等. 改进模型估计的无人机侦察视频快速拼接方法[J]. 红外与激光工程201847(9): 382-390.
  SUN S Y, ZHANG Y, HU Y J, et al. Fast mosaic method of unmanned aerial vehicle reconnaissance video based on improvement model fitting[J]. Infrared and Laser Engineering201847(9): 382-390 (in Chinese).
[76] ZHENG J, PENG W, WANG Y, et al. Accelerated RANSAC for accurate image registration in aerial video surveillance[J]. IEEE Access20219: 36775-36790.
[77] 罗凯, 徐俊武, 杨敏. 一种改进KNN的无人机图像快速拼接方法[J]. 武汉工程大学学报202143(3): 344-348.
  LUO K, XU J W, YANG M. Improved stitching method based on KNN for UAV images[J]. Journal of Wuhan Institute of Technology202143(3): 344-348 (in Chinese).
[78] 韩敏, 闫阔, 秦国帅. 基于改进KAZE的无人机航拍图像拼接算法[J]. 自动化学报201945(2): 305-314.
  HAN M, YAN K, QIN G S. A mosaic algorithm for UAV aerial image with improved KAZE[J]. Acta Automatica Sinica201945(2): 305-314 (in Chinese).
[79] LIAO T, WANG C, LI L, et al. Parallax-tolerant image stitching via segmentation-guided multi-homography warping[J]. Signal Processing2025230: 109860.
[80] 钟梦帆, 裴继红. 局部特征点对称约束的图像拼接增强方法[J]. 航空学报202243(S1): 726948.
  ZHONG M F, PEI J H. Image mosaic enhancement method with symmetric constraint of local feature points[J]. Acta Aeronautica et Astronautica Sinica202243(S1): 726948 (in Chinese).
[81] 高琰, 肖小月, 李小虎, 等. 非一致重叠率大批量航拍远红外图像拼接方法研究[J]. 红外与激光工程202251(7): 461-472.
  GAO Y, XIAO X Y, LI X H, et al. Research on the stitching method of massive aerial far-infrared images with an inconsistent overlap rate[J]. Infrared and Laser Engineering202251(7): 461-472 (in Chinese).
[82] CHANG C H, SATO Y, CHUANG Y Y. Shape-preserving half-projective warps for image stitching[C]∥2014 IEEE Conference on Computer Vision and Pattern Recognition. Piscataway: IEEE Press, 2014: 3254-3261.
[83] 吴衔誉, 庄嘉权, 林忠麟, 等. 用于缺陷检测的指尖型大面积光学式触觉传感器设计与性能研究[J]. 仪器仪表学报202344(2): 164-174.
  WU X Y, ZHUANG J Q, LIN Z L, et al. Design and performance research of a large-area fingertip optical tactile sensor for surface defect detection[J]. Chinese Journal of Scientific Instrument202344(2): 164-174 (in Chinese).
[84] 张冬梅, 卢小平, 苗沛基, 等. 一种改进的APAP影像匹配算法[J]. 测绘通报2020(3): 123-128.
  ZHANG D M, LU X P, MIAO P J, et al. An improved APAP image matching algorithm[J]. Bulletin of Surveying and Mapping2020(3): 123-128 (in Chinese).
[85] LIU B, ZHANG J P, LI Z. An improved APAP algorithm via line segment correction for UAV multispectral image stitching[C]∥IGARSS 2022-2022 IEEE International Geoscience and Remote Sensing Symposium. Piscataway: IEEE Press, 2022: 6057-6060.
[86] 刘强, 韩敏. 基于直线特征约束网格变形的航拍图像拼接[J]. 控制与决策202237(3): 669-675.
  LIU Q, HAN M. Linear-preserve-mesh warps in aerial image stitching[J]. Control and Decision202237(3): 669-675 (in Chinese).
[87] XU J, ZHAO D D, REN Z W, et al. A parallax image mosaic method for low altitude aerial photography with artifact and distortion suppression[J]. Journal of Imaging20229(1): 5.
[88] 赵辉, 杜雅欣, 王红君, 等. 改进保形半投影的无人机遥感图像拼接算法[J]. 现代电子技术202144(20): 133-136.
  ZHAO H, DU Y X, WANG H J, et al. UAV remote sensing image stitching algorithm with improved SPHP[J]. Modern Electronics Technique202144(20): 133-136 (in Chinese).
[89] FANG F M, WANG T T, FANG Y Y, et al. Fast color blending for seamless image stitching[J]. IEEE Geoscience and Remote Sensing Letters201916(7): 1115-1119.
[90] LENG J W, WANG S N. UAV remote sensing image mosaic technology combined with improved SPHP algorithm[C]∥2020 IEEE International Conference on Mechatronics and Automation (ICMA). Piscataway: IEEE Press, 2020: 1155-1160.
[91] TING R, HU Y C, YANG C S, et al. Research on fast natural aerial image mosaic[J]. Computers & Electrical Engineering202190: 107007.
[92] TING R, HU Y C, YANG C S, et al. A research on Quick-SIFT and ghosting elimination technique for UAV image mosaic[C]∥International Symposium on Artificial Intelligence and Robotics 2020, 2020: 275-284.
[93] KARIM S, TONG G, LI J Y, et al. Current advances and future perspectives of image fusion: A comprehensive review[J]. Information Fusion202390: 185-217.
[94] 田金炎, 段福洲, 王乐, 等. 基于Wallis与距离权重增强的无人机影像拼接缝消除[J]. 中国图象图形学报201419(5): 806-812.
  TIAN J Y, DUAN F Z, WANG L, et al. UAV image seam elimination method based on Wallis and distance weight enhancement[J]. Journal of Image and Graphics201419(5): 806-812 (in Chinese).
[95] 胡育诚, 芮挺, 杨成松, 等. 无人机航拍图像拼接重影消除技术研究[J]. 计算机应用研究202138(5): 1586-1589.
  HU Y C, RUI T, YANG C S, et al. Research on eliminate ghosting technique of UAV image mosaic[J]. Application Research of Computers202138(5): 1586-1589 (in Chinese).
[96] 易俐娜, 许筱, 张桂峰, 等. 轻小型无人机高光谱影像拼接研究[J]. 光谱学与光谱分析201939(6): 1885-1891.
  YI L N, XU X, ZHANG G F, et al. Light and small UAV hyperspectral image mosaicking[J]. Spectroscopy and Spectral Analysis201939(6): 1885-1891 (in Chinese).
[97] 徐亚明, 邢诚, 陈晓东. 一种基于拼接线的无人机序列影像拼接方法[J]. 武汉大学学报(信息科学版)201136(11): 1265-1269.
  XU Y M, XING C, CHEN X D. A mosaicking method for UAV sequence images based on seam line[J]. Geomatics and Information Science of Wuhan University201136(11): 1265-1269 (in Chinese).
[98] 赵馨雨, 屈盛官, 吕继亮, 等. 基于缝合线驱动图像拼接的表面粗糙度测量方法研究[J]. 中国激光202249(9): 7-15.
  ZHAO X Y, QU S G, LV J L, et al. Surface roughness measurement based on seam-driven image stitching[J]. Chinese Journal of Lasers202249(9): 7-15 (in Chinese).
[99] 王欢, 周颖玥, 王学渊, 等. 基于质量评价的无人机航拍图像拼接方法[J]. 计算机应用研究202239(8): 2511-2514.
  WANG H, ZHOU Y Y, WANG X Y, et al. Quality evaluation-based image stitching for UAV images[J]. Application Research of Computers202239(8): 2511-2514 (in Chinese).
[100] YUAN Y T, FANG F M, ZHANG G X. Superpixel-based seamless image stitching for UAV images[J]. IEEE Transactions on Geoscience and Remote Sensing202159(2): 1565-1576.
[101] 石耀榕, 肖敬达. 无人机影像拼接多分辨率自适应无缝融合方法[J]. 测绘通报2024(6): 36-40.
  SHI Y R, XIAO J D. Multi-resolution adaptive seamless fusion method for UAV image stitching[J]. Bulletin of Surveying and Mapping2024(6): 36-40 (in Chinese).
[102] 刘媛媛, 何铭, 王跃勇, 等. 基于优化SIFT算法的农田航拍全景图像快速拼接[J]. 农业工程学报202339(1): 117-125.
  LIU Y Y, HE M, WANG Y Y, et al. Fast stitching for the farmland aerial panoramic images based on optimized SIFT algorithm[J]. Transactions of the Chinese Society of Agricultural Engineering202339(1): 117-125 (in Chinese).
[103] RONNEBERGER O, FISCHER P, BROX T. U-Net: Convolutional networks for biomedical image segmentation[M]∥Medical Image Computing and Computer-Assisted Intervention-MICCAI 2015. Cham: Springer International Publishing, 2015: 234-241.
[104] SHELHAMER E, LONG J, DARRELL T. Fully convolutional networks for semantic segmentation[C]∥IEEE Transactions on Pattern Analysis and Machine Intelligence. Piscataway: IEEE Press, 2017: 640-651.
[105] ZHANG G X, QIN D Y, YANG J Q, et al. UAV low-altitude aerial image stitching based on semantic segmentation and ORB algorithm for urban traffic[J]. Remote Sensing202214(23): 6013.
[106] 张海波, 寇姣姣, 杨兴, 等. 面向青花瓷碎片图像的U-Net++拼接网络[J]. 计算机辅助设计与图形学学报202436(3): 379-387.
  ZHANG H B, KOU J J, YANG X, et al. U-net++ mosaic network for blue and white porcelain fragment images[J]. Journal of Computer-Aided Design & Computer Graphics202436(3): 379-387 (in Chinese).
[107] 何赟泽, 张帆, 刘昊, 等. 风机叶片无人机红外热图像拼接方法[J]. 电子测量与仪器学报202236(7): 44-53.
  HE Y Z, ZHANG F, LIU H, et al. Infrared image stitch method of wind turbine blade based on UAV[J]. Journal of Electronic Measurement and Instrumentation202236(7): 44-53 (in Chinese).
[108] 许恒雷, 陈帅旗, 宋勋, 等. 基于图像语义分割与结构保持约束的风机叶片拼接技术[J]. 现代防御技术202452(4): 123-129.
  XU H L, CHEN S Q, SONG X, et al. Blade stitching technology based on image semantic segmentation and structure preservation constraints[J]. Modern Defence Technology202452(4): 123-129 (in Chinese).
[109] 黄西尧, 何羿霆, 杜华军, 等. 地球同步轨道目标物深度学习检测方法[J]. 宇航学报202142(10): 1283-1292.
  HUANG X Y, HE Y T, DU H J, et al. Geostationary orbit object detection based on deep learning[J]. Journal of Astronautics202142(10): 1283-1292 (in Chinese).
[110] DETONE D, MALISIEWICZ T, RABINOVICH A. SuperPoint: Self-supervised interest point detection and description[C]∥2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW). Piscataway: IEEE Press, 2018: 337-33712.
[111] MA J Y, JIANG X Y, FAN A X, et al. Image matching from handcrafted to deep features: A survey[J]. International Journal of Computer Vision2021129(1): 23-79.
[112] 曾旭东, 樊绍胜, 续尚植, 等. 低光照环境下基于轻量级SuperPoint的单目VI-SLAM算法[J]. 激光与光电子学进展202461(18): 187-198.
  ZENG X D, FAN S S, XU S Z, et al. Monocular VI-SLAM algorithm based on lightweight SuperPoint network in low-light environment[J]. Laser & Optoelectronics Progress202461(18): 187-198 (in Chinese).
[113] ZHENG H X, CHANG Z Q, LI Y K, et al. An efficient and fast image mosaic approach for highway panoramic UAV images[J]. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing202417: 10454-10467.
[114] MO Y, KANG X D, DUAN P H, et al. A robust UAV hyperspectral image stitching method based on deep feature matching[J]. IEEE Transactions on Geoscience and Remote Sensing202160: 5517514.
[115] 王宇斐, 刘骁佳, 刘欢, 等. 孪生神经网络在航天产品电性能测试方面的应用[J]. 航空学报202243(S1): 727048.
  WANG Y F, LIU X J, LIU H, et al. Application of twin neural network in electrical performance testing of aerospace products[J]. Acta Aeronautica et Astronautica Sinica202243(S1): 727048 (in Chinese).
[116] 李嘉诚, 朱福珍. 基于孪生网络的无人机遥感图像拼接[J]. 黑龙江大学自然科学学报202340(4): 496-504.
  LI J C, ZHU F Z. UAV remote sensing image stitching based on Siamese network[J]. Journal of Natural Science of Heilongjiang University202340(4): 496-504 (in Chinese).
[117] REN M X, LI J N, SONG L Q, et al. MLP-based efficient stitching method for UAV images[J]. IEEE Geoscience and Remote Sensing Letters202219: 2503305.
[118] HE K M, ZHANG X Y, REN S Q, et al. Deep residual learning for image recognition[C]∥2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). Piscataway: IEEE Press, 2016: 770-778.
[119] LUO X, LAI G L, WANG X, et al. UAV remote sensing image automatic registration based on deep residual features[J]. Remote Sensing202113(18): 3605.
[120] LECUN Y, BOSER B, DENKER J S, et al. Backpropagation applied to handwritten zip code recognition[J]. Neural Computation19891(4): 541-551.
[121] 罗旭东, 吴一全, 陈金林. 无人机航拍影像目标检测与语义分割的深度学习方法研究进展[J]. 航空学报202445(6): 028822.
  LUO X D, WU Y Q, CHEN J L. Research progress on deep learning methods for object detection and semantic segmentation in UAV aerial images[J]. Acta Aeronautica et Astronautica Sinica202445(6): 028822 (in Chinese).
[122] CAO W R. Applying image registration algorithm combined with CNN model to video image stitching[J]. The Journal of Supercomputing202177(12): 13879-13896.
[123] 董磊, 陈泓兵, 陈曦, 等. 基于DQN的单一飞行员驾驶模式分布式多智能体联盟任务分配策略[J]. 航空学报202344(13): 327895.
  DONG L, CHEN H B, CHEN X, et al. Distributed multi-agent coalition task allocation strategy for single pilot operation mode based on DQN[J]. Acta Aeronautica et Astronautica Sinica202344(13): 327895 (in Chinese).
[124] MA J, LIU W C, CHEN T W. DQN-based stitching algorithm for unmanned aerial vehicle images[M]∥Advanced Data Mining and Applications. Cham: Springer Nature Switzerland, 2023: 125-138.
[125] 陈珺, 高海宽, 李梓贤. 基于半投影翘曲的无人机图像拼接方法[J]. 计算机应用研究202441(1): 301-305.
  CHEN J, GAO H K, LI Z X. UAV image stitching method based on half-projection warping[J]. Application Research of Computers202441(1): 301-305 (in Chinese).
[126] 贾银江, 徐哲男, 苏中滨, 等. 基于优化SIFT算法的无人机遥感作物影像拼接[J]. 农业工程学报201733(10): 123-129.
  JIA Y J, XU Z N, SU Z B, et al. Mosaic of crop remote sensing images from UAV based on improved SIFT algorithm[J]. Transactions of the Chinese Society of Agricultural Engineering201733(10): 123-129 (in Chinese).
[127] SHAN J H, JIANG W, HUANG Y, et al. Unmanned aerial vehicle (UAV)-based pavement image stitching without occlusion, crack semantic segmentation, and quantification[J]. IEEE Transactions on Intelligent Transportation Systems202425(11): 17038-17053.
[128] 刘杰, 游品鸿, 田明, 等. 基于局部投影的视差图像拼接平滑优化[J]. 电子学报202250(6): 1451-1456.
  LIU J, YOU P H, TIAN M, et al. Smooth optimization of parallax images mosaic based on local projection[J]. Acta Electronica Sinica202250(6): 1451-1456 (in Chinese).
[129] 徐勇, 裴海龙. 基于特征的机载激光点云与影像数据的融合[J]. 计算机测量与控制201422(2): 607-610.
  XU Y, PEI H L. Fusion of airborne laser point clouds and area-array data based on features[J]. Computer Measurement & Control201422(2): 607-610 (in Chinese).
[130] 周志艳, 闫梦璐, 陈盛德, 等. Harris角点自适应检测的水稻低空遥感图像配准与拼接算法[J]. 农业工程学报201531(14): 186-193.
  ZHOU Z Y, YAN M L, CHEN S D, et al. Image registration and stitching algorithm of rice low-altitude remote sensing based on Harris corner self-adaptive detection[J]. Transactions of the Chinese Society of Agricultural Engineering201531(14): 186-193 (in Chinese).
[131] WANG J X, DU P, YANG S Q, et al. A spatial arrangement preservation-based stitching method via geographic coordinates of UAV for farmland remote sensing image[J]. IEEE Transactions on Geoscience and Remote Sensing202462: 4404713.
[132] 韩建峰, 张妍. 基于无人机航拍路面的拼接算法研究[J]. 激光与光电子学进展202057(20): 46-52.
  HAN J F, ZHANG Y. Research on stitching algorithm based on UAV based on aerial photography[J]. Laser & Optoelectronics Progress202057(20): 46-52 (in Chinese).
[133] 党良慧, 张玉金, 姜月武, 等. 基于多特征优选的图像拼接算法及系统设计[J]. 智能计算机与应用202111(7): 60-65.
  DANG L H, ZHANG Y J, JIANG Y W, et al. Image stitching algorithm and system design based on multi-feature optimization[J]. Intelligent Computer and Applications202111(7): 60-65 (in Chinese).
[134] 徐旭, 康青, 陈善静, 等. 基于Agisoft Metashape图像拼接的无人机环境热像监测应用研究[J]. 红外技术202345(1): 49-55.
  XU X, KANG Q, CHEN S J, et al. Application of UAV environmental thermography monitoring based on agisoft metashape image mosaic[J]. Infrared Technology202345(1): 49-55 (in Chinese).
[135] 宋晔, 吴一全. 基于无人机航拍的风力发电机叶片表面缺陷检测综述[J]. 仪器仪表学报202445(10): 1-25.
  SONG Y, WU Y Q. Review of wind turbine blade surface defect detection based on UAV aerial photography[J]. Chinese Journal of Scientific Instrument202445(10): 1-25 (in Chinese).
[136] 张文峰, 彭向阳, 陈锐民, 等. 基于无人机红外视频的输电线路发热缺陷智能诊断技术[J]. 电网技术201438(5): 1334-1338.
  ZHANG W F, PENG X Y, CHEN R M, et al. Intelligent diagnostic techniques of abnormal heat defect in transmission lines based on unmanned helicopter infrared video[J]. Power System Technology201438(5): 1334-1338 (in Chinese).
[137] 李万润, 范博源, 赵文海, 等. 基于无人机及YOLOX视觉算法的大跨度钢结构吊装过程位移监测[J]. 振动与冲击202443(17): 61-70.
  LI W R, FAN B Y, ZHAO W H, et al. Displacement monitoring in large-span steel structure hoisting process based on drone and YOLOX visual algorithm[J]. Journal of Vibration and Shock202443(17): 61-70 (in Chinese).
[138] 彭泓, 李红利, 杜宇, 等. 电力巡线无人机航拍图像拼接算法[J]. 计算机应用与软件202037(5): 243-248, 255.
  PENG H, LI H L, DU Y, et al. Stitching algorithm of aerial images taken by power patrol UAV[J]. Computer Applications and Software202037(5): 243-248, 255 (in Chinese).
文章导航

/