电子电气工程与控制

一种无人机视觉位姿估计的语义特征匹配算法

  • 赵辰豪 ,
  • 吴德伟 ,
  • 何晶 ,
  • 吴倩
展开
  • 空军工程大学 信息与导航学院,西安 710077
.E-mail: wudewei74609@126.com

收稿日期: 2024-03-18

  修回日期: 2024-04-15

  录用日期: 2024-05-09

  网络出版日期: 2024-05-29

基金资助

国家自然科学基金(62206310);陕西高校青年创新团队(2023015)

A semantic feature matching algorithm for UAV visual pose estimation

  • Chenhao ZHAO ,
  • Dewei WU ,
  • Jing HE ,
  • Qian WU
Expand
  • School of Information and Navigation,Airforce Engineering University,Xi’an 710077,China

Received date: 2024-03-18

  Revised date: 2024-04-15

  Accepted date: 2024-05-09

  Online published: 2024-05-29

Supported by

National Natural Science Foundation of China(62206310);Youth Innovation Team of Shaanxi Universities(2023015)

摘要

传统视觉特征匹配算法提取的特征点易受光照、视角变化等外界因素的影响,复杂环境下算法匹配精度低、鲁棒性差,导致无人机视觉定位误差大。针对上述问题,提出了一种融合多类信息的语义特征匹配算法,该算法采用语义特征点替代传统特征点以提高特征点的鲁棒性与可重复提取率。首先,采用位置信息、语义信息以及描述信息建立特征点的初始表征;随后,利用具有注意力机制的图神经网络聚合其他语义特征点信息,建立最终表征,以优化表征结果的精确性;最后,根据语义信息与表征信息计算特征点对的综合匹配度,提高特征匹配的准确率。实验结果表明:在无人机飞行场景下,所提算法特征点的稳健性、特征匹配准确性均优于传统算法,且对光照、大视角等变化具有较强的鲁棒性,为后端无人机视觉导航位姿解算提供了更加可靠精准的语义特征匹配结果。

本文引用格式

赵辰豪 , 吴德伟 , 何晶 , 吴倩 . 一种无人机视觉位姿估计的语义特征匹配算法[J]. 航空学报, 2025 , 46(2) : 330406 -330406 . DOI: 10.7527/S1000-6893.2024.30406

Abstract

The feature points extracted by traditional methods in UAV navigation are susceptible to external factors such as changes in lighting and viewing angles, and the low matching accuracy and poor robustness of the algorithm in complex environment lead to large errors in pose estimation. To address these issues, this paper proposes a semantic feature matching algorithm that integrates multiple types of information. The algorithm replaces traditional feature points with semantic feature points to enhance robustness and repeatability of point extraction. To optimize the accuracy of the description, we establish the initial representations of feature points via positional, semantic, and descriptive information. Subsequently, a graph neural network incorporating a fusion attention mechanism is used to aggregate the information from other semantic feature points, so as to create the final representation. Finally, the comprehensive matching degree of feature point pairs is calculated based on semantic and characterization information to enhance the accuracy of feature matching. Experimental results demonstrate that in UAV flight scenarios, the proposed algorithm exhibits better robustness and feature matching accuracy compared to traditional algorithms. Moreover, it shows strong robustness to changes in lighting and large viewing angles, providing more reliable and accurate landmark matching for back-end UAV visual pose estimation.

参考文献

1 张闻宇, 李智, 王勇军. 基于CenSurE-star特征的无人机景象匹配算法[J]. 仪器仪表学报201738(2): 462-470.
  ZHANG W Y, LI Z, WANG Y J. UAV scene matching algorithm based on CenSurE-star feature?[J]. Chinese Journal of Scientific Instrument201738(2): 462-470 (in Chinese).
2 刘海桥, 刘萌, 龚子超, 等. 基于深度学习的图像匹配方法综述[J]. 航空学报202445(3): 028796.
  LIU H Q, LIU M, GONG Z C, et al. A review of image matching methods based on deep learning[J]. Acta Aeronautica et Astronautica Sinica202445(3): 028796 (in Chinese).
3 李家松, 李明磊, 魏大洲, 等. GPS拒止条件下的景象匹配导航方法研究[J]. 电子技术应用202248(3): 88-93.
  LI J S, LI M L, WEI D Z, et al. Research on scene matching navigation method under GPS-denied environments[J]. Application of Electronic Technique202248(3): 88-93 (in Chinese).
4 赵春晖, 周昳慧, 林钊, 等. 无人机景象匹配视觉导航技术综述[J]. 中国科学(信息科学)201949(5): 507-519.
  ZHAO C H, ZHOU Y H, LIN Z, et al. Review of scene matching visual navigation for unmanned aerial vehicles[J]. Scientia Sinica (Informationis)201949(5): 507-519 (in Chinese).
5 范继伟, 杨小冈, 卢瑞涛, 等. 基于遥感影像的智能景像匹配适配区选择方法[J]. 中国惯性技术学报202331(1): 14-23.
  FAN J W, YANG X G, LU R T, et al. Intelligent scene matching suitable area selection method based on remote sensing image[J]. Journal of Chinese Inertial Technology202331(1): 14-23 (in Chinese).
6 张绍荣, 张闻宇, 李云, 等. 基于FAST角点和FREAK描述符改进的无人机景象匹配算法[J]. 电子测量与仪器学报202034(4): 102-110.
  ZHANG S R, ZHANG W Y, LI Y, et al. Improved UAV scene matching algorithm based on FAST corner and FREAK descriptor[J]. Journal of Electronic Measurement and Instrumentation202034(4): 102-110 (in Chinese).
7 DONG J, HU M Q, LU J Z, et al. Affine template matching based on multi-scale dense structure principal direction[J]. IEEE Transactions on Circuits and Systems for Video Technology202131(6): 2125-2132.
8 REVAUD J, WEINZAEPFEL P, HARCHAOUI Z, et al. DeepMatching: hierarchical deformable dense matching[J]. International Journal of Computer Vision2016120(3): 300-323.
9 KORMAN S, REICHMAN D, TSUR G, et al. FasT-match: fast affine template matching[C]∥2013 IEEE Conference on Computer Vision and Pattern Recognition. Piscataway: IEEE Press, 2013: 2331-2338.
10 MUHAMMAD U, TANVIR M, KHURSHID K. Feature based correspondence: A comparative study on image matching algorithms[J]. International Journal of Advanced Computer Science and Applications20167(3): 235-246.
11 傅卫平, 秦川, 刘佳, 等. 基于SIFT算法的图像目标匹配与定位[J]. 仪器仪表学报201132(1): 163-169.
  FU WP, QIN C, LIU J, et al. Matching and location of image object based on SIFT algorithm[J]. Chinese Journal of Scientific Instrument201132(1): 163-169 (in Chinese) .
12 李晓明, 郝沙沙, 陈双慧. 结合先验知识的海底图像配准方法[J]. 计算机辅助设计与图形学学报202335(11): 1743-1750.
  LI X M, HAO S S, CHEN S H. Seabed image matching by incorporating prior knowledge[J]. Journal of Computer-Aided Design & Computer Graphics202335(11): 1743-1750 (in Chinese).
13 曾国奇, 牛子凡, 郑丽丽, 等. 基于球形变换的无人机视频图像实时拼接方法[J]. 航空学报202344(24): 328364.
  ZENG G Q, NIU Z F, ZHENG L L, et al. A real time video image stitching method for UAV based on spherical transformation[J]. Acta Aeronautica et Astronautica Sinica202344(24): 328364 (in Chinese).
14 冯亦东, 孙跃. 基于SURF特征提取和FLANN搜索的图像匹配算法[J]. 图学学报201536(4): 650-654.
  FENG DY, SUN Y. Image matching algorithm based on SURF feature extraction and FLANN search[J]. Journal of Graphics201536(4): 650-654 (in Chinese) .
15 李小红, 谢成明, 贾易臻, 等. 基于ORB特征的快速目标检测算法[J]. 电子测量与仪器学报201327(5): 455-460.
  LI X H, XIE C M, JIA Y Z, et al. Rapid moving object detection algorithm based on ORB features[J]. Journal of Electronic Measurement and Instrumentation201327(5): 455-460 (in Chinese).
16 MUR-ARTAL R, MONTIEL J M M, TARDOS J D. ORB-SLAM: A versatile and accurate monocular SLAM system[J]. IEEE Transactions on Robotics201531(5): 1147-1163.
17 SARLIN P E, DETONE D, MALISIEWICZ T, et al. SuperGlue: Learning feature matching with graph neural networks[C]∥2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). Piscataway: IEEE Press, 2020: 4937-4946.
18 WANG K, LENG C C, YAN H P, et al. Feature matching based on Gaussian kernel convolution and minimum relative motion[J]. Engineering Applications of Artificial Intelligence2024131: 107795.
19 SUN J M, SHEN Z H, WANG Y A, et al. LoFTR: detector-free local feature matching with transformers[C]∥2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). Piscataway: IEEE Press, 2021: 8918-8927.
20 REDMON J, FARHADI A. YOLOv3: an incremental improvement[DB/OL]. arXiv preprint1804.02767,2018.
文章导航

/