基于图像匹配的机载惯导位置和航向修正方法
收稿日期: 2025-05-28
修回日期: 2025-06-27
录用日期: 2025-09-03
网络出版日期: 2025-09-10
基金资助
国家重点研发计划(2023YFC2907000);国家自然科学基金(62203163);湖南省自然科学基金(2025JJ60407)
Image matching based airborne inertial navigation system position and heading correction method
Received date: 2025-05-28
Revised date: 2025-06-27
Accepted date: 2025-09-03
Online published: 2025-09-10
Supported by
National Key Research and Development Program of China(2023YFC2907000);National Natural Science Foundation of China(62203163);Hunan Provincial Natural Science Foundation(2025JJ60407)
针对无人机在无GPS环境和夜间环境下难以导航的问题，提出了一种基于异源图像匹配与惯导融合的机载自主定位与导航方法。该方法能实现红外或可见光航拍图像与卫星可见光基准图像的配准，并基于配准结果实现自主定位和航向修正。所提出的异源图像匹配方法由基于结构特征的快速图像匹配和基于端到端学习网络的精确配准组成，前者可以提供20 Hz左右的位置修正，后者可以提供高精度的位置和航向修正。通过位姿融合滤波方法，将图像匹配获得位置和方向信息与惯导融合，可以有效抑制惯性导航误差的发散，最终提高导航精度。挂飞测试结果表明所提方法比较现有方法能有效提高定位精度和可靠性，并能在机载嵌入式计算平台上达成实时处理。
董晶 , 胡权富 , 刘海桥 , 韩松来 , 尧雅婷 , 陈志康 . 基于图像匹配的机载惯导位置和航向修正方法[J]. 航空学报, 2026 , 47(10) : 632116 -632116 . DOI: 10.7527/S1000-6893.2025.32116
To address the challenge of UAV navigation in GPS-free and nighttime environments， this paper proposes an airborne autonomous localization and navigation method based on heterogenous image matching and inertial navigationfusion. The proposed method enables the alignment of infrared or visible aerial images with geo-referenced satellite images， and subsequently realizes autonomous localization estimation and heading correction based on the alignment results. The heterogenous image matching method in this paper consists of a fast structural feature-based image matching module and an end-to-end learning-based fine registration network. The former provides position corrections at approximately 20 Hz， while the latter enables high-precision position and heading refinement. A pose fusion filtering strategy is employed to integrate the position and heading information obtained from image matching with inertial navigation data， effectively suppressing the drift in inertial systems and ultimately improving navigation accuracy. The flight test shows that the proposed method can effectively improve the positioning accuracy and reliability compared with existing methods， and can reach real-time processing on the airborne embedded computing platform.
| [1] | LIN J R， ZHANG F. R3LIVE： A robust， real-time， RGB-colored， LiDAR-inertial-visual tightly-coupled state estimation and mapping package［C］∥2022 International Conference on Robotics and Automation （ICRA）. Piscataway： IEEE Press， 2022： 10672-10678. |
| [2] | 周治国， 邸顺帆. 基于强度扫描上下文回环检测的激光雷达SLAM算法［J］. 中国惯性技术学报， 2022， 30（6）： 738-745. |
| ZHOU Z G， DI S F. Lidar SLAM based on intensity scan context loop closure detection［J］. Journal of Chinese Inertial Technology， 2022， 30（6）： 738-745 （in Chinese）. | |
| [3] | SHAN M， WANG F， LIN F， et al. Google map aided visual navigation for UAVs in GPS-denied environment［C］∥2015 IEEE International Conference on Robotics and Biomimetics （ROBIO）. Piscataway： IEEE Press， 2015： 114-119. |
| [4] | KINNARI J， VERDOJA F， KYRKI V. Season-invariant GNSS-denied visual localization for UAVs［J］. IEEE Robotics and Automation Letters， 2022， 7（4）： 10232-10239. |
| [5] | LOWE D G. Distinctive image features from scale-invariant keypoints［J］. International Journal of Computer Vision， 2004， 60（2）： 91-110. |
| [6] | BAY H， TUYTELAARS T， VAN GOOL L. SURF： Speeded up robust features［C］∥Computer Vision-ECCV 2006. Berlin： Springer， 2006： 404-417. |
| [7] | RUBLEE E， RABAUD V， KONOLIGE K， et al. ORB： An efficient alternative to SIFT or SURF［C］∥2011 International Conference on Computer Vision. Piscataway： IEEE Press， 2011： 2564-2571. |
| [8] | LI J Y， HU Q W， AI M Y. RIFT： Multi-modal image matching based on radiation-variation insensitive feature transform［J］. IEEE Transactions on Image Processing， 2019， 29： 3296-3310. |
| [9] | HAN X F， LEUNG T， JIA Y Q， et al. MatchNet： Unifying feature and metric learning for patch-based matching［C］∥2015 IEEE Conference on Computer Vision and Pattern Recognition （CVPR）. Piscataway： IEEE Press， 2015： 3279-3286. |
| [10] | 叶熠彬， 滕锡超， 于起峰， 等. 基于MatchNet和多点匹配约束的可见光-SAR图像匹配［J］. 航空学报， 2024， 45（10）： 329162. |
| YE Y B， TENG X C， YU Q F， et al. Optical-SAR image matching based on MatchNet and multi-point matching constraint［J］. Acta Aeronautica et Astronautica Sinica， 2024， 45（10）： 329162 （in Chinese）. | |
| [11] | 刘磊， 李元祥， 倪润生， 等. 基于卷积与图神经网络的合成孔径雷达与可见光图像配准［J］. 光学学报， 2022， 42（24）： 110-120. |
| LIU L， LI Y X， NI R S， et al. Synthetic aperture radar and optical images registration based on convolutional and graph neural networks［J］. Acta Optica Sinica， 2022， 42（24）： 110-120 （in Chinese）. | |
| [12] | JIANG H W， KARPUR A， CAO B Y， et al. OmniGlue： Generalizable feature matching with foundation model guidance［C］∥2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition （CVPR）. Piscataway： IEEE Press， 2024： 19865-19875. |
| [13] | SARLIN P E， DETONE D， MALISIEWICZ T， et al. SuperGlue： Learning feature matching with graph neural networks［C］∥2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition （CVPR）. Piscataway： IEEE Press， 2020： 4937-4946. |
| [14] | LINDENBERGER P， SARLIN P E， POLLEFEYS M. LightGlue： Local feature matching at light speed［C］∥2023 IEEE/CVF International Conference on Computer Vision （ICCV）. Piscataway： IEEE Press， 2023： 17581-17592. |
| [15] | ZHANG W， LI T T， ZHANG Y T， et al. LTFormer： A light-weight transformer-based self-supervised matching network for heterogeneous remote sensing images［J］. Information Fusion， 2024， 109： 102425. |
| [16] | REVAUD J， WEINZAEPFEL P， HARCHAOUI Z， et al. DeepMatching： Hierarchical deformable dense matching［J］. International Journal of Computer Vision， 2016， 120（3）： 300-323. |
| [17] | YE Y X， SHAN J， BRUZZONE L， et al. Robust registration of multimodal remote sensing images based on structural similarity［J］. IEEE Transactions on Geoscience and Remote Sensing， 2017， 55（5）： 2941-2958. |
| [18] | ZHAI F C， ZENG Q H， LI J， et al. Iterative geolocation based on cross-view image registration （IGCIR） for long-range targets［J］. Chinese Journal of Aeronautics， 2025， 38（7）： 103483. |
| [19] | PARK J H， NAM W J， LEE S W. A two-stream symmetric network with bidirectional ensemble for aerial image matching［J］. Remote Sensing， 2020， 12（3）： 465. |
| [20] | ZHANG H， LEI L， NI W P， et al. Optical and SAR image dense registration using a robust deep optical flow framework［J］. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing， 2023， 16： 1269-1294. |
| [21] | MUR-ARTAL R， MONTIEL J M M， TARDóS J D. ORB-SLAM： A versatile and accurate monocular SLAM system［J］. IEEE Transactions on Robotics， 2015， 31（5）： 1147-1163. |
| [22] | GOFORTH H， LUCEY S. GPS-denied UAV localization using pre-existing satellite imagery［C］∥2019 International Conference on Robotics and Automation （ICRA）. Piscataway： IEEE Press， 2019： 2974-2980. |
| [23] | CHANG C H， CHOU C N， CHANG E Y. CLKN： Cascaded Lucas-kanade networks for image alignment［C］∥2017 IEEE Conference on Computer Vision and Pattern Recognition （CVPR）. Piscataway： IEEE Press， 2017： 3777-3785. |
| [24] | CHEN N H， LOU T S， ZHAO L Y. MMHCA： Multi-feature representations based on multi-scale hierarchical contextual aggregation for UAV-view geo-localization［J］. Chinese Journal of Aeronautics， 2025， 38（6）： 103242. |
| [25] | WANG H Y， ZHOU F H， WU Q H. Accurate vision-enabled UAV location using feature-enhanced transformer-driven image matching［J］. IEEE Transactions on Instrumentation and Measurement， 2024， 73： 5502511. |
| [26] | SAMANO N， ZHOU M J， CALWAY A. Global aerial localisation using image and map embeddings［C］∥2021 IEEE International Conference on Robotics and Automation （ICRA）. Piscataway： IEEE Press， 2021： 5788-5794. |
| [27] | BARRON J L， FLEET D J， BEAUCHEMIN S S. Performance of optical flow techniques［J］. International Journal of Computer Vision， 1994， 12（1）： 43-77. |
| [28] | HE Y， CISNEROS I， KEETHA N， et al. Foundloc： Vision-based onboard aerial localization in the wild［DB/OL］. arXiv preprint： 2310.16299， 2023. |
| [29] | LI M K， WANG Z M， HUO G， et al. A deep learning framework with geographic information adaptive loss for remote sensing images based UAV self-positioning［DB/OL］. arXiv preprint： 2502.16164， 2025. |
| [30] | HARTLEY R， ZISSERMAN A.计算机视觉中的多视图几何［M］. 韦穗， 章权兵， 译. 第2版. 北京： 机械工业出版社， 2019： 157-158. |
| RICARD HARTLEY， ANDREW ZISSERMAN. Mul-tiple view geometry in computer vision［M］.WEI H， ZHANG Q B， translated. Version 2. Beijing：China Machine Press， 2019：157-158. | |
| [31] | GAO X S， HOU X R， TANG J L， et al. Complete solution classification for the perspective-three-point problem［J］. IEEE Transactions on Pattern Analysis and Machine Intelligence， 2003， 25（8）： 930-943. |
| [32] | WEI Y C， TAO L T. Efficient histogram-based sliding window［C］∥2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. Piscataway： IEEE Press， 2010： 3003-3010. |
| [33] | OUYANG W L， TOMBARI F， MATTOCCIA S， et al. Performance evaluation of full search equivalent pattern matching algorithms［J］. IEEE Transactions on Pattern Analysis and Machine Intelligence， 2012， 34（1）： 127-143. |
| [34] | ROCCO I， ARANDJELOVIC R， SIVIC J. End-to-end weakly-supervised semantic alignment［C］∥2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition. Piscataway： IEEE Press， 2018： 6917-6925. |
| [35] | FISCHLER M A， BOLLES R C. Random sample consensus： A paradigm for model fitting with applications to image analysis and automated cartography［J］. Communications of the ACM， 1981， 24（6）： 381-395. |
| [36] | XIE S N， GIRSHICK R， DOLLáR P， et al. Aggregated residual transformations for deep neural networks［C］∥2017 IEEE Conference on Computer Vision and Pattern Recognition （CVPR）. Piscataway： IEEE Press， 2017： 5987-5995. |
| [37] | RIBEIRO M I. Kalman and extended Kalman filters： Concept， derivation and properties［J］. Institute for Systems and Robotics， 2004， 43（46）： 3736-3741. |
| [38] | SAVAGE P G. Strapdown inertial navigation integration algorithm design part 2： Velocity and position algorithms［J］. Journal of Guidance， Control， and Dynamics， 1998， 21（2）： 208-221. |
| [39] | FURGALE P， REHDER J， SIEGWART R. Unified temporal and spatial calibration for multi-sensor systems［C］∥2013 IEEE/RSJ International Conference on Intelligent Robots and Systems. Piscataway： IEEE Press， 2013： 1280-1286. |
| [40] | LUO Y， CHA H， ZUO L， et al. General cross-modality registration framework for visible and infrared UAV target image registration［J］. Scientific Reports， 2023， 13（1）：12941. |
/
| 〈 |
|
〉 |
CJA