ACTA AERONAUTICAET ASTRONAUTICA SINICA >
Image matching based airborne inertial navigation system position and heading correction method
Received date: 2025-05-28
Revised date: 2025-06-27
Accepted date: 2025-09-03
Online published: 2025-09-10
Supported by
National Key Research and Development Program of China(2023YFC2907000);National Natural Science Foundation of China(62203163);Hunan Provincial Natural Science Foundation(2025JJ60407)
To address the challenge of UAV navigation in GPS-free and nighttime environments， this paper proposes an airborne autonomous localization and navigation method based on heterogenous image matching and inertial navigationfusion. The proposed method enables the alignment of infrared or visible aerial images with geo-referenced satellite images， and subsequently realizes autonomous localization estimation and heading correction based on the alignment results. The heterogenous image matching method in this paper consists of a fast structural feature-based image matching module and an end-to-end learning-based fine registration network. The former provides position corrections at approximately 20 Hz， while the latter enables high-precision position and heading refinement. A pose fusion filtering strategy is employed to integrate the position and heading information obtained from image matching with inertial navigation data， effectively suppressing the drift in inertial systems and ultimately improving navigation accuracy. The flight test shows that the proposed method can effectively improve the positioning accuracy and reliability compared with existing methods， and can reach real-time processing on the airborne embedded computing platform.
Jing DONG , Quanfu HU , Haiqiao LIU , Songlai HAN , Yating YAO , Zhikang CHEN . Image matching based airborne inertial navigation system position and heading correction method[J]. ACTA AERONAUTICAET ASTRONAUTICA SINICA, 2026 , 47(10) : 632116 -632116 . DOI: 10.7527/S1000-6893.2025.32116
| [1] | LIN J R， ZHANG F. R3LIVE： A robust， real-time， RGB-colored， LiDAR-inertial-visual tightly-coupled state estimation and mapping package［C］∥2022 International Conference on Robotics and Automation （ICRA）. Piscataway： IEEE Press， 2022： 10672-10678. |
| [2] | 周治国， 邸顺帆. 基于强度扫描上下文回环检测的激光雷达SLAM算法［J］. 中国惯性技术学报， 2022， 30（6）： 738-745. |
| ZHOU Z G， DI S F. Lidar SLAM based on intensity scan context loop closure detection［J］. Journal of Chinese Inertial Technology， 2022， 30（6）： 738-745 （in Chinese）. | |
| [3] | SHAN M， WANG F， LIN F， et al. Google map aided visual navigation for UAVs in GPS-denied environment［C］∥2015 IEEE International Conference on Robotics and Biomimetics （ROBIO）. Piscataway： IEEE Press， 2015： 114-119. |
| [4] | KINNARI J， VERDOJA F， KYRKI V. Season-invariant GNSS-denied visual localization for UAVs［J］. IEEE Robotics and Automation Letters， 2022， 7（4）： 10232-10239. |
| [5] | LOWE D G. Distinctive image features from scale-invariant keypoints［J］. International Journal of Computer Vision， 2004， 60（2）： 91-110. |
| [6] | BAY H， TUYTELAARS T， VAN GOOL L. SURF： Speeded up robust features［C］∥Computer Vision-ECCV 2006. Berlin： Springer， 2006： 404-417. |
| [7] | RUBLEE E， RABAUD V， KONOLIGE K， et al. ORB： An efficient alternative to SIFT or SURF［C］∥2011 International Conference on Computer Vision. Piscataway： IEEE Press， 2011： 2564-2571. |
| [8] | LI J Y， HU Q W， AI M Y. RIFT： Multi-modal image matching based on radiation-variation insensitive feature transform［J］. IEEE Transactions on Image Processing， 2019， 29： 3296-3310. |
| [9] | HAN X F， LEUNG T， JIA Y Q， et al. MatchNet： Unifying feature and metric learning for patch-based matching［C］∥2015 IEEE Conference on Computer Vision and Pattern Recognition （CVPR）. Piscataway： IEEE Press， 2015： 3279-3286. |
| [10] | 叶熠彬， 滕锡超， 于起峰， 等. 基于MatchNet和多点匹配约束的可见光-SAR图像匹配［J］. 航空学报， 2024， 45（10）： 329162. |
| YE Y B， TENG X C， YU Q F， et al. Optical-SAR image matching based on MatchNet and multi-point matching constraint［J］. Acta Aeronautica et Astronautica Sinica， 2024， 45（10）： 329162 （in Chinese）. | |
| [11] | 刘磊， 李元祥， 倪润生， 等. 基于卷积与图神经网络的合成孔径雷达与可见光图像配准［J］. 光学学报， 2022， 42（24）： 110-120. |
| LIU L， LI Y X， NI R S， et al. Synthetic aperture radar and optical images registration based on convolutional and graph neural networks［J］. Acta Optica Sinica， 2022， 42（24）： 110-120 （in Chinese）. | |
| [12] | JIANG H W， KARPUR A， CAO B Y， et al. OmniGlue： Generalizable feature matching with foundation model guidance［C］∥2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition （CVPR）. Piscataway： IEEE Press， 2024： 19865-19875. |
| [13] | SARLIN P E， DETONE D， MALISIEWICZ T， et al. SuperGlue： Learning feature matching with graph neural networks［C］∥2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition （CVPR）. Piscataway： IEEE Press， 2020： 4937-4946. |
| [14] | LINDENBERGER P， SARLIN P E， POLLEFEYS M. LightGlue： Local feature matching at light speed［C］∥2023 IEEE/CVF International Conference on Computer Vision （ICCV）. Piscataway： IEEE Press， 2023： 17581-17592. |
| [15] | ZHANG W， LI T T， ZHANG Y T， et al. LTFormer： A light-weight transformer-based self-supervised matching network for heterogeneous remote sensing images［J］. Information Fusion， 2024， 109： 102425. |
| [16] | REVAUD J， WEINZAEPFEL P， HARCHAOUI Z， et al. DeepMatching： Hierarchical deformable dense matching［J］. International Journal of Computer Vision， 2016， 120（3）： 300-323. |
| [17] | YE Y X， SHAN J， BRUZZONE L， et al. Robust registration of multimodal remote sensing images based on structural similarity［J］. IEEE Transactions on Geoscience and Remote Sensing， 2017， 55（5）： 2941-2958. |
| [18] | ZHAI F C， ZENG Q H， LI J， et al. Iterative geolocation based on cross-view image registration （IGCIR） for long-range targets［J］. Chinese Journal of Aeronautics， 2025， 38（7）： 103483. |
| [19] | PARK J H， NAM W J， LEE S W. A two-stream symmetric network with bidirectional ensemble for aerial image matching［J］. Remote Sensing， 2020， 12（3）： 465. |
| [20] | ZHANG H， LEI L， NI W P， et al. Optical and SAR image dense registration using a robust deep optical flow framework［J］. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing， 2023， 16： 1269-1294. |
| [21] | MUR-ARTAL R， MONTIEL J M M， TARDóS J D. ORB-SLAM： A versatile and accurate monocular SLAM system［J］. IEEE Transactions on Robotics， 2015， 31（5）： 1147-1163. |
| [22] | GOFORTH H， LUCEY S. GPS-denied UAV localization using pre-existing satellite imagery［C］∥2019 International Conference on Robotics and Automation （ICRA）. Piscataway： IEEE Press， 2019： 2974-2980. |
| [23] | CHANG C H， CHOU C N， CHANG E Y. CLKN： Cascaded Lucas-kanade networks for image alignment［C］∥2017 IEEE Conference on Computer Vision and Pattern Recognition （CVPR）. Piscataway： IEEE Press， 2017： 3777-3785. |
| [24] | CHEN N H， LOU T S， ZHAO L Y. MMHCA： Multi-feature representations based on multi-scale hierarchical contextual aggregation for UAV-view geo-localization［J］. Chinese Journal of Aeronautics， 2025， 38（6）： 103242. |
| [25] | WANG H Y， ZHOU F H， WU Q H. Accurate vision-enabled UAV location using feature-enhanced transformer-driven image matching［J］. IEEE Transactions on Instrumentation and Measurement， 2024， 73： 5502511. |
| [26] | SAMANO N， ZHOU M J， CALWAY A. Global aerial localisation using image and map embeddings［C］∥2021 IEEE International Conference on Robotics and Automation （ICRA）. Piscataway： IEEE Press， 2021： 5788-5794. |
| [27] | BARRON J L， FLEET D J， BEAUCHEMIN S S. Performance of optical flow techniques［J］. International Journal of Computer Vision， 1994， 12（1）： 43-77. |
| [28] | HE Y， CISNEROS I， KEETHA N， et al. Foundloc： Vision-based onboard aerial localization in the wild［DB/OL］. arXiv preprint： 2310.16299， 2023. |
| [29] | LI M K， WANG Z M， HUO G， et al. A deep learning framework with geographic information adaptive loss for remote sensing images based UAV self-positioning［DB/OL］. arXiv preprint： 2502.16164， 2025. |
| [30] | HARTLEY R， ZISSERMAN A.计算机视觉中的多视图几何［M］. 韦穗， 章权兵， 译. 第2版. 北京： 机械工业出版社， 2019： 157-158. |
| RICARD HARTLEY， ANDREW ZISSERMAN. Mul-tiple view geometry in computer vision［M］.WEI H， ZHANG Q B， translated. Version 2. Beijing：China Machine Press， 2019：157-158. | |
| [31] | GAO X S， HOU X R， TANG J L， et al. Complete solution classification for the perspective-three-point problem［J］. IEEE Transactions on Pattern Analysis and Machine Intelligence， 2003， 25（8）： 930-943. |
| [32] | WEI Y C， TAO L T. Efficient histogram-based sliding window［C］∥2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. Piscataway： IEEE Press， 2010： 3003-3010. |
| [33] | OUYANG W L， TOMBARI F， MATTOCCIA S， et al. Performance evaluation of full search equivalent pattern matching algorithms［J］. IEEE Transactions on Pattern Analysis and Machine Intelligence， 2012， 34（1）： 127-143. |
| [34] | ROCCO I， ARANDJELOVIC R， SIVIC J. End-to-end weakly-supervised semantic alignment［C］∥2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition. Piscataway： IEEE Press， 2018： 6917-6925. |
| [35] | FISCHLER M A， BOLLES R C. Random sample consensus： A paradigm for model fitting with applications to image analysis and automated cartography［J］. Communications of the ACM， 1981， 24（6）： 381-395. |
| [36] | XIE S N， GIRSHICK R， DOLLáR P， et al. Aggregated residual transformations for deep neural networks［C］∥2017 IEEE Conference on Computer Vision and Pattern Recognition （CVPR）. Piscataway： IEEE Press， 2017： 5987-5995. |
| [37] | RIBEIRO M I. Kalman and extended Kalman filters： Concept， derivation and properties［J］. Institute for Systems and Robotics， 2004， 43（46）： 3736-3741. |
| [38] | SAVAGE P G. Strapdown inertial navigation integration algorithm design part 2： Velocity and position algorithms［J］. Journal of Guidance， Control， and Dynamics， 1998， 21（2）： 208-221. |
| [39] | FURGALE P， REHDER J， SIEGWART R. Unified temporal and spatial calibration for multi-sensor systems［C］∥2013 IEEE/RSJ International Conference on Intelligent Robots and Systems. Piscataway： IEEE Press， 2013： 1280-1286. |
| [40] | LUO Y， CHA H， ZUO L， et al. General cross-modality registration framework for visible and infrared UAV target image registration［J］. Scientific Reports， 2023， 13（1）：12941. |
/
| 〈 |
|
〉 |
CJA