Articles

UAV swarm positioning method based on monocular vision and ranging information

  • Kun LI ,
  • Shuhui BU ,
  • Jiapeng LI ,
  • Juboxi WANG ,
  • Pengcheng HAN ,
  • Xiaohan LI ,
  • Haowei LI
Expand
  • 1.School of Aeronautics,Northwestern Polytechnical University,Xi’an 710072,China
    2.National Key Laboratory of Aircraft Configuration Design,Xi’an 710072,China

Received date: 2024-09-27

  Revised date: 2024-10-17

  Accepted date: 2024-11-22

  Online published: 2024-11-29

Supported by

Postdoctoral Fellowship Program of CPS(GZB20240986)

Abstract

Unmanned Aerial Vehicle (UAV) swarms play a pivotal role in the low-altitude economy. Accurate swarm positioning information underpins mission coordination, resource optimization, and efficient scheduling among drones, thereby facilitating the sustainable advancement of the low-altitude economy. In complex environments, however, Global Satellite Navigation System (GNSS) signals may be disrupted, rendering it difficult for UAV swarms to obtain accurate positioning data and compromising their ability to function collaboratively. To address this challenge in GNSS-denied environments, this paper presents a UAV swarm positioning method that integrates monocular vision and ranging information. Visual Odometry (VO) is employed to enable autonomous positioning for each UAV within the swarm. A communication framework is designed to transmit only essential data, including visual keyframes, pose frames, and map points, to the central server, thus reducing communication bandwidth. The concept of pose frame is introduced to address the limitation that keyframes cannot fuse with ranging information. The central server aligns maps from different UAVs based on the common view relationships between keyframes or the constraints between pose frames and their corresponding ranging data. The server then fuses and optimizes these maps using both visual and ranging information, achieving accurate swarm positioning. After global optimization, the server sends the corrected keyframe and map point data back to the local map of UAV’s VO to further enhance positioning accuracy. The proposed method is validated through simulations and experiments. Results demonstrate that the swarm positioning error is reduced to 0.49 m, outperforming current state-of-the-art visual positioning methods. Additionally, the scale error is reduced to 3.2%, effectively resolving the problem of scale ambiguity inherent in monocular visual positioning. This method proposed enables precise UAV swarm positioning based solely on inter-UAV ranging information, eliminating the need for shared visual features, and providing robust positioning data for UAV swarms operating in complex environments.

Cite this article

Kun LI , Shuhui BU , Jiapeng LI , Juboxi WANG , Pengcheng HAN , Xiaohan LI , Haowei LI . UAV swarm positioning method based on monocular vision and ranging information[J]. ACTA AERONAUTICAET ASTRONAUTICA SINICA, 2025 , 46(11) : 531281 -531281 . DOI: 10.7527/S1000-6893.2024.31281

References

[1] 於志文, 孙卓, 程岳, 等. 智能无人机集群协同感知计算研究综述[J]. 航空学报, 2024, 45(20): 630912.
  YU Z W, SUN Z, CHENG Y, et al. A review of intelligent UAV swarm collaborative perception and computation[J]. Acta Aeronautica et Astronautica Sinica, 2024, 45(20): 630912 (in Chinese).
[2] 姜霞, 曾宪琳, 孙健, 等. 多飞行器的分布式优化研究现状与展望[J]. 航空学报, 2021, 42(4): 524551.
  JIANG X, ZENG X L, SUN J, et al. Research status and prospect of distributed optimization for multiple aircraft[J]. Acta Aeronautica et Astronautica Sinica, 2021, 42(4): 524551 (in Chinese).
[3] 曾照洋, 彭文胜, 李云凯, 等. 智能无人机集群可靠性技术内涵、发展及挑战[J]. 兵工学报, 2025, 46(3):3-20.
  ZENG Z Y, PENG W S, LI Y K, et al. Connotation, development and challenges of reliability Technology of intelligent UAV swarm[J]. Acta Armamentarii, 2025, 46(3): 3-20 (in Chinese).
[4] CAUSA F, FASANO G, GRASSI M. GNSS-aware path planning for UAV swarm in complex environments[C]∥ 2019 IEEE 5th International Workshop on Metrology for AeroSpace (MetroAeroSpace). IEEE, 2019: 661-666.
[5] OUYANG X F, ZENG F L, LYU D Q, et al. Cooperative navigation of UAVs in GNSS-denied area with colored RSSI measurements[J]. IEEE Sensors Journal, 2021, 21(2): 2194-2210.
[6] 许勇, 颜鸿涛, 贾涛, 等. 固定翼集群无人机空中模拟对接技术[J]. 航空学报, 2023, 44(5): 212-228.
  XU Y, YAN H T, JIA T, et al. Aerial simulation docking technology of fixed-wing clustering UAVs[J]. Acta Aeronautica et Astronautica Sinica, 2023, 44(5): 212-228 (in Chinese).
[7] WANG S L, ALMANSA C M, QUERALTA J P, et al. UWB-based localization for multi-UAV systems and collaborative heterogeneous multi-robot systems[J]. Procedia Computer Science, 2020, 175: 357-364.
[8] 李昕, 孟硕林, 黄观文, 等. 基于SE(3)-EKF的旋翼无人机GNSS/SINS空中快速对准方法[J]. 中国惯性技术学报, 2023, 31(11): 1076-1082.
  LI X, MENG S L, HUANG G W, et al. Rapid in-flight alignment method for rotor UAV with GNSS/SINS based on SE(3)-EKF[J]. Journal of Chinese Inertial Technology, 2023, 31(11): 1076-1082 (in Chinese).
[9] 周文雅, 李哲, 许勇, 等. 基于双目视觉的无人机编队相对定位算法[J]. 宇航学报, 2022, 43(1): 122-130.
  ZHOU W Y, LI Z, XU Y, et al. Relative positioning algorithm of UAV formation based on binocular vision[J]. Journal of Astronautics, 2022, 43(1): 122-130 (in Chinese).
[10] SHETTY A, GAO G X. Adaptive covariance estimation of LiDAR-based positioning errors for UAVs[J]. Navigation, 2019, 66(2): 463-476.
[11] LUO H J, WEN C Y. A low-cost relative positioning method for UAV/UGV coordinated heterogeneous system based on visual-lidar fusion[J]. Aerospace, 2023, 10(11): 924.
[12] LI W J, FU Z Y. Unmanned aerial vehicle positioning based on multi-sensor information fusion[J]. Geo-spatial Information Science, 2018, 21(4): 302-310.
[13] YE X Y, SONG F J, ZHANG Z Y, et al. A review of small UAV navigation system based on multisource sensor fusion[J]. IEEE Sensors Journal, 2023, 23(17): 18926-18948.
[14] FORSTER C, ZHANG Z C, GASSNER M, et al. SVO: Semidirect visual odometry for monocular and multicamera systems[J]. IEEE Transactions on Robotics, 2017, 33(2): 249-265.
[15] MATSUKI H, VON STUMBERG L, USENKO V, et al. Omnidirectional DSO: Direct sparse odometry with fisheye cameras[J]. IEEE Robotics and Automation Letters, 2018, 3(4): 3693-3700.
[16] MUR-ARTAL R, TARDóS J D. ORB-SLAM2: An open-source SLAM system for monocular, stereo, and RGB-D cameras[J]. IEEE Transactions on Robotics, 2017, 33(5): 1255-1262.
[17] CAMPOS C, ELVIRA R, RODRíGUEZ J J G, et al. ORB-SLAM3: An accurate open-source library for visual, visual-inertial, and multimap SLAM[J]. IEEE Transactions on Robotics, 2021, 37(6): 1874-1890.
[18] MUR-ARTAL R, MONTIEL J M M, TARDóS J D. ORB-SLAM: A versatile and accurate monocular SLAM system[J]. IEEE Transactions on Robotics, 2015, 31(5): 1147-1163.
[19] MUR-ARTAL R, TARDóS J D. Fast relocalisation and loop closing in keyframe-based SLAM[C]∥ 2014 IEEE International Conference on Robotics and Automation (ICRA). Piscataway: IEEE Press, 2014: 846-853.
[20] DUAN C, JUNGINGER S, HUANG J H, et al. Deep learning for visual SLAM in transportation robotics: A review[J]. Transportation Safety and Environment, 2019, 1(3): 177-184.
[21] SANSONE F, FRANCESCONI A, OLIVIERI L, et al. Low-cost relative navigation sensors for miniature spacecraft and drones[C]∥ 2015 IEEE Metrology for Aerospace (MetroAeroSpace). Piscataway: IEEE Press, 2015: 389-394.
[22] WANG Q Q, CHAN K F, SCHWEIZER K, et al. Ultrasound Doppler-guided real-time navigation of a magnetic microswarm for active endovascular delivery[J]. Science Advances, 2021, 7(9): eabe5914.
[23] CHATTERJEE S, CHAKRABORTY S, NATH A, et al. Near-real-time detection of craters: A YOLOv5 based approach[C]∥ 2023 International Conference on Machine Intelligence for GeoAnalytics and Remote Sensing (MIGARS). Piscataway: IEEE Press, 2023: 1-4.
[24] 熊骏, 解相朋, 熊智, 等. 基于图模型的无人集群同步自定位与相对定位[J]. 航空学报, 2023, 44(Sup.2): 729708.
  XIONG J, XIE X P, XIONG Z, et al. Synchronized self-localization and relative-localization of unmanned swarms based on graph model[J]. Acta Aeronautica et Astronautica Sinica, 2023, 44(Sup.2): 729708 (in Chinese).
[25] 武成锋, 程进, 郭晓云, 等. 飞行器集群协同定位与导航对抗技术发展与展望[J]. 宇航学报, 2022, 43(2): 131-142.
  WU C F, CHENG J, GUO X Y, et al. Development and prospect of aircraft clusters cooperative positioning and navigation countermeasures technology[J]. Journal of Astronautics, 2022, 43(2): 131-142 (in Chinese).
[26] 杜祯强, 柴洪洲, 向民志, 等. UUVs集群协同定位的分散式增广信息滤波方法[J]. 测绘学报, 2022, 51(2): 182-191.
  DU Z Q, CHAI H Z, XIANG M Z, et al. Decentralized extend information filter for cooperative localization of UUVs[J]. Acta Geodaetica et Cartographica Sinica, 2022, 51(2): 182-191 (in Chinese).
[27] 刘俊成, 张京娟, 冯培德. 基于相互测距信息的机群组网协同定位技术[J]. 北京航空航天大学学报, 2012, 38(4): 541-545.
  LIU J C, ZHANG J J, FENG P D. Swarming aircraft collaborative localization based on mutual rangings[J]. Journal of Beijing University of Aeronautics and Astronautics, 2012, 38(4): 541-545 (in Chinese).
[28] 李坤, 布树辉, 贾旋, 等. 基于惯性导航与数据链的飞机间相对定位方法[J]. 航空学报, 2024, 45(15): 329594.
  LI K, BU S H, JIA X, et al. Relative aircraft positioning based on inertial navigation and datalink[J]. Acta Aeronautica et Astronautica Sinica, 2024, 45(15): 329594 (in Chinese).
[29] 于卓静, 孙永荣, 朱云峰, 等. 测角测距信息下的双机协同高精度定位算法[J]. 兵工自动化, 2019, 38(2): 1-5.
  YU Z J, SUN Y R, ZHU Y F, et al. High precision algorithm of dual-aircraft cooperative locating with angle and distance information[J]. Ordnance Industry Automation, 2019, 38(2): 1-5 (in Chinese).
[30] 牛皓飞, 蔡庆中, 李健, 等. 基于图优化的通信受限环境下协同导航方法[J]. 航空学报, 2023, 44(11): 327342.
  NIU H F, CAI Q Z, LI J, et al. Method for cooperative navigation in constrained environment based on graph optimization[J]. Acta Aeronautica et Astronautica Sinica, 2023, 44(11): 327342 (in Chinese).
[31] BURRI M, NIKOLIC J, GOHL P, et al. The EuRoC micro aerial vehicle datasets[J]. International Journal of Robotics Research, 2016, 35(10): 1157-1163.
Outlines

/

〈 〉