首页 >

基于鱼眼相机和RGBD相机的异构协同SLAM

张宇桐1,宋建梅2,丁艳1,刘锦鹏1   

  1. 1. 北京理工大学
    2. 北京理工大学宇航学院
  • 收稿日期:2022-06-14 修回日期:2022-09-23 出版日期:2022-09-30 发布日期:2022-09-30
  • 通讯作者: 丁艳
  • 基金资助:
    国家自然科学基金

Heterogeneous collaborative SLAM based on fisheye and RGBD camera

  • Received:2022-06-14 Revised:2022-09-23 Online:2022-09-30 Published:2022-09-30
  • Supported by:
    National Natural Science Foundation of China

摘要: SLAM技术在卫星导航拒止环境下的自主导航中有着广泛的应用前景。结合单目鱼眼SLAM可获取更多纹理信息的优势和RGBD-SLAM可直接获取尺度信息的优势,本文设计基于单目鱼眼相机和RGBD相机的异构协同SLAM系统。首先设计特征点对三维灰度质心方向一致性检验方法以筛选异构图像之间的候选匹配点。然后设计异构图像之间的分步式光流-投影匹配方法,以实现鱼眼相机和RGBD相机之间高性能的特征点匹配与相对位姿估计。最后基于ORBSLAM2框架,提出基于鱼眼相机和RGBD相机的异构协同SLAM系统框架。实验结果表明,相比于传统的特征点匹配方法,本文设计的特征匹配方法在异构相机的图像特征匹配任务中能够表现出更高的性能。相比于单目鱼眼SLAM系统和RGBD-SLAM系统,本文提出的异构协同SLAM系统在相机快速移动、相机贴近景物、低帧率、纹理缺失等条件下,以及在相机纯旋转运动、室外大场景等条件下性能更优,其鲁棒性、抗轨迹漂移能力和轨迹精度比单目鱼眼SLAM系统和RGBD-SLAM系统都有较大提升。

关键词: 异构协同SLAM, 异构图像特征匹配, 鱼眼相机, RGBD相机, 候选匹配点筛选

Abstract: SLAM technology has a broad application prospect in autonomous navigation in satellite navigation denied envi-ronments. To combine the advantages of monocular fisheye SLAM to obtain more texture information and RGBD-SLAM to directly obtain scale information, a heterogeneous collaborative SLAM system based on a monocular fisheye camera and a RGBD camera is designed. Firstly, a method for checking the 3D gray centroid direction con-sistency between feature points is designed to screen candidate matching points between heterogeneous images. Then, a step-by-step optical flow and projection matching method between heterogeneous images is designed to achieve high-performance feature point matching and relative pose estimation between fisheye and RGBD camera. Finally, based on ORB-SLAM2 framework, a heterogeneous collaborative SLAM system based on fisheye and RGBD camera is proposed. The experimental results show that, compared with the traditional feature point match-ing methods, the proposed feature point matching method shows higher performance in the image feature match-ing task for heterogeneous cameras. Compared with monocular fisheye SLAM and RGBD-SLAM system, the pro-posed heterogeneous collaborative SLAM system has better performance under the conditions of rapid camera movement, camera close to the scene, low frame rate, texture loss, pure rotation of the camera, outdoor large scenes, etc. its robustness, anti-drift ability and trajectory accuracy are greatly improved compared with mo-nocular fisheye SLAM and RGBD-SLAM system.

Key words: Heterogeneous collaborative SLAM, Heterogeneous image feature matching, Fisheye camera, RGBD camera, Candidate matching points filtering

中图分类号: