ACTA AERONAUTICAET ASTRONAUTICA SINICA >
Stable pose estimation and calibration method for projection augmented reality tracking locator
Received date: 2024-08-19
Revised date: 2024-10-16
Accepted date: 2024-11-25
Online published: 2024-12-05
Supported by
Special Funds for Basic Scientific Research Operating Expenses of Central Universities(56XCA2403107);China Aviation Industry Corporation Industry-University-Research Cooperation Project(HFZL2022CXY006);Nanjing University of Aeronautics and Astronautics Graduate Research and Practice Innovation Program(xcxjh20230512)
To overcome the projection limitations of traditional in-situ Projection Augmented Reality （PAR） systems in occlusion and restricted spaces， a tracking-based PAR assembly assistance system is designed and implemented. Firstly， in view of the transfer target positioning problem existing in system construction， a transfer target positioning algorithm based on voting is proposed by borrowing the idea of “model globally， match locally” from Point Pair Features （PPF）. In addition， in view of the pose calibration problem between the transfer target and the projector， a transfer pose calibration algorithm based on multi-station coupling is proposed. The pose model is simplified by using Kronecker product and solved by constructing Lagrangian equations. Finally， the effectiveness of the proposed algorithm is verified by conducting transfer target positioning stability tests and transfer pose calibration tests. The flexibility of the system is verified by conducting projection positioning tests in the aircraft nose cabin scene. It is shown that the system framework can effectively expand the application scope of the PAR system.
Xifu ZHAO , Haihua CUI , Yihua ZHANG , Renchuan YANG , Jiarui ZHOU , Kai PENG , Minjie LIAO . Stable pose estimation and calibration method for projection augmented reality tracking locator[J]. ACTA AERONAUTICAET ASTRONAUTICA SINICA, 2025 , 46(8) : 331072 -331072 . DOI: 10.7527/S1000-6893.2024.31072
| 1 | BOTTANI E， VIGNALI G. Augmented reality technology in the manufacturing industry： A review of the last decade［J］. IISE Transactions， 2019， 51（3）： 284-310. |
| 2 | LEE J， BAGHERI B， KAO H G. A cyber-physical systems architecture for industry 4.0-based manufacturing systems［J］. Manufacturing Letters， 2015， 3： 18-23. |
| 3 | 潘志庚， 高嘉利， 王若楠， 等. 面向实物交互的空间增强现实数字孪生法配准技术［J］. 计算机辅助设计与图形学学报， 2021， 33（5）： 655-661. |
| PAN Z G， GAO J L， WANG R N， et al. Digital twin registration technique of spatial augmented reality for tangible interaction?［J］. Journal of Computer-Aided Design & Computer Graphics， 2021， 33（5）： 655-661 （in Chinese）. | |
| 4 | 秦玉波， 穆欣伟， 邹方. 基于空间增强现实的辅助装配系统研究［J］. 航空制造技术， 2022， 65（12）： 56-62. |
| QIN Y B， MU X W， ZOU F. Research on auxiliary assembly system based on spatial augmented reality?［J］. Aeronautical Manufacturing Technology， 2022， 65（12）： 56-62 （in Chinese）. | |
| 5 | 叶凯玉， 周玲， 张辉， 等. 基于结构光场辅助的面阵定位投影标示技术研发［J］. 航空制造技术， 2024， 67（）： 131-138. |
| YE K Y， ZHOU L， ZHANG H， et al. Research on area array projection positioned indication based on structured light field aid?［J］. Aeronautical Manufacturing Technology， 2024， 67（Sup 1）： 131-138 （in Chinese）. | |
| 6 | TREINEN T， KOLLA S S V K. Augmented reality for quality inspection， assembly and remote assistance in manufacturing?［J］. Procedia Computer Science， 2024， 232： 533-543. |
| 7 | SERENO M， WANG X Y， BESANCON L， et al. Collaborative work in augmented reality： a survey［J］. IEEE Transactions on Visualization and Computer Graphics， 2022， 28（6）： 2530-2549. |
| 8 | BEARDSLEY P， VAN BAAR J， RASKAR R， et al. Interaction using a handheld projector?［J］. IEEE Computer Graphics and Applications， 2005， 25（1）： 39-43. |
| 9 | DEGANI A， LI W B， SACKS R， et al. An automated system for projection of interior construction layouts?［J］. IEEE Transactions on Automation Science and Engineering， 2019， 16（4）： 1825-1835. |
| 10 | CORTES G， MARCHAND E， BRINCIN G， et al. MoSART： Mobile spatial augmented reality for 3D interaction with tangible objects?［J］. Frontiers in Robotics and AI， 2018， 5： 93. |
| 11 | 翁金平， 程筱胜， 崔海华， 等. 面向三维测量的空间标志点高稳定实时匹配方法［J］. 激光与光电子学进展， 2016， 53（2）： 109-116. |
| WENG J P， CHENG X S， CUI H H， et al. Robust matching algorithm for real-time 3D measurement based on spatial marked points［J］. Laser & Optoelectronics Progress， 2016， 53（2）： 109-116 （in Chinese）. | |
| 12 | SHI J L， SUN Z X， BAI S Q. 3D reconstruction framework via combining one 3D scanner and multiple stereo trackers?［J］. The Visual Computer， 2018， 34（3）： 377-389. |
| 13 | WEN Z M， WANG Y J， LUO J， et al. Robust， fast and accurate vision-based localization of a cooperative target used for space robotic arm［J］. Acta Astronautica， 2017， 136： 101-114. |
| 14 | 温卓漫， 王延杰， 邸男， 等. 空间站机械臂位姿测量中合作靶标的快速识别［J］. 航空学报， 2015， 36（4）： 1330-1338. |
| WEN Z M， WANG Y J， DI N， et al. Fast recognition of cooperative target used for position and orientation measurement of space station’s robot arm［J］. Acta Aeronautica et Astronautica Sinica， 2015， 36（4）： 1330-1338 （in Chinese）. | |
| 15 | JIANG T， CHENG X， CUI H， et al. Combined shape measurement based on locating and tracking of an optical scanner［J］. Journal of Instrumentation， 2019， 14（1）： P01006. |
| 16 | 刘传凯， 雷俊雄， 刘茜， 等. 基于逆投影的多椭圆联合快速高精度定位算法?［J］. 航空学报， 2023， 44（12）： 327731. |
| LIU C K， LEI J X， LIU Q， et al. Fast and precise location measurement of joint multiple ellipses based on inverse transformation of perspective projection?［J］. Acta Aeronautica et Astronautica Sinica， 2023， 44（12）： 327731 （in Chinese）. | |
| 17 | BARONE S， PAOLI A， RAZIONALE A. 3D reconstruction and restoration monitoring of sculptural artworks by a multi-sensor framework［J］. Sensors， 2012， 12（12）： 16785-16801. |
| 18 | JIANG T， CUI H H， CHENG X S. Accurate calibration for large-scale tracking-based visual measurement system［J］. IEEE Transactions on Instrumentation and Measurement， 2020， 70： 5003011. |
| 19 | 陈媛， 罗哉， 杨力， 等. 一种基于立体靶标定位的三维重建方法［J］. 计量学报， 2024， 45（4）： 471-479. |
| CHEN Y， LUO Z， YANG L， et al. A 3D reconstruction method based on stereo target location?［J］. Acta Metrologica Sinica， 2024， 45（4）： 471-479 （in Chinese）. | |
| 20 | DROST B， ULRICH M， NAVAB N， et al. Model globally， match locally： Efficient and robust 3D object recognition［C］∥2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. Piscataway： IEEE Press， 2010. |
| 21 | BESL P J， MCKAY N D. A method for registration of 3-D shapes［J］. IEEE Transactions on Pattern Analysis and Machine Intelligence， 1992， 14（2）： 239-256. |
| 22 | LEPETIT V， MORENO-NOGUER F， FUA P. EPnP： An accurate O（n） solution to the PnP problem［J］. International Journal of Computer Vision， 2009， 81（2）： 155-166. |
/
| 〈 |
|
〉 |
CJA