Traditional in-situ projection augmented reality (PAR) systems cannot solve the problem of projection in occlusion and restricted spaces. To this end, this paper designs and implements a tracking-based PAR assembly assistance system. Aiming at the problem of transfer target positioning in the system, a transfer target positioning algorithm based on voting is proposed by borrowing the idea of "model globally, match locally" in point pair features (PPF); for the transfer pose calibration problem, a transfer pose calibration algorithm based on multi-station coupling is proposed, the
Kronecker product is used to simplify the model equation, and the Lagrangian equation is constructed to solve it. The effectiveness of the proposed algorithm is verified by conducting transfer target positioning stability tests and transfer pose accuracy tests; the flexibility of the proposed system is verified by conducting projection positioning tests in the aircraft nose cabin scene, which also shows that the system framework can effectively expand the application scope of the PAR system.
[1] BOTTANI E, VIGNALI G. Augmented reality technology in the manufacturing industry: A review of the last decade[J/OL]. IISE Transactions, 2019, 51(3): 284-310.
[2] Lee J, Bagheri B, Kao H A. A cyber-physical systems architecture for industry 4.0-based manufacturing sys-tems[J]. Manufacturing letters, 2015, 3: 18-23.
[3] 潘志庚,高嘉利,王若楠,等.面向实物交互的空间增强现实数字孪生法配准技术[J].计算机辅助设计与图形学学报,2021,33(05):655-661.
PAN Z G, GAO J L, WANG R N, et al. Digital Twin Registration Technique of Spatial Augmented Reality for Tangible Interaction[J]. Journal of Computer-Aided Design & Computer Graphics, 2021, 33(05): 655-661 (in Chinese).
[4] 秦玉波,穆欣伟,邹方.基于空间增强现实的辅助装配系统研究[J].航空制造技术,2022,65(12):56-62.
QIN Y B, MU X W, ZOU F. Research on auxiliary Assembly System based on space Augmented Reality [J]. Aeronautical Manufacturing Technology, 2022, 65(12): 56-62 (in Chinese).
[5] 叶凯玉,周玲,张辉,等.基于结构光场辅助的面阵定位投影标示技术研发[J].航空制造技术, 2024,67(1/2): 131-138.
YE K Y, ZHOU L, ZHANG H, et al. Research on Area Array Projection Positioned Indication Based on Struc-tured Light Field Aid[J]. Aeronautical Manufacturing Technology, 2024, 67(1/2): 131-138 (in Chinese).
[6] TREINEN T, KOLLA S S V K. Augmented Reality for Quality Inspection, Assembly and Remote Assistance in Manufacturing[J/OL].Procedia Computer Science, 2024, 232:533-543.
[7] SERENO M, WANG X, BESANCON L, et al. Col-laborative Work in Augmented Reality: A Survey[J/OL]. IEEE Transactions on Visualization and Computer Graphics, 2020: 1-1.
[8] BEARDSLEY P, VAN BAAR J, RASKAR R, et al. Interaction using a handheld projector[J/OL]. IEEE Computer Graphics and Applications, 2005, 25(1): 39-43.
[9] DEGANI A, LI W B, SACKS R, et al. An Automated System for Projection of Interior Construction Lay-outs[J/OL]. IEEE Transactions on Automation Science and Engineering, 2019, 16(4): 1825-1835.
[10] CORTES G, MARCHAND E, BRINCIN G, et al. MoSART: Mobile Spatial Augmented Reality for 3D Interaction With Tangible Objects[J/OL]. Frontiers in Robotics and AI, 2018, 5: 93.
[11] 翁金平,程筱胜,崔海华,等.面向三维测量的空间标志点高稳定实时匹配方法[J].激光与光电子学进展,2016,53(02):109-116.
WENG J P, CHENG X S, CUI H H, et al. Robust Matching Algorithm for Real-Time 3D Measurement Based on Spatial Marked Points[J]. Laser & Optoelec-tronics Progress, 2016, 53(02): 109-116 (in Chinese).
[12] SHI J, SUN Z, BAI S. 3D reconstruction framework via combining one 3D scanner and multiple stereo trackers[J/OL]. The Visual Computer, 2018, 34(3): 377-389.
[13] WEN Z, WANG Y, LUO J, et al.. Robust, fast and accurate vision-based localization of a cooperative target used for space robotic arm[J/OL]. Acta Astronautica, 2017, 136: 101-114.
[14] 温卓漫,王延杰,邸男,等.空间站机械臂位姿测量中合作靶标的快速识别[J].航空学报,2015,36(04):1330-1338.
WEN Z M, WANG Y J, DI N, et al.Fast recognition of cooperative target used for position and orientation measurement of space station's robot arm [J]. Acta As-tronautica Sinica,2015,36(04):1330-1338(in Chinese).
[15] JIANG T, CHENG X, CUI H, et al. Combined shape measurement based on locating and tracking of an opti-cal scanner[J/OL]. Journal of Instrumentation, 2019, 14(01): P01006-P01006.
[16] 刘传凯,雷俊雄,刘茜,等.基于逆投影的多椭圆联合快速高精度定位算法[J].航空学报,2023,44(12):250-264. LIU C K，LEI J X，LIU Q，et al. Fast and precise location measurement of joint multiple ellipses based on inverse transformation of perspective projection[J].Acta Aeronautica et Astronautica Sinica，2023，44(12)：250-264(in Chinese).
[17] BARONE S, PAOLI A, RAZIONALE A. 3D Recon-struction and Restoration Monitoring of Sculptural Artworks by a Multi-Sensor Frame-work[J/OL].Sensors, 2012, 12(12): 16785-16801.
[18] JIANG T, CUI H, CHENG X. Accurate Calibration for Large-Scale Tracking-Based Visual Measurement Sys-tem[J/OL]. IEEE Transactions on Instrumentation and Measurement, 2021, 70: 1-11.
[19] 陈媛,罗哉,杨力,等.一种基于立体靶标定位的三维重建方法[J].计量学报,2024,45(04):471-479.
CHEN Y, LUO Z, YANG L, et al. A 3D reconstruction method based on stereo target location[J]. Acta Metro-logica Sinica, 2024,45(04):471-479(in Chinese).
[20] DROST B, ULRICH M, NAVAB N, 等. Model glob-ally, match locally: Efficient and robust 3D object recognition[C/OL]//2010 IEEE Computer Society Con-ference on Computer Vision and Pattern Recognition. San Francisco, CA, USA: IEEE, 2010: 998-1005.
[21] BESL P J, MCKAY N D. A method for registration of 3-D shapes[J/OL]. IEEE Transactions on Pattern Anal-ysis and Machine Intelligence, 1992, 14(2): 239-256.
[22] LEPETIT V, MORENO-NOGUER F, FUA P. EPnP: An Accurate O(n) Solution to the PnP Problem[J/OL]. International Journal of Computer Vision, 2009, 81(2): 155-166.
CJA