基于逆投影的多椭圆联合快速高精度定位算法

doi:10.7527/S1000-6893.2022.27731

Abstract

Abstract:

Cooperative target measurement is an important positioning method for many kinds of operation tasks such as spacecraft rendering， docking， capture and maintenance. However， the current positioning method based on cooperative target has some problems， such as complex operation of target extraction and vulnerability to interferences， which result in poor timeliness， stability， and positioning accuracy. To solve the above problems， a location method of circular cooperative target is proposed based on inverse transformation of perspective projection. Firstly， target contour points are projected into the space by inverse projection of the imaging beam to form a plurality of elliptical cones composed of ray clusters. Then， an optimization model of position and posture residuals is constructed based on the relative relationship between multiple circular outlines of the cooperative target and elliptical conical ray clusters. Finally， an accurate pose of the target is obtained by the Levenberg-Marquadt algorithm. The measurement proposed does not need to fit the ellipse according to target contour points， which improves the calculation efficiency and avoids the accuracy error caused by ellipse fitting. The joint adjustment of multiple ray clusters greatly reduces the influence of noise and error points on position and posture accuracy， and improves the robustness and anti-interference of the algorithm. The experimental results show that the proposed algorithm has high accuracy， computing efficiency and robustness at different distances and noise environments， and can provide strong support for rapid， stable and accurate visual measurement of cooperative targets in the scenes of capture and rendezvous and docking of the space manipulator.

Key words: cooperative target, space robot, multiple circle target, space inverse projection, visual localization

CLC Number:

V448.2

Chuankai LIU, Junxiong LEI, Qian LIU, Jun SUN, Jianhua SU, Xiaodong HU, Dongsheng LI. Fast and precise location measurement of joint multiple ellipses based on inverse transformation of perspective projection[J]. ACTA AERONAUTICAET ASTRONAUTICA SINICA, 2023, 44(12): 327731-327731.

Figures/Tables 18

Fig.1

Fig.2

Fig.3

Fig.4

输入	基于机械臂当前关节构型和基座位姿经正运动学结算得到末端相机初始迭代值 $Ω 0 = x 0, y 0, z 0, θ x 0, θ y 0, θ z 0 T$ 、常量 $β 、 σ ∈ 0,1$ ，当前迭代步数 $k = 0$ 、收敛阈值 $ε$ 取非常小的值， $s$ 表示 $Ω$ 的长度，即 $s = 6$ 。
步骤1	取 $Ω = Ω k$ 计算残差函数矩阵 $e k Ω k$ 及其雅可比矩阵 $J k Ω k$ 。
步骤2	计算 $g k = J k ⋅ e k$ ，如果 $n o r m g k ≤ ε$ ，迭代结束并返回 $Ω ̂ = Ω k$ ，否则进入步骤3。
步骤3	计算残差函数矩阵下降方向 $d k = - J k T ⋅ J k + m u k E s × s - 1 ⋅ g k$ ，其中 $m u k = n o r m e k$ 。
步骤4	采用Armijo算法线性搜索合适的下降步长 $h k$ ，满足 $e k Ω k + β ∧ h ⋅ d k ≤ e k Ω k + σ β ∧ h g k - 1 d k$ 的最小 $h$ 值。
步骤5	更新自变量 $Ω k + 1 = Ω k + β h k d k$ ，返回步骤2。
输出	末端相机精确位姿解 $Ω ̂$ 。

Fig.5

Fig.6

Fig.7

Fig.8

Fig.9

Fig.10

Table 1

Fig.11

Fig.12

Table 2

Fig.13

Fig.14

Fig.15

References 22

1	REDDY T. Analysis and CDNA microarray image segmentation based on Hough circle transform［J］. International Journal of Recent Technology and Engineering （IJRTE）， 2019， 7（5c）： 53-55.
2	陈燕新，戚飞虎. 一种新的基于随机Hough变换的椭圆检测方法［J］. 红外与毫米波学报， 2000， 19（1）： 43-47.
	CHEN Y X， QI F H. A new ellipse detection method using randomized Hough transform［J］. Journal of Infrared and Millimeter Waves， 2000， 19（1）： 43-47 （in Chinese）．
3	DE MARCO T， CAZZATO D， LEO M， et al. Randomized circle detection with isophotes curvature analysis［J］. Pattern Recognition， 2015， 48（2）： 411-421.
4	屈稳太. 基于弦中点Hough变换的椭圆检测方法［J］. 浙江大学学报（工学版）， 2005， 39（8）： 1132-1135， 1196.
	QU W T. Chord midpoint Hough transform based ellipse detection method［J］. Journal of Zhejiang University （Engineering Science）， 2005， 39（8）： 1132-1135， 1196 （in Chinese）.
5	张汝祥，陈德林，季江伟，等. 基于圆对称性和随机选点改进霍夫变换圆检测算法［J］. 科技创新与应用， 2019（14）： 41-43.
	ZHANG R X， CHEN D L， JI J W， et al. Improved Hough transform circle detection algorithm based on circle symmetry and random selection［J］. Technology Innovation and Application， 2019（14）： 41-43 （in Chinese）.
6	朱正伟，宋文浩，焦竹青，等. 基于随机Hough变换改进的快速圆检测算法［J］. 计算机工程与设计， 2018， 39（7）： 1978-1983.
	ZHU Z W， SONG W H， JIAO Z Q， et al. Fast circle detection algorithm based on improved randomized Hough transform［J］. Computer Engineering and Design， 2018， 39（7）： 1978-1983 （in Chinese）.
7	KIM E， HASEYAMA M， KITAJIMA H. Fast and robust ellipse extraction from complicated images［C］∥ Proceedings of the First International Conference on Information Technology and Applications. 2002： 357-362.
8	LU C S， XIA S Y， SHAO M， et al. Arc-support line segments revisited：Ａn efficient high-quality ellipse detection［J］. IEEE Transactions on Image Processing， 2020， 29： 768-781.
9	MENG C， LI Z X， BAI X Z， et al. Arc adjacency matrix-based fast ellipse detection［J］. IEEE Transactions on Image Processing， 2020， 29： 4406-4420.
10	徐伟高. 基于单目视觉的位姿测量关键技术研究［D］. 西安：中国科学院大学（中国科学院西安光学精密机械研究所）， 2016： 6-7.
	XU W G. Key technology research on pose measurement based on monocular vision［D］. Xi’an： Xi’an Institute of Optics and Precision Mechanics， Chinese Academy of Sciences， 2016： 6-7 （in Chinese）.
11	王波，胡浩，张彩霞，等. P3P问题多解现象的普遍性［J］. 中国科学：信息科学， 2017， 47（4）： 482-491.
	WANG B， HU H， ZHANG C X， et al. Generality of the multi-solution phenomenon in the P3P problem［J］. Scientia Sinica （Informationis）， 2017， 47（4）： 482-491 （in Chinese）.
12	BUJNAK M， KUKELOVA Z， PAJDLA T. A general solution to the P4P problem for camera with unknown focal length［C］∥ 2008 IEEE Conference on Computer Vision and Pattern Recognition. Piscataway： IEEE Press， 2008： 1-8.
13	ABDEL-AZIZ Y I， KARARA H M. Direct linear transformation into object space coordinates in close-range photogrammetry［C］∥Proceedings of Symp. Close-Range Photogrammetry， 1971： 1-18.
14	LU C P， HAGER G D， MJOLSNESS E. Fast and globally convergent pose estimation from video images［J］. IEEE Transactions on Pattern Analysis and Machine Intelligence， 2000， 22（6）： 610-622.
15	MORENO-NOGUER F， LEPETIT V， FUA P. Accurate non-iterative O（n） solution to the PnP problem［C］∥ 2007 IEEE 11th International Conference on Computer Vision. Piscataway： IEEE Press， 2007： 1-8.
16	HESCH J A， ROUMELIOTIS S I. A direct least-squares （DLS） method for PnP［C］∥ 2011 International Conference on Computer Vision. Piscataway： IEEE Press， 2012： 383-390.
17	温卓漫. 复杂场景下合作靶标的准确快速识别与定位［D］. 长春：中国科学院长春光学精密机械与物理研究所， 2017.
	WEN Z M. Accurate and fast identification and localization of A cooperative target in complex background［D］. Changchun： Changchun Institute of Optics， Fine Mechanics and Physics， Chinese Academy of Sciences， 2017 （in Chinese）.
18	刘传凯，李东升，王俊魁，等. 基于双目椭圆特征的月面采样机械臂末端位姿精确测量方法［J］. 中国科学：技术科学， 2021， 51（12）： 1453-1464.
	LIU C K， LI D S， WANG J K， et al. Precise pose measurement of lunar sampling manipulator based on binocular ellipse feature［J］. Scientia Sinica （Technologica）， 2021， 51（12）： 1453-1464 （in Chinese）.
19	李大明，饶炜，胡成威，等. 空间站机械臂关键技术研究［J］. 载人航天， 2014， 20（3）： 238-242.
	LI D M， RAO W， HU C W， et al. Key technology review of the research on the space station manipulator［J］. Manned Spaceflight， 2014， 20（3）： 238-242 （in Chinese）.
20	温卓漫，王延杰，邸男，等. 基于合作靶标的在轨手眼标定［J］. 仪器仪表学报， 2014， 35（5）： 1005-1012.
	WEN Z M， WANG Y J， DI N， et al. On-orbit hand-eye calibration using cooperative target［J］. Chinese Journal of Scientific Instrument， 2014， 35（5）： 1005-1012 （in Chinese）.
21	通过末端执行器与目标适配器之间的对接与分离，中国空间站机械臂可以实现舱外大范围爬行，辅助航天员出舱活动［EB/OL］. .
	Through the docking and separation between the end effector and the target adapter， the robotic arm of the Chinese space station can achieve a wide range of extravehicular crawling and assist astronauts in extravehicular activities［EB/OL］. （in Chinese）.
22	LI G， CAO C C， GE J， et al. Defects detection of pharmaceutical blister packaging based on shape template matching［J］. Applied Mechanics and Materials， 2015， 731： 426-429.

圆形序号	半径/mm	x/mm	y/mm	z/mm	姿态角
1（外白色圆环）	18.75	-4.596	59.92	265	靶标姿态角均与适配器一致
1（内白色圆圈）	8	-56.073	59.92	265
2	9.32	-4.596	59.92	218.723
3	9.32	-4.596	134.585	257
4	9.32	-4.596	-14.745	257
5	9.32	-4.596	178.388	235
6	9.32	-4.596	93.73	235
7	9.32	-4.596	26.11	235
8	9.32	-4.596	-58.548	235

序号	耗时/ms
序号	本文算法	椭圆拟合+ Iterative迭代法	椭圆拟合+ EPNP算法
1	1.401	13.234	10.841
4	1.545	8.852	8.043
7	1.384	9.251	9.09
10	0.665	11.966	8.767
13	0.580	8.596	8.238
16	1.358	9.014	8.39

[1]	Bin CHEN, Houyin XI, Xiaodong ZHANG, Min LUO, Zhidong GUO. Point cloud registration of space non-cooperative targets based on geodesic distance [J]. ACTA AERONAUTICAET ASTRONAUTICA SINICA, 2023, 44(1): 326336-326336.
[2]	WANG Zi, SUN Xiaoliang, LI Zhang, CHENG Zilong, YU Qifeng. Transformer based monocular satellite pose estimation [J]. ACTA AERONAUTICAET ASTRONAUTICA SINICA, 2022, 43(5): 325298-325298.
[3]	XIA Pengcheng, LUO Jianjun, WANG Mingming, TAN Longyu. Coordinated stabilization control for dual-arm space robot capturing a non-cooperative target [J]. ACTA AERONAUTICAET ASTRONAUTICA SINICA, 2022, 43(2): 325398-325398.
[4]	JIA Qingxuan, DUAN Jiaqi, CHEN Gang. Uncalibrated visual servo of space robots performing on-orbit assembly alignment task [J]. ACTA AERONAUTICAET ASTRONAUTICA SINICA, 2021, 42(6): 424063-424063.
[5]	SUN Bowen, WANG Dayi, WANG Jiongqi, ZHOU Haiyin, GE Dongming, DONG Tianshu. Filter method for dimension reduction in spacecraft autonomous navigation based on sequence image [J]. ACTA AERONAUTICAET ASTRONAUTICA SINICA, 2021, 42(4): 524971-524971.
[6]	CHU Weimeng, YANG Jinzhao, WU Shu'nan, WU Zhigang. LSTM-based on-orbit identification of inertia tensor for space robot system [J]. ACTA AERONAUTICAET ASTRONAUTICA SINICA, 2021, 42(11): 524615-524615.
[7]	MU Jinzhen, LIU Zongming, HAN Fei, ZHOU Yan, LI Shuang. Long-range relative pose estimation and optimization of a failure satellite [J]. ACTA AERONAUTICAET ASTRONAUTICA SINICA, 2021, 42(11): 524959-524959.
[8]	LI Wenhao, ZHANG Heng, FENG Guanhua. Cooperative teleoperation for multi-master/multi-slave systems with large time-varying delays [J]. ACTA AERONAUTICAET ASTRONAUTICA SINICA, 2021, 42(1): 523896-523896.
[9]	ZHOU Yiqun, LUO Jianjun, WANG Mingming. Load distribution for space robots after target capture [J]. ACTA AERONAUTICAET ASTRONAUTICA SINICA, 2021, 42(1): 523915-523915.
[10]	GE Jiahao, LIU Li, DONG Xinxin, TIAN Weiyong, LU Tianhe. Trajectory planning for free floating space robots based on kinodynamic RRT^* [J]. ACTA AERONAUTICAET ASTRONAUTICA SINICA, 2021, 42(1): 523877-523877.
[11]	WANG Mingming, LUO Jianjun, YUAN Jianping, WANG Jiawen, LIU Cong. In-orbit assembly technology: Review [J]. ACTA AERONAUTICAET ASTRONAUTICA SINICA, 2021, 42(1): 523913-523913.
[12]	LIU Jinglong, ZHANG Chongfeng, ZOU Huaiwu, LI Ning, WU Linna. On-orbit precise operation control method for flexible joint space robots based on disturbance observer [J]. ACTA AERONAUTICAET ASTRONAUTICA SINICA, 2021, 42(1): 523899-523899.
[13]	HAN Fei, LIU Fucheng, WANG Zhaolong, DU Xuan, LIU Shanshan, LIU Chaozhen. Multiple line-of-sight angles-only relative navigation by multiple collaborative space robots [J]. ACTA AERONAUTICAET ASTRONAUTICA SINICA, 2021, 42(1): 524174-524174.
[14]	MENG Guang, HAN Liangliang, ZHANG Chongfeng. Research progress and technical challenges of space robot [J]. ACTA AERONAUTICAET ASTRONAUTICA SINICA, 2021, 42(1): 523963-523963.
[15]	WAN Wenya, SUN Chong, YUAN Jianping. Multi-finger caging-based gripping path design for space non-cooperative targets [J]. ACTA AERONAUTICAET ASTRONAUTICA SINICA, 2020, 41(12): 324041-324041.

Fast and precise location measurement of joint multiple ellipses based on inverse transformation of perspective projection

RichHTML

PDF (PC)

Knowledge

Abstract

Cite this article

share this article

Figures/Tables 18

References 22

Related Articles 15

Recommended Articles

Metrics

Comments