航拍视频帧间快速配准算法

doi:10.7527/S1000-6893.2013.0239

Abstract

Abstract:

To deal with the effect which is caused by camera moving, a fast and reliable image registration method between sequential frames for unmanned aerial vehicle (UAV) videos is proposed. Firstly, the stable FAST corners are selected via the constraints of spatial displacements and cornerness measurements. Meanwhile, an adaptive threshold method is involved in the feature detection process to improve environmental adaptability. Then, the binary descriptions of the detected features are generated by using the uncorrelated sample point set, which is obtained by training, and the matched points are established using the NN (Nearest Neighbor) algorithm based on hamming distances. Finally, the affine transformation parameters between adjacent frames are estimated using the matched points by RANSAC, which can be provided for further processing, such as moving object detection and tracking. Experimental results show that the proposed algorithm is fast and reliable, it has high environmental adaptability, and thus can meet the image registration requirements in UAV systems.

Key words: unmanned aerial vehicle, computer vision, aerial video, image registration, feature extraction

CLC Number:

V297
TP391

SHEN Hao, LI Shuxiao, SHEN Yiping, ZHU Chengfei, CHANG Hongxing. Fast Interframe Registration Method in Aerial Videos[J]. ACTA AERONAUTICAET ASTRONAUTICA SINICA, 2013, 34(6): 1405-1413.

References

[1] Zitova B, Flusser J. Image registration methods: a survey. Image and Vision Computing, 2003, 21(11): 977-1000.

[2] Brown M, Lowe D. Automatic panoramic image stitching using invariant features. International Journal of Computer Vision, 2007, 74(1): 59-73.

[3] Wang Y L, Zhang X, Gao C,et al. Feature matching based global motion estimation in aerial video mosaicing. Acta Aeronautica et Astronautica Sinica, 2008, 29(5): 1218-1225. (in Chinese) 王云丽, 张鑫, 高超, 等. 航拍视频拼图中基于特征匹配的全局运动估计方法. 航空学报, 2008, 29(5): 1218-1225.

[4] Xu D, An J W. Global motion estimation by fitting optical flow in aerial video imagery. Acta Aeronautica et Astronautica Sinica, 2006, 27(1): 94-97. (in Chinese) 许东, 安锦文. 一种基于光流拟和的航拍视频图像全局运动估算方法. 航空学报, 2006, 27(1): 94-97.

[5] Battiato S, Bruna A R, Puglisi G. A robust block-based image/video registration approach for mobile imaging devices. IEEE Transactions on Multimedia, 2010, 12(7): 622-635.

[6] Lowe D G. Distinctive image features from scale-invariant keypoints. International Journal of Computer Vision, 2004, 60(1): 91-110.

[7] Steedly D, Pal C, Szeliski R. Efficiently registering video into panoramic mosaic. Proceedings of the 10th IEEE International Conference on Computer Vision, 2005: 1300-1307.

[8] Bay H, Tuytelaars T, Gool L V. Surf: speeded up robust features. Proceedings of the 9th European Conference on Computer Vision. Graz, Austria: 2006: 404-417.

[9] Rublee E, Rabaud V, Konolige K, et al. Orb: an efficient alternative to sift or surf. Proceedings of the 13th IEEE International Conference on Computer Vision, 2011: 2564-2571.

[10] Rosten E, Drummond T. Machine learning for high-speed corner detection. Proceedings of the 9th European Conference on Computer Vision. Graz, Austria: Springer-Verlag Berlin Heidelberg, 2006: 430-443.

[11] Viola P, Jones M. Rapid object detection using a boosted cascade of simple features. Proceedings of the 2001 IEEE Conference on Computer Vision and Pattern Recognition, 2001: 511-518.

[12] Calonder M, Lepetit V, Fua P. Brief: binary robust independent elementary features. Proceedings of the 11th European Conference on Computer Vision. Crete, Greece: Springer-Verlag Berlin Heidelberg, 2010: 778-792.

[13] Leutenegger S, Chli M, Siegwart R Y. BRISK: binary robust invariant scalable keypoints. Proceedings of the 13th IEEE International Conference on Computer Vision, 2011: 2548-2555.

[14] Fan B, Wu F, Hu Z. Aggregating gradient distributions into intensity orders: a novel local image descriptor. Proceedings of the 2011 IEEE Conference on Computer Vision and Pattern Recognition, 2011: 2377-2384.

[15] Fischler M, Bolles R. Random sample consensus: a paradigm for model fitting with application to image analysis and automated cartography. Communications of the ACM, 1981, 24: 381-395.

[16] Hess R. Open SIFT. (2010-12-07). http://blogs.oregonstate.eduhess/code/sift/.

[17] Microsoft Corporation. Image composite editor. (2011-05-26)[2012-07-17]. http://research.microsoft.com/en-us/um/redmond/groups/ivm/ice/.

[18] ArcSoft Corporation. Panorama maker 6.[2012-07-17]. http://www.arcsoft.com/panorama-maker/.

Fast Interframe Registration Method in Aerial Videos

PDF (PC)

Knowledge

Abstract

Cite this article

share this article

References

Related Articles 15

Recommended Articles

Metrics

Comments

[1]	Ping WANG, Hui FU, Guili XU. Camera pose estimation and corresponding points matching based on rotation search [J]. ACTA AERONAUTICAET ASTRONAUTICA SINICA, 2023, 44(2): 326695-326695.
[2]	Yuanliang XUE, Guodong JIN, Lining TAN, Jiankun XU. Adaptive UAV target tracking algorithm based on multi-scale fusion [J]. ACTA AERONAUTICAET ASTRONAUTICA SINICA, 2023, 44(1): 326107-326107.
[3]	ZHONG Mengfan, PEI Jihong. Image stitching enhancement method with symmetrical constraint of local feature points [J]. ACTA AERONAUTICAET ASTRONAUTICA SINICA, 2022, 43(S1): 726948-726948.
[4]	HU Yangxiu, ZHAO Changchun, JIA Chenglong, QIAN Zhouyuan, HU Tao. Synchronous path formation control of UAV swarm based on robot operating system (ROS) [J]. ACTA AERONAUTICAET ASTRONAUTICA SINICA, 2022, 43(S1): 726914-726914.
[5]	HU Wei, WAN Wenzhang, CHEN Mou. Neural network and disturbance observer based control for automatic carrier landing of UAV [J]. ACTA AERONAUTICAET ASTRONAUTICA SINICA, 2022, 43(S1): 726963-726963.
[6]	HAN Songyu, SHAO Haidong, JIANG Hongkai, ZHANG Xiaoyang. Intelligent fault diagnosis of aero-engine high-speed bearings using enhanced CNN [J]. ACTA AERONAUTICAET ASTRONAUTICA SINICA, 2022, 43(9): 625479-625479.
[7]	YANG Te, YANG Zhichun, LIANG Shuya, KANG Zaifei, JIA You. Feature extraction and identification of stationary random dynamic load using deep neural network [J]. ACTA AERONAUTICAET ASTRONAUTICA SINICA, 2022, 43(9): 225952-225952.
[8]	LI Hui, LONG Teng, SUN Jingliang, XU Guangtong. Adaptive line-of-sight method for 3D path following of UAVs [J]. ACTA AERONAUTICAET ASTRONAUTICA SINICA, 2022, 43(9): 326105-326105.
[9]	XING Ling, JIA Xiaofan, ZHAO Pengcheng, WU Honghai. Location privacy protection scheme for unmanned aerial vehicle group based on matrix encryption [J]. ACTA AERONAUTICAET ASTRONAUTICA SINICA, 2022, 43(8): 325386-325386.
[10]	ZHANG Zhouyu, CAO Yunfeng, FAN Yanming. Research progress of vision based aerospace conflict sensing technologies for small unmanned aerial vehicle in low altitude [J]. ACTA AERONAUTICAET ASTRONAUTICA SINICA, 2022, 43(8): 25645-025645.
[11]	LI Chunpeng, ZHANG Tiejun, QIAN Zhansen, LIU Tiezhong. Aerodynamic design of modular configuration for multi-mission unmanned aerial vehicle [J]. ACTA AERONAUTICAET ASTRONAUTICA SINICA, 2022, 43(7): 125411-125411.
[12]	LIU Fang, SUN Yanan. UAV target tracking algorithm based on adaptive fusion network [J]. ACTA AERONAUTICAET ASTRONAUTICA SINICA, 2022, 43(7): 325522-325522.
[13]	LYU Shuaishuai, YANG Yu, WANG Binwen, YIN Chenfei. A crack identification method of aircraft structure based on improved FaceNet [J]. ACTA AERONAUTICAET ASTRONAUTICA SINICA, 2022, 43(6): 525463-525463.
[14]	SUN Qin, LI Hongxu, WANG Yuzhi, ZHOU Liping, ZHANG Yingchao. Resilient UAV swarm modeling and solving based on multi-domain collaborative method [J]. ACTA AERONAUTICAET ASTRONAUTICA SINICA, 2022, 43(5): 325340-325340.
[15]	LIU Fang, HAN Xiao. Adaptive aerial object detection based on multi-scale deep learning [J]. ACTA AERONAUTICAET ASTRONAUTICA SINICA, 2022, 43(5): 325270-325270.