In this paper， an image mosaic enhancement method with symmetrical constraint of local feature points is proposed. Firstly， according to the internal and external parameter matrix of the camera， the forward local constraint region of the feature points is calculated， and the set of positive matching points is obtained. Then， the inverse local constraint region is calculated， and the set of inverse matching points is obtained. The intersection in the set of forward and reverse matching point pairs is found， and the final correct matching point pair set which satisfies the symmetric constraint condition is obtained. Combining this enhancement method with the existing advanced stitching model learning algorithm， the optimal image transformation is obtained， and finally the stitched image is obtained according to the image transformation model. This method effectively overcomes the problem that the threshold of the RANSAC algorithm needs to be manually adjusted when learning different models， thus reducing the parameter sensitivity of the algorithm， and improving the image stitching accuracy. Experiments show that our method is superior to existing methods both qualitatively and quantitatively.
ZHONG Mengfan
,
PEI Jihong
. Image stitching enhancement method with symmetrical constraint of local feature points[J]. ACTA AERONAUTICAET ASTRONAUTICA SINICA, 2022
, 43(S1)
: 726948
-726948
.
DOI: 10.7527/S1000-6893.2022.26948
[1] BROWN M, LOWE D G. Automatic panoramic image stitching using invariant features[J]. International Journal of Computer Vision, 2007, 74(1): 59-73.
[2] SZELISKI R. Image alignment and stitching: A tutorial[J]. Foundations and Trends in Computer Graphics and Vision, 2007, 2(1): 1-104.
[3]
[4] ZHAO J F, CHEN Y T, FENG H J, et al. Infrared image enhancement through saliency feature analysis based on multi-scale decomposition[J]. Infrared Physics & Technology, 2014, 62: 86-93.
[5] ZARAGOZA J, CHIN T J, TRAN Q H, et al. As-projective-as-possible image stitching with moving DLT[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2014, 36(7): 1285-1298.
[6]
[7] LIN K M, JIANG N J, CHEONG L F, et al. SEAGULL: Seam-guided local alignment for parallax-tolerant image stitching[M]∥Computer Vision-ECCV 2016. Cham: Springer International Publishing, 2016: 370-385.
[8]
[9] LOWE D G. Distinctive image features from scale-invariant keypoints[J]. International Journal of Computer Vision, 2004, 60(2): 91-110.
[10] FISCHLER M A, BOLLES R C. A paradigm for model fitting with applications to image analysis and automated cartography[J]. Communications of the ACM-CACM, 1981: 381-395.
[11]
[12] LI J, DENG B, TANG R, et al. Local-adaptive image alignment based on triangular facet approximation[J]. IEEE Transactions on Image Processing, 2019, 29: 2356-2369.
[13] LIAO C, WANG G J, SHEN Y L, et al. Aerial video stitching via multi-direction strips[J]. Acta Aeronautica et Astronautica Sinica, 2012, 33(11): 2065-2073 (in Chinese). 廖超, 王贵锦, 沈永玲, 等. 航拍视频的多向条带拼接算法[J]. 航空学报, 2012, 33(11): 2065-2073.
[14] YI M, GUO B L. Aerial video image registration method based on invariant features and mapping restraint[J]. Acta Aeronautica et Astronautica Sinica, 2012, 33(10): 1872-1880 (in Chinese). 易盟, 郭宝龙. 基于不变特征和映射抑制的航拍视频图像配准[J]. 航空学报, 2012, 33(10): 1872-1880.
[15] LU J Z, SUN F D, DONG J, et al. Real-time mosaicking for infrared videos from an oblique sweeping camera[J]. Chinese Journal of Aeronautics, 2021, 34(1): 309-319.
[16]
[17]
[18]
[19] BOYKOV Y, KOLMOGOROV V. An experimental comparison of Min-cut/max-flow algorithms for energy minimization in vision[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2004, 26(9): 1124-1137.
[20] BOYKOV Y, VEKSLER O, ZABIH R. Fast approximate energy minimization via graph cuts[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2001, 23(11): 1222-1239.
[21]
[22]
[23] WANG Z, BOVIK A C, SHEIKH H R, et al. Image quality assessment: From error visibility to structural similarity[J]. IEEE Transactions on Image Processing, 2004, 13(4): 600-612.
CJA