基于关键点检测的红外弱小目标检测

doi:10.7527/S1000-6893.2023.28173

Abstract

Abstract:

Infrared small target detection aims to detect infrared dim small targets from complex background. With wide application of this technology in monitoring and early warning systems， precise guidance， etc.， how to realize fast and accurate detection of infrared small targets is of great importance. Existing traditional algorithms often result in missed detection or false detection， and the detection method based on semantic segmentation in deep learning is easy to be affected by “over segmentation” and “under segmentation”. To address these problems， an infrared small target detection algorithm is proposed based on key point detection （KeypointNet）. The main innovations of this study are as follows. First， The coordinates of the target center point is directly optimized， improving detection efficiency and effectively ensuring the detection rate and false alarm rate of the target. Second， a low-high level feature fusion module is designed to obtain multi-scale information of the target and improve the detection effect. Experimental results on relevant data sets show that in comparison with other algorithms， the algorithm proposed can achieve better effect， with the detection rate reaching 97.58% and the false alarm rate being reduced to less than 2%.

Key words: infrared small target detection, key point detection, deep learning, KeypointNet, image processing

CLC Number:

V243

Qiang WANG, Letian WU, Yong WANG, Huan WANG, Wankou YANG. An infrared small target detection method based on key point[J]. ACTA AERONAUTICAET ASTRONAUTICA SINICA, 2023, 44(10): 328173-328173.

Figures/Tables 17

Fig. 1

Fig. 2

Fig. 3

Fig. 4

Fig. 5

Fig. 6

Fig. 7

Fig. 8

Table 1

Table 2

Fig. 9

Table 3

Table 4

Table 5

Table 6

Fig. 10

Fig. 11

References 36

1	TEUTSCH M， KRÜGER W. Classification of small boats in infrared images for maritime surveillance［C］∥ 2010 International WaterSide Security Conference. Piscataway： IEEE Press， 2011： 1-7.
2	DENG H， SUN X P， LIU M L， et al. Small infrared target detection based on weighted local difference measure［J］. IEEE Transactions on Geoscience and Remote Sensing， 2016， 54（7）： 4204-4214.
3	SUN Y， YANG J G， AN W. Infrared dim and small target detection via multiple subspace learning and spatial-temporal patch-tensor model［J］. IEEE Transactions on Geoscience and Remote Sensing， 2021， 59： 3737-3752.
4	梁杰，李磊，任君，等. 基于深度学习的红外图像遮挡干扰检测方法［J］. 兵工学报， 2019， 40（7）： 1401-1410.
	LIANG J， LI L， REN J， et al. Infrared image occlusion interference detection method based on deep learning［J］. Acta Armamentarii， 2019， 40（7）： 1401-1410 （in Chinese）.
5	赵坤，孔祥维. 小目标红外图像背景噪声的抑制及方法讨论［J］. 光学与光电技术， 2004， 2（2）： 9-12.
	ZHAO K， KONG X W. Background noise suppression in small targets infrared images and its method discussion［J］. Optics & Optoelectronic Technology， 2004， 2（2）： 9-12 （in Chinese）.
6	HOU X D， ZHANG L Q. Saliency detection： A spectral residual approach［C］∥ 2007 IEEE Conference on Computer Vision and Pattern Recognition. Piscataway： IEEE Press， 2007： 1-8.
7	龙云利，徐晖，安玮，等. 基于约束序贯M估计的时空域融合红外杂波抑制［J］. 航空学报， 2011， 32（8）： 1531-1541.
	LONG Y L， XU H， AN W， et al. Spatial-temporal fused filtering for infrared clutter suppression based on restricted sequential M-estimation［J］. Acta Aeronautica et Astronautica Sinica， 2011， 32（8）： 1531-1541 （in Chinese）.
8	PHILIP CHEN C L， LI H， WEI Y T， et al. A local contrast method for small infrared target detection［J］. IEEE Transactions on Geoscience and Remote Sensing， 2014， 52（1）： 574-581.
9	LIU M， DU H， ZHAO Y， et al. Image small target detection based on deep learning with SNR controlled sample generation［M］∥Current Trends in Computer Science and Mechanical Automation. De Gruyter Open Poland， 2018： 211-220.
10	张凯，王凯迪，杨曦，等. 基于DNET的空中红外目标抗干扰识别算法［J］. 航空学报， 2021， 42（2）： 324223.
	ZHANG K， WANG K D， YANG X， et al. Anti-interference recognition algorithm based on DNET for infrared aerial target［J］. Acta Aeronautica et Astronautica Sinica， 2021， 42（2）： 324223 （in Chinese）.
11	DAI Y M， WU Y Q， ZHOU F， et al. Asymmetric contextual modulation for infrared small target detection［C］∥ 2021 IEEE Winter Conference on Applications of Computer Vision （WACV）. Piscataway： IEEE Press， 2021： 949-958.
12	LI B Y， XIAO C， WANG L G， et al. Dense nested attention network for infrared small target detection［DB/OL］. arXiv preprint： 2106.00487， 2021.
13	LIU F C， GAO C Q， CHEN F， et al. Infrared small-dim target detection with transformer under complex backgrounds［DB/OL］. arXiv preprint： 2109.14379， 2021.
14	田萱，王亮，丁琪. 基于深度学习的图像语义分割方法综述［J］. 软件学报， 2019， 30（2）： 440-468.
	TIAN X， WANG L， DING Q. Review of image semantic segmentation based on deep learning［J］. Journal of Software， 2019， 30（2）： 440-468 （in Chinese）.
15	SHELHAMER E， LONG J， DARRELL T. Fully convolutional networks for semantic segmentation［C］∥ IEEE Transactions on Pattern Analysis and Machine Intelligence. Piscataway： IEEE Press， 2016： 640-651.
16	RONNEBERGER O， FISCHER P， BROX T. U-net： Convolutional networks for biomedical image segmentation［DB/OL］. arXiv preprint： 1505.04597， 2015.
17	BADRINARAYANAN V， KENDALL A， CIPOLLA R. SegNet： A deep convolutional encoder-decoder architecture for image segmentation［J］. IEEE Transactions on Pattern Analysis and Machine Intelligence， 2017， 39（12）： 2481-2495.
18	CHEN L C， PAPANDREOU G， KOKKINOS I， et al. Semantic image segmentation with deep convolutional nets and fully connected CRFs［DB/OL］. arXiv preprint： 1412.7062， 2014.
19	NEWELL A， YANG K Y， DENG J. Stacked hourglass networks for human pose estimation［DB/OL］. arXiv preprint： 1603.06937， 2016.
20	TOMPSON J， JAIN A， LECUN Y， et al. Joint training of a convolutional network and a graphical model for human pose estimation［C］∥ Proceedings of the 27th International Conference on Neural Information Processing Systems. New York： ACM， 2014： 1799–1807.
21	ZHOU X Y， WANG D Q， KRÄHENBÜHL P. Objects as points［DB/OL］. ArXiv preprint： 1904.07850， 2019.
22	ZHAO H S， SHI J P， QI X J， et al. Pyramid scene parsing network［C］∥ 2017 IEEE Conference on Computer Vision and Pattern Recognition （CVPR）. Piscataway： IEEE Press， 2017： 6230-6239.
23	WANG X L， GIRSHICK R， GUPTA A， et al. Non-local neural networks［C］∥ 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition. Piscataway： IEEE Press， 2018： 7794-7803.
24	VASWANI A， SHAZEER N， PARMAR N， et al. Attention is all You need［C］∥ Proceedings of the 31st International Conference on Neural Information Processing Systems. New York： ACM， 2017： 6000–6010.
25	REN S Q， HE K M， GIRSHICK R， et al. Faster R-CNN： Towards real-time object detection with region proposal networks［J］. IEEE Transactions on Pattern Analysis and Machine Intelligence， 2017， 39（6）： 1137-1149.
26	WANG H， ZHOU L P， WANG L. Miss detection vs. false alarm： Adversarial learning for small object segmentation in infrared images［C］∥ 2019 IEEE/CVF International Conference on Computer Vision （ICCV）. Piscataway： IEEE Press， 2020： 8508-8517.
27	XIAO B， WU H P， WEI Y C. Simple baselines for human pose estimation and tracking［C］∥European Conference on Computer Vision. Cham： Springer， 2018： 472-487.
28	GAO C Q， TIAN J W， WANG P. Generalised-structure-tensor-based infrared small target detection［J］. Electronics Letters， 2008， 44（23）： 1349-1351.
29	HAN J H， MA Y， ZHOU B， et al. A robust infrared small target detection algorithm based on human visual system［J］. IEEE Geoscience and Remote Sensing Letters， 2014， 11（12）： 2168-2172.
30	ZHANG H， ZHANG L， YUAN D， et al. Infrared small target detection based on local intensity and gradient properties［J］. Infrared Physics & Technology， 2018， 89： 88-96.
31	ZHANG L， PENG L， ZHANG T， et al. Infrared small target detection via non-convex rank approximation minimization joint l2， 1 norm［J］. Remote Sensing， 2018， 10（11）： 1821-1846.
32	ZHANG L， PENG Z. Infrared small target detection based on partial sum of the tensor nuclear norm［J］. Remote Sensing， 2019， 11（4）： 382-415.
33	HAN J H， MORADI S， FARAMARZI I， et al. A local contrast method for infrared small-target detection utilizing a tri-layer window［J］. IEEE Geoscience and Remote Sensing Letters， 2020， 17（10）： 1822-1826.
34	FENG Z H， KITTLER J， AWAIS M， et al. Wing loss for robust facial landmark localisation with convolutional neural networks［DB/OL］. ArXiv preprint： 1711.06753， 2017.
35	LIANG D， GENG Q X， WEI Z Q， et al. Anchor retouching via model interaction for robust object detection in aerial images［J］. IEEE Transactions on Geoscience and Remote Sensing， 2022， 60： 1-13.
36	WEI Z Q， LIANG D， ZHANG D， et al. Learning calibrated-guidance for object detection in aerial images［J］. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing， 2022， 15： 2721-2733.

数据集	算法	P_d/%	F_a/%
NJUST-SIRST	GST	79.00	25.33
	ILCM	38.67	53.69
	LIG	81.17	90.27
	NRAM	78.00	30.80
	PSTNN	79.67	44.07
	TLLCM	81.00	92.01
	DNANet	84.83	6.83
	MDvsFA	89.50	12.51
	KeypointNet	87.42	6.00

NUAA-SIRST	GST	87.02	13.09
	ILCM	43.41	38.85
	LIG	90.12	50.38
	NRAM	86.05	22.62
	PSTNN	86.82	23.81
	TLLCM	95.83	92.73
	DNANet	98.48	5.31
	MDvsFA	89.73	2.91
	KeypointNet	97.58	1.74

算法	100张图片推理时间/s	参数量/M
DNANet	4.58	4.97
MDvsFA	5.01	3.92
KeypointNet	1.20	7.18

算法	NJUST-SIRST		NUAA-SIRST
算法	P_d/%	F_a/%	P_d/%	F_a/%
语义分割	88.17	18.40	98.48	3.49
KeypointNet	87.42	6.00	97.58	1.74

高斯半径	NJUST-SIRST		NUAA-SIRST
高斯半径	P_d/%	F_a/%	P_d/%	F_a/%
r=3	86.00	5.76	92.64	1.12
r=5	87.42	6.00	97.58	1.74
r=10	89.58	8.89	98.06	5.31
r=15	88.33	11.52	97.18	7.69

模块	NJUST-SIRST		NUAA-SIRST
模块	P_d/%	F_a/%	P_d/%	F_a/%
Baseline	83.67	8.18	93.02	1.74
Baseline+ PPM	85.00	6.83	96.03	2.42
Baseline+BST+PPM	87.42	6.00	97.58	1.74

An infrared small target detection method based on key point

RichHTML

PDF (PC)

Knowledge

Abstract

Cite this article

share this article

Figures/Tables 17

References 36

Related Articles 15

Recommended Articles

Metrics

Comments

损失函数	NJUST-SIRST		NUAA-SIRST
损失函数	P_d/%	F_a/%	P_d/%	F_a/%
SmoothL1 Loss	87.42	6.00	97.58	1.74
MSE Loss	86.16	6.83	96.03	2.42
Wing Loss 1	1.333	64.62	1.163	50.84
Wing Loss 2	7.917	58.22	61.63	30.41

[1]	Lei HE, Weiqi QIAN, Kangsheng DONG, Xian YI, Congcong CHAI. Aerodynamic characteristics modeling of iced airfoil based on convolution neural networks [J]. ACTA AERONAUTICAET ASTRONAUTICA SINICA, 2023, 44(5): 126434-126434.
[2]	Linhong ZHOU, Guangyu HE, Shunlai ZANG. A method for modeling three-dimensional morphology of dust particle based on cross-sectional SEM data characteristics [J]. ACTA AERONAUTICAET ASTRONAUTICA SINICA, 2023, 44(4): 426201-426201.
[3]	SU Lingfei, HUA Yongzhao, DONG Xiwang, REN Zhang. Human-UAV swarm multi-modal intelligent interaction methods [J]. ACTA AERONAUTICAET ASTRONAUTICA SINICA, 2022, 43(S1): 727001-727001.
[4]	FAN Yongsheng, YANG Xiaoguang, SHI Duoqi, TAN Long, HUANG Weiqing. Rafting-waste judgement of serviced turbine blades: quantitative characterization and threshold determination [J]. ACTA AERONAUTICAET ASTRONAUTICA SINICA, 2022, 43(9): 625100-625100.
[5]	LIU Jiaqi, FENG Yunwen, LU Cheng, XUE Xiaofeng, PAN Weihuang. Safety analysis of aero-engine operation based on intelligent neural network [J]. ACTA AERONAUTICAET ASTRONAUTICA SINICA, 2022, 43(9): 625375-625375.
[6]	ZHAO Liangyu, LI Dan, ZHAO Chenyue, JIANG Fei. Some achievements on detection methods of UAV autonomous landing markers [J]. ACTA AERONAUTICAET ASTRONAUTICA SINICA, 2022, 43(9): 25882-025882.
[7]	CAO Ming, WANG Peng, ZUO Hongfu, ZENG Haijun, SUN Jianzhong, YANG Weidong, WEI Fang, CHEN Xuefeng. Current status, challenges and opportunities of civil aero-engine diagnostics & health management Ⅱ: Comprehensive off-board diagnosis, life management and intelligent condition based MRO [J]. ACTA AERONAUTICAET ASTRONAUTICA SINICA, 2022, 43(9): 625574-625574.
[8]	SHAO Yiwei, CHEN Jiayu, LIN Cuiying, WAN Cheng, GE Hongjuan, SHI Zhilong. Gearbox fault diagnosis with small training samples: An improved deep forest based method [J]. ACTA AERONAUTICAET ASTRONAUTICA SINICA, 2022, 43(8): 625429-625429.
[9]	LIU Zichao, WANG Jiang, HE Shaoming, LI Yufei. A computational guidance algorithm for impact angle control based on predictor-corrector concept [J]. ACTA AERONAUTICAET ASTRONAUTICA SINICA, 2022, 43(8): 325433-325433.
[10]	SUN Canfei, HUANG Linran, SHEN Yong. Fault diagnosis of helicopter planetary gear transmission system under complex operating conditions [J]. ACTA AERONAUTICAET ASTRONAUTICA SINICA, 2022, 43(8): 625480-625480.
[11]	KANG Yuxiang, CHEN Guo, WEI Xunkai, ZHOU Lei. Deep residual hedging network and its application in fault diagnosis of rolling bearings [J]. ACTA AERONAUTICAET ASTRONAUTICA SINICA, 2022, 43(8): 625201-625201.
[12]	LIU Zhan, ZHANG Jun, YIN Jia, ZHAO Wanhua. On-machine detection of geometric and state parameters of end mills based on machine vision [J]. ACTA AERONAUTICAET ASTRONAUTICA SINICA, 2022, 43(7): 425593-425593.
[13]	LYU Shuaishuai, YANG Yu, WANG Binwen, YIN Chenfei. A crack identification method of aircraft structure based on improved FaceNet [J]. ACTA AERONAUTICAET ASTRONAUTICA SINICA, 2022, 43(6): 525463-525463.
[14]	LIU Tianyuan, ZHENG Hangbin, YANG Changqi, BAO Jinsong, WANG Junliang, GU Jun. Explainable deep learning method for laser welding defect detection [J]. ACTA AERONAUTICAET ASTRONAUTICA SINICA, 2022, 43(4): 524961-524961.
[15]	KANG Shuo, KE Zhenzheng, WANG Xuan, ZHU Weidong. Detection method of defects in automatic fiber placement based on fusion of infrared and visible images [J]. ACTA AERONAUTICAET ASTRONAUTICA SINICA, 2022, 43(3): 425187-425187.