special column

Infrared aircraft target detection method based on multi-level feature enhancement fusion

  • Yi ZHANG ,
  • Yan ZHANG ,
  • Yu ZHANG ,
  • Yong ZHANG ,
  • Di LIU
Expand
  • College of Electronic Science and Technology,National University of Defense Technology,Changsha  410073,China

Received date: 2023-06-26

  Revised date: 2023-07-17

  Accepted date: 2023-08-30

  Online published: 2023-09-06

Supported by

National Natural Science Foundation of China(62075239)

Abstract

Infrared aircraft target detection and recognition has broad prospects for applications in the fields of unmanned reconnaissance, target precision guidance, and flight monitoring. To solve the difficulty in accurate recognition caused by few available features and small difference between classes in infrared aircraft target detection and recognition, a Multi-level Feature Enhanced Fusion Network model (MFEFNet) is proposed. Firstly, a Local and Global Feature Enhancement fusion module (LGFE) is designed. By designing the coordinate attention mechanism and the global pixel attention mechanism, the module enhances and merges the deep semantic features and the low-level detail features. The module implements the top-down mode to dynamically guide the low-level local feature enhancement with deep semantics, and then adaptively strengthens the feature map representation of infrared aircraft target information. Then, a Global Extension Module (GEM) is designed. Based on the feature pyramid, the module further aggregates the multi-scale context information of the intermediate feature map to improve the ability of the network to identify multi-class targets. Finally, the GEM module and LGFE module are cascaded to maintain the long-distance dependence of features and produce a joint effect, which further improves the ability to make feature characterization and target classification decisions and effectively solves the problems of missing features and small differences between classes of infrared aircraft targets. In addition, this paper develops a new ground infrared aircraft dataset based on transfer learning, and analyzes the consistency between transfer data and real infrared data at the feature level by using Gram distance. The experimental results on the ground infrared aircraft dataset show that each module of MFEFNet is effective. Compared with other advanced algorithms, the algorithm proposed can improve the mean Average Precision (mAP) of ground infrared aircraft target recognition by more than 4.3%, and has achieved obvious advantages in recognition accuracy.

Cite this article

Yi ZHANG , Yan ZHANG , Yu ZHANG , Yong ZHANG , Di LIU . Infrared aircraft target detection method based on multi-level feature enhancement fusion[J]. ACTA AERONAUTICAET ASTRONAUTICA SINICA, 2023 , 44(22) : 629220 -629220 . DOI: 10.7527/S1000-6893.2023.29220

References

1 张凯, 刘昊, 杨曦, 等. 基于关键点检测网络的空中红外目标要害部位识别算法[J]. 西北工业大学学报202038(6): 1154-1162.
  ZHANG K, LIU H, YANG X, et al. Identification algorithm based on key-point detection network for vital parts of infrared aerial target[J]. Journal of Northwestern Polytechnical University202038(6): 1154-1162 (in Chinese).
2 ZHANG Y, ZHANG Y, FU R G, et al. Learning nonlocal quadrature contrast for detection and recognition of infrared rotary-wing UAV targets in complex background[J]. IEEE Transactions on Geoscience and Remote Sensing202260: 1-19.
3 欧阳欢, 范大昭, 郭静, 等. 结合显著性检测与特征匹配的飞机目标识别[J]. 测绘通报2020(3): 1-6.
  OUYANG H, FAN D Z, GUO J, et al. Aircraft target recognition based on saliency detection and feature matching[J]. Bulletin of Surveying and Mapping2020(3): 1-6 (in Chinese).
4 HU Q, LI R S, XU Y, et al. Toward aircraft detection and fine-grained recognition from remote sensing images[J]. Journal of Applied Remote Sensing202216(2): 024516.
5 HUANG H L, HUANG J C, FENG Y H, et al. Aircraft type recognition based on target track[J]. Journal of Physics: Conference Series20181061: 012015.
6 李婕, 周顺, 朱鑫潮, 等. 结合多通道注意力的遥感图像飞机目标检测[J]. 计算机工程与应用202258(1): 209-217.
  LI J, ZHOU S, ZHU X C, et al. Remote sensing image aircraft target detection combined with multiple channel attention[J]. Computer Engineering and Applications202258(1): 209-217 (in Chinese).
7 KOU R K, WANG C P, FU Q, et al. Infrared small target detection based on the improved density peak global search and human visual local contrast mechanism[J]. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing202215: 6144-6157.
8 蔡红苹, 耿振伟, 粟毅. 遥感图像飞机检测新方法: 圆周频率滤波法[J]. 信号处理200723(4): 539-543.
  CAI H P, GENG Z W, SU Y. A new method to detect airplanes in remote sensing image—circle-frequency filter[J]. Signal Processing200723(4): 539-543 (in Chinese).
9 AN Z Y, SHI Z W, TENG X C, et al. An automated airplane detection system for large panchromatic image with high spatial resolution[J]. Optik2014125(12): 2768-2775.
10 李萍, 张波, 尚怡君. 基于红外图像和特征融合的飞机目标识别方法[J]. 电光与控制201623(8): 92-96.
  LI P, ZHANG B, SHANG Y J. Aircraft target identification based on infrared image and feature fusion[J]. Electronics Optics & Control201623(8): 92-96 (in Chinese).
11 XU C F, DUAN H B. Artificial bee colony (ABC) optimized edge potential function (EPF) approach to target recognition for low-altitude aircraft[J]. Pattern Recognition Letters201031(13): 1759-1772.
12 ZHAO A, FU K, WANG S Y, et al. Aircraft recognition based on landmark detection in remote sensing images[J]. IEEE Geoscience and Remote Sensing Letters201714(8): 1413-1417.
13 WU Q C, SUN H, SUN X, et al. Aircraft recognition in high-resolution optical satellite remote sensing images[J]. IEEE Geoscience and Remote Sensing Letters201412(1): 112-116.
14 钟都都, 王建华, 张凯, 等. 用于红外目标跟踪的模板匹配改进算法[J]. 飞行器测控学报200827(3): 63-67.
  ZHONG D D, WANG J H, ZHANG K, et al. An improved template matching method for IR object tracking[J]. Journal of Spacecraft TT&C Technology200827(3): 63-67 (in Chinese).
15 方涛. 一种基于显著性与卷积神经网络的红外飞机识别算法[D]. 武汉: 华中科技大学, 2014.
  FANG T. An infrared aircraft recognition algorithm based on saliency and convolutional neural network[D].Wuhan: Huazhong University of Science and Technology, 2014 (in Chinese).
16 ZUO J W, XU G L, FU K, et al. Aircraft type recognition based on segmentation with deep convolutional neural networks[J]. IEEE Geoscience and Remote Sensing Letters201815(2): 282-286.
17 刘思婷. 基于深度神经网络的遥感影像飞机目标检测与型号识别方法[D]. 兰州: 兰州交通大学, 2022.
  LIU S T. Aircraft target detection and type recognition in remote sensing imagery based on deep neural network[D]. Lanzhou: Lanzhou Jiatong University, 2022 (in Chinese).
18 沙苗苗, 李宇, 李安. 改进Faster R-CNN的遥感图像多尺度飞机目标检测[J]. 遥感学报202226(8): 1624-1635.
  SHA M M, LI Y, LI A. Multiscale aircraft detection in optical remote sensing imagery based on advanced Faster R-CNN[J]. National Remote Sensing Bulletin202226(8): 1624-1635 (in Chinese).
19 吴杰, 高策, 余毅, 等. 改进LDS_YOLO网络的遥感飞机检测算法研究[J]. 计算机工程与应用202258(15): 210-219.
  WU J, GAO C, YU Y, et al. Research on improved LDS_YOLO network remote sensing aircraft detection algorithm[J]. Computer Engineering and Applications202258(15): 210-219 (in Chinese).
20 LIN T Y, DOLLáR P, GIRSHICK R, et al. Feature pyramid networks for object detection[C]∥ 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). Piscataway: IEEE Press, 2017: 936-944.
21 REN S Q, HE K M, GIRSHICK R, et al. Faster R-CNN: Towards real-time object detection with region proposal networks[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence201739(6): 1137-1149.
22 CAI Z W, VASCONCELOS N. Cascade R-CNN: Delving into high quality object detection[C]∥ 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition. Piscataway: IEEE Press, 2018: 6154-6162.
23 REDMON J, FARHADI A. YOLOv3: An incremental improvement[DB/OL]. arXiv preprint1804.02767, 2018.
24 GE Z, LIU S T, WANG F, et al. YOLOX: Exceeding YOLO series in 2021[DB/OL]. arXiv preprint: 2107.08430, 2021.
25 LIU W, ANGUELOV D, ERHAN D, et al. SSD: Single shot MultiBox detector[M]∥Computer Vision – ECCV 2016. Cham: Springer International Publishing, 2016: 21-37.
26 LIN T Y, GOYAL P, GIRSHICK R, et al. Focal loss for dense object detection[C]∥2017 IEEE International Conference on Computer Vision (ICCV). Piscataway: IEEE Press, 2017: 2999-3007.
27 TIAN Z, SHEN C H, CHEN H, et al. FCOS: Fully convolutional one-stage object detection[C]∥2019 IEEE/CVF International Conference on Computer Vision (ICCV). Piscataway: IEEE Press, 2020: 9626-9635.
Outlines

/