导航

Acta Aeronautica et Astronautica Sinica ›› 2023, Vol. 44 ›› Issue (22): 627476-627476.doi: 10.7527/S1000-6893.2022.27476

• special column • Previous Articles     Next Articles

Interpretable fusion association network for multi-source remote sensing ship target based on attribute guidance

Zhenyu XIONG(), Yaqi CUI, Kai DONG, Mengyang LI, Wei XIONG   

  1. Institute of Information Fusion,Naval Aviation University,Yantai  264001,China
  • Received:2022-05-20 Revised:2022-06-21 Accepted:2022-07-29 Online:2023-11-25 Published:2022-08-03
  • Contact: Zhenyu XIONG E-mail:x_zhen_yu@163.com
  • Supported by:
    National Science Fund for Young Scholars(62001499);National Natural Science Foundation of China(61790554)

Abstract:

Multi-source remote sensing ship target correlation, as an important means for early-stage large-scale early warning and detection, provides important information support for maritime situation research and judgment. Existing association algorithms face the problems of poor interpretability of association results, difficulty in measuring heterogeneous features and low accuracy of multi-source target association. In this paper, an interpretable fusion network based on attribute guidance is proposed to solve the problem of ship target association in multi-source remote sensing. Firstly, to solve the problem of large difference in multi-source image content and difficulty in feature alignment, a global association module is proposed, which uses the cross modal measurement loss function to map image features into the common space. Then, an interpretable module including the multi head attention model and the attribute supervision function is proposed to improve the correlation accuracy and output interpretable correlation results. The multi-head attention model makes the network pay attention to the salient region of ship targets, and the attribute supervision function enables the model to pay attention to the discriminant attribute features in ship images. Finally, the idea of knowledge distillation is used to reduce the difference between the output feature distance of the global correlation module and the interpretable module, so that the network can realize accurate correlation and provide interpretable correlation results. In the experimental part, this paper constructs the first multi-source remote sensing ship target data set. The test results on this data set show that this algorithm is not only better than the existing algorithms in correlation accuracy, but also can provide clear and intuitive visual correlation results for the correlation process.

Key words: multi-source ship target, remote sensing image, association learning, attention model, interpretable feature learning

CLC Number: