ACTA AERONAUTICAET ASTRONAUTICA SINICA >
A unified detection model for multimodal aerospace remote sensing images based on mixture of experts
Received date: 2025-10-09
Revised date: 2025-11-06
Accepted date: 2025-12-11
Online published: 2025-12-23
Supported by
National Natural Science Foundation of China(62571442)
With the increasing number of remote sensing satellites deployed in orbit in China， the quantity of aerospace remote sensing images， represented by Synthetic Aperture Radar （SAR） and optical （RGB） images， is rapidly growing， along with the demand for tasks such as object detection from these massive datasets. However， due to objective factors such as differences in imaging mechanisms and resolutions， images from different satellites exhibit significant modality feature differences. These differences are particularly pronounced between SAR and RGB remote sensing images， making it difficult for a single model to learn feature information across different types of remote sensing images. As a result， each satellite typically requires a dedicated model for detection tasks， which has become a major obstacle to collaborative recognition and relay detection applications in satellite remote sensing. To address this issue， this paper innovatively proposes a self-distillation multimodal detection model based on a Mixture of Experts （MoE）. First， a modality-aware MoE structure is constructed， employing a small number of high-quality experts as teachers to guide other experts， while simultaneously incorporating modality-invariant constraints to further reduce cross-modality feature shifts. Second， a Fourier-enhanced diffusion detection head is developed， combining frequency-domain feature enhancement to improve the capability of capturing detailed information of detection targets. To evaluate the model performance， aerospace images were selected and cropped from the public datasets FAIR1M and SARDet_100K， resulting in a dataset of 68 983 aerospace remote sensing images for object detection under different backgrounds and imaging mechanisms. Experimental results demonstrate that， compared with existing single-modality detection methods， the proposed model performs better in detection tasks across both modalities， with a significant improvement in mean Average Precision （mAP）. This fully demonstrates that the proposed model possesses significant application value in multimodal aerospace remote sensing image object detection， and exhibits good adaptability to various types of satellite remote sensing images.
Yuanjie ZHI , Xin GE , Fan ZHANG , Zhi YANG , Mingyang MA , Shaohui MEI . A unified detection model for multimodal aerospace remote sensing images based on mixture of experts[J]. ACTA AERONAUTICAET ASTRONAUTICA SINICA, 2026 , 47(10) : 532864 -532864 . DOI: 10.7527/S1000-6893.2025.32864
| [1] | GUI S X， SONG S， QIN R J， et al. Remote sensing object detection in the deep learning era—A review［J］. Remote Sensing， 2024， 16（2）： 327. |
| [2] | DELPLANQUE A， THéAU J， FOUCHER S， et al. Wildlife detection， counting and survey using satellite imagery： Are we there yet？［J］. GIScience & Remote Sensing， 2024， 61（1）： 2348863. |
| [3] | 高志强， 刘纪远. 基于遥感和GIS的中国土地潜力资源的研究［J］. 遥感学报， 2000， 4（2）： 136-140. |
| GAO Z Q， LIU J Y. The research of land potential re-sources in China based on remote sensing ＆ GIS ［J］. National Remote Sensing Bulletin， 2000， 4（2）： 136-140 （in Chinese）. | |
| [4] | ZHENG Z， ZHONG Y F， WANG J J， et al. Building damage assessment for rapid disaster response with a deep object based semantic change detection framework： From natural disasters to man-made disasters［J］. Remote Sensing of Environment， 2021， 265： 112636. |
| [5] | AVTAR R， KOUSER A， KUMAR A， et al. Remote sensing for international peace and security： Its role and implications［J］. Remote Sensing， 2021， 13（3）： 439. |
| [6] | ADEGUN A A， FONOU DOMBEU J V， VIRIRI S， et al. State-of-the-art deep learning methods for objects detection in remote sensing satellite images［J］. Sensors， 2023， 23（13）： 5849. |
| [7] | WANG L F， MEI S H， WANG Y， et al. CAMCFormer： Cross-attention and multicorrelation aided transformer for few-shot object detection in optical remote sensing images［J］. IEEE Transactions on Geoscience and Remote Sensing， 2025， 63， 1-16. |
| [8] | HAN J M， DING J， LI J， et al. Align deep features for oriented object detection［J］. IEEE Transactions on Geoscience and Remote Sensing， 2021， 60： 1-11. |
| [9] | LIU W， ZHOU L F. Multilevel denoising for high quality SAR object detection in complex scenes［J］. IEEE Transactions on Geoscience and Remote Sensing， 2024， 62： 1-13. |
| [10] | GAO G， BAI Q L， ZHANG C， et al. Dualistic cascade convolutional neural network dedicated to fully PolSAR image ship detection［J］. ISPRS Journal of Photogrammetry and Remote Sensing， 2023， 202： 663-681. |
| [11] | WANG C， LU W， LI X， et al. M4-SAR： A multi-resolution， multi-polarization， multi-scene， multi-source dataset and benchmark for Optical-SAR fusion object detection［DB/OL］. arXiv preprint： 2505.10931， 2025. |
| [12] | 王子玲， 熊振宇， 顾祥岐. 可见光与SAR多源遥感图像关联学习算法［J］. 航空学报， 2022， 43（S1）： 727239. |
| WANG Z L， XIONG Z Y， GU X Q. Correlation learning algorithm of visible light and SAR cross modal remote sensing images［J］. Acta Aeronautica et Astronautica Sinica， 2022， 43（S1）： 727239 （in Chinese）. | |
| [13] | JACOBS R A， JORDAN M I， NOWLAN S J， et al. Adaptive mixtures of local experts［J］. Neural Computation， 1991， 3（1）： 79-87. |
| [14] | SHAZEER N， MIRHOSEINI A， MAZIARZ K， et al. Outrageously large neural networks： The sparsely-gated mixture-of-experts layer［DB/OL］. arXiv preprint： 1701.06538， 2017. |
| [15] | ZHANG L F， SONG J B， GAO A N， et al. Be your own teacher： Improve the performance of convolutional neural networks via self distillation［C］∥Proceedings of the IEEE/CVF international conference on computer vision （ICCV）. Piscataway： IEEE Press， 2019： 3713-3722. |
| [16] | WANG Z Y， LI Y L， CHEN X， et al. Detecting everything in the open world： Towards universal object detection［C］∥Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition（CVPR）. Piscataway： IEEE Press， 2023： 11433-11443. |
| [17] | XIONG Z T， WANG Y， ZHANG F H， et al. One for all： Toward unified foundation models for Earth vision［C］∥IGARSS 2024-2024 IEEE International Geoscience and Remote Sensing Symposium. Piscataway： IEEE Press， 2024： 2734-2738. |
| [18] | LI Y X， LI X， LI Y H， et al. SM3Det： A unified model for multi-modal remote sensing object detection［DB/OL］. arXiv preprint： 2412.20665， 2024. |
| [19] | LI Y X， LI X， LI W J， et al. SARDet-100K： Towards open-source benchmark and toolkit for large-scale SAR object detection［C］∥NIPS’24： Proceedings of the 38th International Conference on Neural Information Processing Systems. Curran Associates Inc.， 2024： 128430-128461. |
| [20] | SUN X， WANG P J， YAN Z Y， et al. FAIR1M： A benchmark dataset for fine-grained object recognition in high-resolution remote sensing imagery［J］. ISPRS Journal of Photogrammetry and Remote Sensing， 2022， 184： 116-130. |
| [21] | LI W T， ZHAO D P， YUAN B， et al. PETDet： Proposal enhancement for two-stage fine-grained object detection［J］. IEEE Transactions on Geoscience and Remote Sensing， 2023， 62： 1-14. |
| [22] | HOU X Q， LIU M Q， ZHANG S L， et al. Relation DETR： Exploring explicit position relation prior for object detection［C］∥European Conference on Computer Vision （ECCV）. Cham： Springer Nature Switzerland， 2024： 89-105. |
| [23] | ZHAO J Q， DING Z Y， ZHOU Y， et al. OrientedFormer： An end-to-end transformer-based oriented object detector in remote sensing images［J］. IEEE Transactions on Geoscience and Remote Sensing， 2024， 62： 1-16. |
| [24] | DAI Y M， ZOU M R， LI Y X， et al. DenoDet： Attention as deformable multi-subspace feature denoising for target detection in SAR images［J］. IEEE Transactions on Aerospace and Electronic Systems， 2024， 61： 4729-4743. |
| [25] | ZHOU J， XIAO C， PENG B， et al. DiffDet4SAR： Diffusion-based aircraft target detection network for SAR images［J］. IEEE Geoscience and Remote Sensing Letters， 2024， 21： 1-5. |
| [26] | LI W J， YANG W， HOU Y N， et al. SARATR-X： Towards building a foundation model for SAR target recognition［J］. IEEE Transactions on Image Processing， 2025， 34： 869-884. |
/
| 〈 |
|
〉 |
CJA