基于混合专家模型的航天遥感图像目标检测
收稿日期: 2025-07-21
修回日期: 2025-08-21
录用日期: 2025-10-20
网络出版日期: 2025-10-24
基金资助
国家自然科学基金(62125102);国家自然科学基金(U24B20177)
Spaceborne remote sensing image object detection based on mixture of experts model
Received date: 2025-07-21
Revised date: 2025-08-21
Accepted date: 2025-10-20
Online published: 2025-10-24
Supported by
National Natural Science Foundation of China(62125102)
目标检测作为航天遥感领域的重要应用方向,在灾害应急、资源管理、环境监测等领域具有重要意义。以船只目标为例,研究航天遥感图像目标检测。航天遥感观测范围覆盖全球不同海域,这些海域的地貌特征存在巨大差异,现有舰船目标检测方法多采用统一结构处理不同场景,难以适应不同区域及不同分辨率下地物特征的变化。将混合专家模型(MoE)引入航天遥感图像目标检测任务,提出了一种基于混合专家模型的航天遥感图像目标检测模型。该模型针对不同地理区域的差异特征,自适应地选择相应的专家处理,实现不同海域下更精准的舰船目标检测。模型包含两个专家组:一组由空间分辨率信息引导,以捕获不同分辨率下的地物尺度差异;另一组由经纬度信息引导,以适应不同地理区域的地物分布特征。通过两组专家的协同工作,模型能够更加精准地感知和定位图像中的船只目标,显著提高检测性能。此外,还构建了一个包含多分辨率信息和经纬度信息的数据集——地理信息舰船检测数据集(GISD),为研究提供数据支撑。在GISD数据集和公开数据集LEVIR-ship上进行了实验验证,本模型的平均精度AP50分别达到了80.6%、85.7%,相较于两个数据集上性能最优模型的AP50提升了3.8%、2.0%。
卢光宇 , 陈博文 , 陈科研 , 邹征夏 , 史振威 . 基于混合专家模型的航天遥感图像目标检测[J]. 航空学报, 2026 , 47(10) : 532599 -532599 . DOI: 10.7527/S1000-6893.2025.32599
As an important application direction in the field of spaceborne remote sensing, object detection is of great significance in disaster emergency response, resource management, environmental monitoring and other fields. We take ship targets as an example to study object detection in spaceborne remote sensing images. Spaceborne remote sensing covers sea areas in different regions worldwide, and these sea areas have significant differences in geomorphic features. Existing ship target detection methods mostly use a unified structure to handle different scenarios, making it difficult to adapt to changes in ground object features in different regions and with different resolutions. To address this, we introduce the Mixture of Experts (MoE) model into the task of spaceborne remote sensing image object detection, and propose a spaceborne remote sensing image object detection model based on the Mixture of Experts model. It adaptively selects corresponding expert processing for the differential features of different geographical regions to achieve more accurate ship target detection in different sea areas. The model includes two groups of experts: one group is guided by spatial resolution information to capture differences in ground object scales under different resolutions; the other group uses latitude and longitude information for guidance to adapt to the distribution characteristics of ground objects in different geographical regions. Through the collaborative work of the two groups of experts, the model can more accurately perceive and locate ship targets in images, significantly improving detection performance. In addition, we construct a dataset containing multi-resolution information and latitude and longitude information-the Geographic In-formation Ship Detection Dataset (GISD) to provide data support for the research. We conduct experimental verification on the GISD dataset and the public dataset LEVIR-ship. The average precision AP50 of the proposed method reaches 80.6% and 85.7% respectively, which is 3.8% and 2.0% higher than that of the best-performing models on the two datasets.
| [1] | LIN Y F, LI J X, WEI S Q, et al. OptiShipNet: Efficient ship detection in complex marine environments using optical remote sensing images[J]. Journal of Marine Science and Engineering, 2024, 12(10): 1786. |
| [2] | LIU Z H, ZHANG W J, YU H, et al. Improved YOLOv5s for small ship detection with optical remote sensing images[J]. IEEE Geoscience and Remote Sensing Letters, 2023, 20: 8002205. |
| [3] | 肖欣林, 施伟超, 郑向涛, 等. 基于多模型协同的舰船目标检测[J]. 航空学报, 2024, 45(14): 630241. |
| XIAO X L, SHI W C, ZHENG X T, et al. Multiple models collaboration for ship detection[J]. Acta Aeronautica et Astronautica Sinica, 2024, 45(14): 630241 (in Chinese). | |
| [4] | 赵其昌, 吴一全, 苑玉彬. 光学遥感图像舰船目标检测与识别方法研究进展[J]. 航空学报, 2024, 45(8): 029025. |
| ZHAO Q C, WU Y Q, YUAN Y B. Progress of ship detection and recognition methods in optical remote sensing images[J]. Acta Aeronautica et Astronautica Sinica, 2024, 45(8): 029025 (in Chinese). | |
| [5] | ZOU Z X, CHEN K Y, SHI Z W, et al. Object detection in 20 years: A survey[J]. Proceedings of the IEEE, 2023, 111(3): 257-276. |
| [6] | CHEN B W, LIU L Q, ZOU Z X, et al. Target detection in hyperspectral remote sensing image: Current status and challenges[J]. Remote Sensing, 2023, 15(13): 3223. |
| [7] | SHI Z W, YU X R, JIANG Z G, et al. Ship detection in high-resolution optical imagery based on anomaly detector and local shape feature[J]. IEEE Transactions on Geoscience and Remote Sensing, 2014, 52(8): 4511-4523. |
| [8] | 黎经元, 厉小润, 赵辽英. 基于边缘线分析与聚合通道特征的港口舰船检测[J]. 光学学报, 2019, 39(8): 0815004. |
| LI J Y, LI X R, ZHAO L Y. Docked ship detection based on edge line analysis and aggregation channel features[J]. Acta Optica Sinica, 2019, 39(8): 0815004 (in Chinese). | |
| [9] | WANG H L, ZHU M, LIN C B, et al. Ship detection in optical remote sensing image based on visual saliency and AdaBoost classifier[J]. Optoelectronics Letters, 2017, 13(2): 151-155. |
| [10] | GIRSHICK R, DONAHUE J, DARRELL T, et al. Rich feature hierarchies for accurate object detection and semantic segmentation[C]∥ 2014 IEEE Conference on Computer Vision and Pattern Recognition. Piscataway: IEEE Press, 2014. |
| [11] | REDMON J, DIVVALA S, GIRSHICK R, et al. You only look once: Unified, real-time object detection[C]∥2016 IEEE Conference on Computer Vision and Pattern Recognition. Piscataway: IEEE Press, 2016. |
| [12] | CARION N, MASSA F, SYNNAEVE G, et al. End-to-end object detection with transformers[C]∥ 2020 European Conference on Computer Vision. 2020. |
| [13] | LIN H N, SHI Z W, ZOU Z X. Fully convolutional network with task partitioning for inshore ship detection in optical remote sensing images[J]. IEEE Geoscience and Remote Sensing Letters, 2017, 14(10): 1665-1669. |
| [14] | CHEN J Q, CHEN K Y, CHEN H, et al. A degraded reconstruction enhancement-based method for tiny ship detection in remote sensing images with a new large-scale dataset[J]. IEEE Transactions on Geoscience and Remote Sensing, 2022, 60: 5625014. |
| [15] | 王子玲, 熊振宇, 杨璐铖, 等. AIS和光学遥感图像引导的星载SAR舰船目标识别网络[J]. 航空学报, 2024, 45(2): 328672. |
| WANG Z L, XIONG Z Y, YANG L C, et al. Spaceborne SAR ship target recognition network guided by AIS and optical remote sensing images[J]. Acta Aeronautica et Astronautica Sinica, 2024, 45(2): 328672 (in Chinese). | |
| [16] | XING Z J, REN J, FAN X Z, et al. S-DETR: A transformer model for real-time detection of marine ships[J]. Journal of Marine Science and Engineering, 2023, 11(4): 696. |
| [17] | WANG P L, LIU B X, LI Y, et al. IceRegionShip: Optical remote sensing dataset for ship detection in ice-infested waters[J]. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2024, 17: 1007-1020. |
| [18] | YAN Y M, HE Y M, SU N, et al. PNBT-CR: A cloud removal method for ship detection[J]. IEEE Geoscience and Remote Sensing Letters, 2024, 21: 1501905. |
| [19] | 刘子力, 杨家俊, 王文静, 等. 遥感图像云检测方法综述[J]. 中国空间科学技术, 2023, 43(1): 1-17. |
| LIU Z L, YANG J J, WANG W J, et al. Cloud detection methods for remote sensing images: A survey[J]. Chinese Space Science and Technology, 2023, 43(1): 1-17 (in Chinese). | |
| [20] | LI Y X, HOU Q B, ZHENG Z H, et al. Large selective kernel network for remote sensing object detection[C]∥2023 IEEE/CVF International Conference on Computer Vision. Piscataway: IEEE Press, 2024. |
| [21] | MA D Q, LI S J, DANG B, et al. Fostc3net: A lightweight YOLOv5 based on the network structure optimization[J]. Journal of Physics: Conference Series, 2024, 2824(1): 012004. |
| [22] | QIN C, WANG X Q, LI G, et al. An improved attention-guided network for arbitrary-oriented ship detection in optical remote sensing images[J]. IEEE Geoscience and Remote Sensing Letters, 2022, 19: 6514805. |
| [23] | ZOU Z X, SHI Z W. Ship detection in spaceborne optical image with SVD networks[J]. IEEE Transactions on Geoscience and Remote Sensing, 2016, 54(10): 5832-5845. |
| [24] | BI F K, HOU J Y, CHEN L, et al. Ship detection for optical remote sensing images based on visual attention enhanced network[J]. Sensors, 2019, 19(10): 2271. |
| [25] | JACOBS R A, JORDAN M I, NOWLAN S J, et al. Adaptive mixtures of local experts[J]. Neural Computation, 1991, 3(1): 79-87. |
| [26] | FEDUS W, ZOPH B, SHAZEER N. Switch transformers: Scaling to trillion parameter models with simple and efficient sparsity[J]. Journal of Machine Learning Research, 2022, 23(120): 1-39. |
| [27] | CHEN B W, CHEN K Y, YANG M H, et al. Heterogeneous mixture of experts for remote sensing image super-resolution[J]. IEEE Geoscience and Remote Sensing Letters, 2025, 22: 6006405. |
| [28] | XIA G S, BAI X, DING J, et al. DOTA: A large-scale dataset for object detection in aerial images[C]∥ 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition. Piscataway: IEEE Press, 2018. |
| [29] | LIU Z, LIN Y T, CAO Y, et al. Swin transformer: Hierarchical vision transformer using shifted windows[C]∥ 2021 IEEE/CVF International Conference on Computer Vision. Piscataway: IEEE Press, 20221. |
| [30] | SONG J N, ZHOU M L, LUO J, et al. Boundary-aware feature fusion with dual-stream attention for remote sensing small object detection[J]. IEEE Transactions on Geoscience and Remote Sensing, 2025, 63: 5600213. |
| [31] | TIAN Z, SHEN C H, CHEN H, et al. FCOS: Fully convolutional one-stage object detection[C]∥ 2019 IEEE/CVF International Conference on Computer Vision. Piscataway: IEEE Press, 2019. |
| [32] | HE K M, GKIOXARI G, DOLLáR P, et al. Mask R-CNN[C]∥ 2017 IEEE International Conference on Computer Vision. Piscataway: IEEE Press, 2017. |
| [33] | ZHANG H, LI F, LIU S L, et al. DINO: DETR with improved DeNoising anchor boxes for end-to-end object detection[DB/OL]. arXiv preprint: 2203.03605, 2022. |
| [34] | ZONG Z F, SONG G L, LIU Y. DETRs with collaborative hybrid assignments training[C]∥ 2023 IEEE/CVF International Conference on Computer Vision. Piscataway: IEEE Press, 2023. |
/
| 〈 |
|
〉 |