ACTA AERONAUTICAET ASTRONAUTICA SINICA >
AFAR-Net: Autoregressive and feedback-driven adaptive rectangular convolution network for pansharpening
Received date: 2025-06-18
Revised date: 2025-08-06
Accepted date: 2025-09-15
Online published: 2025-10-09
Supported by
National Natural Science Foundation of China(62476021);Open Project of State Key Laboratory of Multimodal Artificial Intelligence Systems(MAIS2024106);Fundamental Research Funds for the Central Universities(2025JBZX062)
To enhance spectral fidelity and spatial detail restoration in remote sensing pansharpening tasks， this paper proposes a deep pansharpening network based on an encoder-decoder architecture， named the Autoregressive and Feedback-Driven Adaptive Rectangular Convolution Network for Pansharpening （AFAR-Net）. The proposed network employs an autoregressive mechanism， where the output of the previous unit is used to optimize the current one， enabling progressive multi-level image reconstruction. Meanwhile， a feedback-driven fusion module is designed to efficiently integrate deep features across units， thereby enhancing spectral consistency. On the other hand， an adaptive convolutional residual block is introduced to flexibly adjust kernel sizes and shapes， strengthening the network’s ability to model and restore complex spatial structures. Finally， a lightweight fusion head is utilized to aggregate multi-level predictions， improving the stability of reconstruction. Experimental results on multiple remote sensing datasets demonstrate that the proposed network outperforms existing mainstream approaches in terms of spatial distortion， Spectral Angle Mapper （SAM）， and the Quality with No Reference （QNR） index， showing strong generalization ability and application potential.
Shaohua DUAN , Chunjie ZHANG , Chuankai LIU , Xiaolong ZHENG , Jitao ZHANG . AFAR-Net: Autoregressive and feedback-driven adaptive rectangular convolution network for pansharpening[J]. ACTA AERONAUTICAET ASTRONAUTICA SINICA, 2026 , 47(10) : 532432 -532432 . DOI: 10.7527/S1000-6893.2025.32432
| [1] | 杜虓宇， 王光辉， 陆尘， 等. 复杂城市环境下的资源三号遥感影像绿地提取［J］. 遥感学报， 2024， 28（11）： 2954-2969. |
| DU X Y， WANG G H， LU C， et al. Green space extraction method from ZY-3 remote sensing images in complex urban environment［J］. National Remote Sensing Bulletin， 2024， 28（11）： 2954-2969 （in Chinese）. | |
| [2] | SUN X， YIN D S， QIN F， et al. Revealing influencing factors on global waste distribution via deep-learning based dumpsite detection from satellite imagery［J］. Nature Communications， 2023， 14： 1444. |
| [3] | 葛宏， 王颖. 基于高光谱遥感数据的森林覆盖动态变化监测研究［J］. 测绘与空间地理信息， 2025， 48（5）： 116-119. |
| GE H， WANG Y. Study on forest coverage dynamic change monitoring based on hyperspectral remote sensing data［J］. Geomatics & Spatial Information Technology， 2025， 48（5）： 116-119 （in Chinese）. | |
| [4] | 丛润民， 孙豪言， 罗宇轩， 等. 基于类关系挖掘的遥感图像广义小样本分割方法［J］. 航空学报， 2025， 46（23）： 631694. |
| CONG R M， SUN H Y， LUO Y X， et al. Generalized few-shot segmentation for remote sensing image based on class relation mining［J］. Acta Aeronautica et Astronautica Sinica， 2025， 46（23）： 631694 （in Chinese）. | |
| [5] | ZHANG C J， LIU C K， DUAN S H， et al. Embodied cognitive intelligence guided Moon sample collection［J］. Innovation， 2025， 6（7）： 100939. |
| [6] | CHENG J， DENG C J， SU Y Z， et al. Methods and datasets on semantic segmentation for unmanned aerial vehicle remote sensing images： A review［J］. ISPRS Journal of Photogrammetry and Remote Sensing， 2024， 211： 1-34. |
| [7] | SUN X， WANG P J， YAN Z Y， et al. FAIR1M： A benchmark dataset for fine-grained object recognition in high-resolution remote sensing imagery［J］. ISPRS Journal of Photogrammetry and Remote Sensing， 2022， 184： 116-130. |
| [8] | SHEN H F， MENG X C， ZHANG L P. An integrated framework for the spatio-temporal-spectral fusion of remote sensing images［J］. IEEE Transactions on Geoscience and Remote Sensing， 2016， 54（12）： 7135-7148. |
| [9] | 赵志威， 付昱凯， 杨树文. 一种粒子群优化脉冲耦合神经网络的全色锐化算法［J］. 航天返回与遥感， 2024， 45（5）： 51-63. |
| ZHAO Z W， FU Y K， YANG S W. A multispectral and panchromatic image fusion algorithm based on particle swarm optimization and pulse-coupled neural network［J］. Spacecraft Recovery & Remote Sensing， 2024， 45（5）： 51-63 （in Chinese）. | |
| [10] | ZHANG C J， BAI H H， ZHAO Y. Fine-grained image classification by class and image-specific decomposition with multiple views［J］. IEEE Transactions on Multimedia， 2023， 25： 6756-6766. |
| [11] | ZHANG C J， LIANG C， ZHAO Y. Exemplar-based， semantic guided zero-shot visual recognition［J］. IEEE Transactions on Image Processing， 2022， 31： 3056-3065. |
| [12] | ZHANG J， ZHANG X P， LIU S， et al. FIE-net： foreground instance enhancement network for domain adaptation object detection in remote sensing imagery［J］. IEEE Transactions on Geoscience and Remote Sensing， 2025， 63： 5620714. |
| [13] | ZOU Z X， SHI Z W. Ship detection in spaceborne optical image with SVD networks［J］. IEEE Transactions on Geoscience and Remote Sensing， 2016， 54（10）： 5832-5845. |
| [14] | LYU S C， ZHAO Q， SUN Y X， et al. Unsupervised domain adaptation for VHR urban scene segmentation via prompted foundation model-based hybrid training joint-optimized network［J］. IEEE Transactions on Geoscience and Remote Sensing， 2025， 63： 4409117. |
| [15] | CHEN K Y， LIU C Y， CHEN H， et al. RSPrompter： Learning to prompt for remote sensing instance segmentation based on visual foundation model［J］. IEEE Transactions on Geoscience and Remote Sensing， 2024， 62： 4701117. |
| [16] | SUN X， TIAN Y， LU W X， et al. From single-to multi-modal remote sensing imagery interpretation： A survey and taxonomy［J］. Science China Information Sciences， 2023， 66（4）： 140301. |
| [17] | CARPER W J， LILLESAND T M， KIEFER R W. The use of intensity-hue-saturation transformations for merging SPOT panchromatic and multispectral image data［J］. Photogrammetric Engineering and Remote Sensing， 1990， 56： 457-467. |
| [18] | KWARTENG P， CHAVEZ A. Extracting spectral contrast in landsat thematic mapper image data using selective principal component analysis［J］. Photogrammetric Engineering & Remote Sensing， 1989， 55（1）： 339-348. |
| [19] | KING R L， WANG J. A wavelet based algorithm for pan sharpening Landsat 7 imagery［C］∥IEEE 2001 International Geoscience and Remote Sensing Symposium. Piscataway： IEEE Press， 2001： 849-851. |
| [20] | 徐欣钰， 李小军， 盖钧飞， 等. 结合NSCT变换和引导滤波的多光谱图像全色锐化算法［J］. 自然资源遥感， 2025， 37（1）： 24-30. |
| XU X Y， LI X J， GE J F， et al. A multispectral image pansharpening algorithm based on nonsubsampled contourlet transform （NSCT） combined with a guided filter［J］. Remote Sensing for Natural Resources， 2025， 37（1）： 24-30 （in Chinese）. | |
| [21] | PALSSON F， SVEINSSON J R， ULFARSSON M O. A new pansharpening algorithm based on total variation［J］. IEEE Geoscience and Remote Sensing Letters， 2014， 11（1）： 318-322. |
| [22] | WANG T T， FANG F M， LI F， et al. High-quality Bayesian pansharpening［J］. IEEE Transactions on Image Processing， 2019， 28（1）： 227-239. |
| [23] | YANG J F， FU X Y， HU Y W， et al. PanNet： a deep network architecture for pan-sharpening［C］∥2017 IEEE International Conference on Computer Vision （ICCV）. Piscataway： IEEE Press， 2017： 1753-1761. |
| [24] | HE L， RAO Y Z， LI J， et al. Pansharpening via detail injection based convolutional neural networks［J］. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing， 2019， 12（4）： 1188-1204. |
| [25] | WU X， HUANG T Z， DENG L J， et al. Dynamic cross feature fusion for remote sensing pansharpening［C］∥2021 IEEE/CVF International Conference on Computer Vision （ICCV）. Piscataway： IEEE Press， 2022： 14667-14676. |
| [26] | SHU W J， DOU H X， WEN R， et al. CMT： cross modulation transformer with hybrid loss for pansharpening［J］. IEEE Geoscience and Remote Sensing Letters， 2024， 21： 5004405. |
| [27] | JIN Z R， ZHANG T J， JIANG T X， et al. LAGConv： local-context adaptive convolution kernels with global harmonic bias for pansharpening［J］. Proceedings of the AAAI Conference on Artificial Intelligence， 2022， 36（1）： 1113-1121. |
| [28] | WANG X Y， ZHENG Z X， SHAO J D， et al. Adaptive rectangular convolution for remote sensing pansharpening［C］∥2025 IEEE/CVF Conference on Computer Vision and Pattern Recognition （CVPR）. Piscataway： IEEE Press， 2025： 17872-17881. |
| [29] | GILLESPIE A R， KAHLE A B， WALKER R E. Color enhancement of highly correlated images Ⅱ： Channel ratio and “chromaticity” transformation techniques［J］. Remote Sensing of Environment， 1987， 22（3）： 343-365. |
| [30] | MAURER T. How to pan-sharpen images using the gram-Schmidt pan-sharpen method-a recipe［J］. The International Archives of the Photogrammetry， Remote Sensing and Spatial Information Sciences， 2013， 40： 239-244. |
| [31] | GARZELLI A， NENCINI F， CAPOBIANCO L. Optimal MMSE pan sharpening of very high resolution multispectral images［J］. IEEE Transactions on Geoscience and Remote Sensing， 2008， 46（1）： 228-236. |
| [32] | VIVONE G. Robust band-dependent spatial-detail approaches for panchromatic sharpening［J］. IEEE Transactions on Geoscience and Remote Sensing， 2019， 57（9）： 6421-6433. |
| [33] | VIVONE G， MARANO S， CHANUSSOT J. Pansharpening： Context-based generalized Laplacian Pyramids by robust regression［J］. IEEE Transactions on Geoscience and Remote Sensing， 2020， 58（9）： 6152-6167. |
| [34] | 戴欢， 杨勇， 卢航远， 等. 梯度递归模型优化注入系数的全色锐化算法［J］. 西安电子科技大学学报（自然科学版）， 2025， 52（2）： 143-155. |
| DAI H， YANG Y， LU H Y， et al. Gradient recursive optimization based injection coefficient algorithm for pansharpening［J］. Journal of Xidian University （Natural Science）， 2025， 52（2）： 143-155 （in Chinese）. | |
| [35] | FU X Y， LIN Z H， HUANG Y， et al. A variational pan-sharpening with local gradient constraints［C］∥2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition （CVPR）. Piscataway： IEEE Press， 2020： 10257-10266. |
| [36] | WU Z C， HUANG T Z， DENG L J， et al. LRTCFPan： Low-rank tensor completion based framework for pansharpening［J］. IEEE Transactions on Image Processing， 2023， 32： 1640-1655. |
| [37] | ZHANG K， ZHANG F， WAN W B， et al. Panchromatic and multispectral image fusion for remote sensing and earth observation： Concepts， taxonomy， literature review， evaluation methodologies and challenges ahead［J］. Information Fusion， 2023， 93： 227-242. |
| [38] | WANG H， ZHANG H， TIAN X， et al. Zero-Sharpen： A universal pansharpening method across satellites for reducing scale-variance gap via zero-shot variation［J］. Information Fusion， 2024， 101： 102003. |
| [39] | VIVONE G， DENG L J， DENG S Q， et al. Deep learning in remote sensing image fusion： Methods， protocols， data， and future perspectives［J］. IEEE Geoscience and Remote Sensing Magazine， 2025， 13（1）： 269-310. |
| [40] | DENG L J， VIVONE G， JIN C， et al. Detail injection-based deep convolutional neural networks for pansharpening［J］. IEEE Transactions on Geoscience and Remote Sensing， 2021， 59（8）： 6995-7010. |
| [41] | TIAN X， LI K， ZHANG W， et al. Interpretable model-driven deep network for hyperspectral， multispectral， and panchromatic image fusion［J］. IEEE Transactions on Neural Networks and Learning Systems， 2024， 35（10）： 14382-14395. |
| [42] | XU S， ZHONG S W， LI H， et al. Spectral-spatial attention-guided multi-resolution network for pansharpening［J］. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing， 2025， 18： 7559-7571. |
| [43] | HUANG J， HUANG R， XU J H， et al. Wavelet-assisted multi-frequency attention network for pansharpening［J］. Proceedings of the AAAI Conference on Artificial Intelligence， 2025， 39（4）： 3662-3670. |
| [44] | DUAN Y L， WU X， DENG H Y， et al. Content-adaptive non-local convolution for remote sensing pansharpening［C］∥2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition （CVPR）. Piscataway： IEEE Press， 2024： 27738-27747. |
| [45] | RONNEBERGER O， FISCHER P， BROX T. U-Net： convolutional networks for biomedical image segmentation［C］∥2015 Medical Image Computing and Computer-Assisted Intervention. Cham： Springer， 2015： 234-241. |
/
| 〈 |
|
〉 |
CJA