基于时空频谱感知的无人机群电磁对抗智能决策

doi:10.7527/S1000-6893.2026.33157

Abstract

Abstract:

UAV swarms face the dual constraints of communication limitations and imperfect information， making efficient collaborative countermeasures a critical challenge to be addressed. To tackle the collaborative decision-making problem in electronic countermeasures for heterogeneous UAV swarms under star topology constraints and partial observation conditions， an intelligent decision-making method for UAV swarm electronic countermeasures based on spatio-temporal spectrum awareness is proposed to enhance the collaborative effectiveness of heterogeneous swarms in electronic countermeasures. First， a Dec-POMDP model is constructed that integrates role differentiation of heterogeneous nodes， a closed-loop “communication-reconnaissance-jamming” interaction mechanism， and intelligent adversarial gaming， where multi-agent outputs contain continuous decision vectors across communication， motion， reconnaissance， and other dimensions. Subsequently， a Spatio-Temporal Spectrum Awareness Multi-Agent Proximal Policy Optimization （STSA-MAPPO） algorithm is proposed， which decouples frequency-domain features and spatial topological relationships from high-dimensional observations through parallel spectrum awareness and spatial coordination modules， aggregates friend-enemy interaction information in stages via serial cross-attention mechanisms， and incorporates a Gated Recurrent Unit （GRU） memory module to model temporal dependencies， thereby inferring the global situation and predicting the opponent’s strategy. Simulation results demonstrate that the proposed algorithm significantly outperforms baseline algorithms in key metrics including electromagnetic advantage degree and spectrum conflict rate.

Key words: heterogeneous UAV swarm, electronic countermeasures, multi-agent reinforcement learning, star topology, spatio-temporal spectrum awareness

CLC Number:

V279
TN97

Jinjie LIU, Kuixian LI, Yun LIN, Qiling GAO. Intelligent decision-making for UAV swarm electronic countermeasures based on spatio-temporal spectrum awareness[J]. Acta Aeronautica et Astronautica Sinica, 2026, 47(18): 533157.

Figures/Tables 16

Fig.1

Fig.2

Fig.3

Fig.4

Table 1

Environmental parameters

参数	参数符号	数值
行动区域大小/（km×km）	$X$	10×10
安全距离阈值/m	$d m i n$	300
仿真总时长/s	$T$	150
仿真步长/s	$Δ t$	0.5

Table 1

Table 2

Table 3

Fig.5

Fig.6

Fig.7

Fig.8

Fig.9

Fig.10

Fig.11

Fig.12

Fig.13

References 31

[1]	DUAN H B， HUO M Z， FAN Y M. From animal collective behaviors to swarm robotic cooperation［J］. National Science Review， 2023， 10（5）： nwad040.
[2]	LI J H， SUN G， DUAN L J， et al. Multi-objective optimization for UAV swarm-assisted IoT with virtual antenna arrays［J］. IEEE Transactions on Mobile Computing， 2024， 23（5）： 4890-4907.
[3]	JAVED S， HASSAN A， AHMAD R， et al. State-of-the-art and future research challenges in UAV swarms［J］. IEEE Internet of Things Journal， 2024， 11（11）： 19023-19045.
[4]	LI Q， WANG Z L， YAO H P， et al. Dynamic routing mechanism for load distribution in UAV swarm networks with edge caching［J］. IEEE Transactions on Mobile Computing， 2025， 24（12）： 13226-13242.
[5]	RAHMAN M， SARKAR N I， LUTUI R. A survey on multi-UAV path planning： Classification， algorithms， open research problems， and future directions［J］. Drones， 2025， 9（4）： 263.
[6]	DENG H Q， HUANG J， LIU Q， et al. A distributed collaborative allocation method of reconnaissance and strike tasks for heterogeneous UAVs［J］. Drones， 2023， 7（2）： 138.
[7]	王靖瑶，李依格，曾建平. 切换通信拓扑下多智能体系统自适应跟踪控制［J］. 厦门大学学报（自然科学版）， 2023， 62（4）： 598-604.
	WANG J Y， LI Y G， ZENG J P. Leader-following consensus control of multi-agent systems with switching topology： An adaptive approach［J］. Journal of Xiamen University （Natural Science）， 2023， 62（4）： 598-604 （in Chinese）.
[8]	DENG Y S， XIA Y Q， SUN Z Q， et al. Weak loss convexification for sequential convex programming［J］. IEEE Transactions on Aerospace and Electronic Systems， 2025， 61（2）： 4020-4029.
[9]	PAN Y， LI R G， DA X Y， et al. Cooperative trajectory planning and resource allocation for UAV-enabled integrated sensing and communication systems［J］. IEEE Transactions on Vehicular Technology， 2024， 73（5）： 6502-6516.
[10]	WU Y， LIANG T J， GOU J Z， et al. Heterogeneous mission planning for multiple UAV formations via metaheuristic algorithms［J］. IEEE Transactions on Aerospace and Electronic Systems， 2023， 59（4）： 3924-3940.
[11]	LI K X， LIU J J， GU X， et al. Dynamic decision-making of UAV swarm based on constrained multi-objective optimization under incomplete interference information［J］. Chinese Journal of Aeronautics， 2026， 39（7）： 103846.
[12]	LV Z F， XIAO L， DU Y S， et al. Multi-agent reinforcement learning based UAV swarm communications against jamming［J］. IEEE Transactions on Wireless Communications， 2023， 22（12）： 9063-9075.
[13]	ZHANG Y X， LUAN M G， CHANG Z， et al. Multiagent reinforcement learning-based resource sharing in multi-UAV wireless networks［J］. IEEE Journal on Miniaturization for Air and Space Systems， 2025， 6（2）： 103-112.
[14]	LI K X， FAN H D， YANG Y D， et al. Multiagent reinforcement-learning-based AAV path and resource allocation for ground-to-air communication network［J］. IEEE Internet of Things Journal， 2025， 12（21）： 44243-44254.
[15]	LV Y， LEI J L， YI P. A local information aggregation-based multiagent reinforcement learning for robot swarm dynamic task allocation［J］. IEEE Transactions on Neural Networks and Learning Systems， 2025， 36（6）： 10437-10449.
[16]	高兵，张哲婕，邹启杰，等. 基于深度强化学习和信息论的多智能体通信方法［J］. 航空学报， 2024， 45（18）： 329862.
	GAO B， ZHANG Z J， ZOU Q J， et al. Multi-agent communication cooperation based on deep reinforcement learning and information theory［J］. Acta Aeronautica et Astronautica Sinica， 2024， 45（18）： 329862 （in Chinese）.
[17]	PU Z Q， WANG H M， LIU Z， et al. Attention enhanced reinforcement learning for multi agent cooperation［J］. IEEE Transactions on Neural Networks and Learning Systems， 2023， 34（11）： 8235-8249.
[18]	LV Z F， XIAO L， CHEN Y F， et al. Safe multi-agent reinforcement learning for wireless applications against adversarial communications［J］. IEEE Transactions on Information Forensics and Security， 2024， 19： 6824-6839.
[19]	WANG Z， LIU F， GUO J， et al. UAV swarm confrontation based on multi-agent deep reinforcement learning［C］∥2022 41st Chinese Control Conference. Piscataway： IEEE Press， 2022： 4996-5001.
[20]	XIANG L， XIE T. Research on UAV swarm confrontation task based on MADDPG algorithm［C］∥2020 5th International Conference on Mechanical， Control and Computer Engineering. Piscataway： IEEE Press， 2021： 1513-1518.
[21]	CERAR G， YETGIN H， MOHORČIČ M， et al. Machine learning for wireless link quality estimation： A survey［J］. IEEE Communications Surveys & Tutorials， 2021， 23（2）： 696-728.
[22]	LIN M Y， ZHANG X X， TIAN Y， et al. Multi-signal detection framework： A deep learning based carrier frequency and bandwidth estimation［J］. Sensors， 2022， 22（10）： 3909.
[23]	LI Y Q， MUKHOPADHYAY B， ALOUINI M S. RSS-based cooperative localization and transmit power（s） estimation using mixed SDP-SOCP［J］. IEEE Transactions on Vehicular Technology， 2023， 72（12）： 16936-16941.
[24]	XIAO Z C， LIU R， LI M， et al. A novel joint angle-range-velocity estimation method for MIMO-OFDM ISAC systems［J］. IEEE Transactions on Signal Processing， 2024， 72： 3805-3818.
[25]	VAN DER MERWE J R， CONTRERAS FRANCO D， HANSEN J， et al. Low-cost COTS GNSS interference monitoring， detection， and classification system［J］. Sensors， 2023， 23（7）： 3452.
[26]	CHENG G Y， FANG Y， XU J， et al. Optimal coordinated transmit beamforming for networked integrated sensing and communications［J］. IEEE Transactions on Wireless Communications， 2024， 23（8）： 8200-8214.
[27]	VASWANI A， SHAZEER N， PARMAR N， et al. Attention is all you need［C］∥Proceedings of the 31st International Conference on Neural Information Processing Systems. Red Hook： Curran Associates， Inc.， 2017： 5998-6008.
[28]	CHO K， VAN MERRIËNBOER B， GULCEHRE C， et al. Learning phrase representations using RNN encoder： Decoder for statistical machine translation［C］∥Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing. Kerrville： Association for Computational Linguistics， 2014： 1724-1734.
[29]	YU C， VELU A， VINITSKY E， et al. The surprising effectiveness of PPO in cooperative multi-agent games［C］∥Proceedings of the 36th Advances International Conference on Neural Information Processing Systems. Red Hook： Curran Associates， Inc.， 2022： 24611-24624.
[30]	LOWE R， WU Y， TAMAR A， et al. Multi-agent actor-critic for mixed cooperative-competitive environments［C］∥Proceedings of the 31st International Conference on Neural Information Processing Systems. Red Hook： Curran Associates， Inc.， 2017： 6382-6393.
[31]	HAARNOJA T， ZHOU A， ABBEEL P， et al. Soft actor-critic： Off-policy maximum entropy deep reinforcement learning with a stochastic actor［DB/OL］. arXiv： 1801.01290， 2018.

参数	数值
无人机数量	1
最大连接数量	5
通信频率范围/GHz	［1.0，1.6］
速度范围/（m·s^-1）	［0，150］
发射功率范围/W	［0，0.2］

参数	数值
无人机数量	5
通信频率范围/GHz	［1.0，1.6］
速度范围/（m·s^-1）	［0，200］
发射功率范围/W	［0，0.1］
侦察频率范围/GHz	［1.0，1.6］
干扰频率范围/GHz	［1.0，1.6］
干扰功率/W	1

Intelligent decision-making for UAV swarm electronic countermeasures based on spatio-temporal spectrum awareness

RichHTML

PDF (PC)

Knowledge

Abstract

Cite this article

share this article

Figures/Tables 16

References 31

Related Articles 4

Recommended Articles

Metrics

Comments

[1]	Yunxiao LIAN, Ni LI, Feng XIE, Pan ZHOU, Changyin DONG. A multi-UAV cooperative air combat decision-making method based on spatial-temporal information fusion [J]. Acta Aeronautica et Astronautica Sinica, 2026, 47(6): 332633-332633.
[2]	Xiaowei FU, Zhe XU, Jindong ZHU, Nan WANG. Maneuvering decision-making of multi-UAV attack-defence confrontation based on PER-MATD3 [J]. ACTA AERONAUTICAET ASTRONAUTICA SINICA, 2023, 44(7): 327083-327083.
[3]	Shuyi GAO, Defu LIN, Duo ZHENG, Xinyu HU. Intelligent cooperative interception strategy of aircraft against cluster attack [J]. Acta Aeronautica et Astronautica Sinica, 2023, 44(18): 328301-328301.
[4]	HUANG Long, DONG Chunxi, ZHAO Guoqing, SHEN Zhibo. InSAR Deception Jamming Method Based on Multiple Jammers [J]. ACTA AERONAUTICAET ASTRONAUTICA SINICA, 2014, 35(6): 1714-1723.