ACTA AERONAUTICAET ASTRONAUTICA SINICA >
Intelligent maneuvering penetration guidance strategies for aerial vehicles considering interceptor detection capability limitations
Received date: 2024-09-30
Revised date: 2024-10-29
Accepted date: 2024-12-04
Online published: 2024-12-10
Supported by
National Natural Science Foundation of China(61903350);Ministry of Education’s Industry-University-Research Innovation Project(2021ZYA02002);Beijing Institute of Technology Research Fund Program for Young Scholars(3010011182130)
In the face of the development of air defense and missile defense interception technologies and equipment, attack aircraft are confronted with issues such as low battlefield survivability and poor effectiveness due to the interception by defensive weapons. To address the aircraft penetration game and countermeasures problem under the interception scenario, this research proposes an intelligent maneuvering penetration guidance strategy for aircraft that considers the limitations of the interceptor detection capabilities. Initially, the interceptor’s line-of-sight angle and detection range are defined, and the relative motion relationship between the interceptor and the attack aircraft is used to describe the evolution of the confrontation situation between the attack and the defense sides. Subsequently, a proximal policy optimization guidance method is designed based on the principles of deep reinforcement learning, constructing a Markov decision chain that guides the aircraft to actively evade the interceptor’s detection, and further optimizing the aircraft’s reward function design method to achieve precise targeting. On this basis, the convergence speed of the intelligent algorithm is addressed by introducing action exploration and generalized advantage functions. Simulation results show that the intelligent maneuvering penetration guidance strategy endows the aircraft with autonomous learning and optimization attributes, allowing it to increase the difficulty of detection for the interceptor through active evasive maneuvers, ultimately breaking through the detection capability limit of the interceptor to achieve penetration and escape. Compared with the traditional PN-sin penetration guidance method, the penetration guidance strategy proposed in this paper can maintain a higher penetration success rate in scenarios where the attack and defense sides have asymmetric maneuvering capabilities.
Shuyi GAO , Defu LIN , Duo ZHENG , Cheng XU . Intelligent maneuvering penetration guidance strategies for aerial vehicles considering interceptor detection capability limitations[J]. ACTA AERONAUTICAET ASTRONAUTICA SINICA, 2025 , 46(10) : 331304 -331304 . DOI: 10.7527/S1000-6893.2024.31304
1 | LAYNO S B. A model of the ABM-vs.-RV engagement with imperfect RV discrimination?[J]. Operations Research, 1971, 19(6): 1502-1517. |
2 | HE L, YAN X D. Adaptive terminal guidance law for spiral-diving maneuver based on virtual sliding targets[J]. Journal of Guidance, Control, and Dynamics, 2018, 41(7): 1591-1601. |
3 | ZARCHAN P. Proportional navigation and weaving targets[J]. Journal of Guidance, Control, and Dynamics, 1995, 18(5): 969-974. |
4 | 吴炎烜, 陆胥坛, 王正杰. 基于滑模控制的飞行器螺旋机动、制导与控制一体化设计研究[J]. 北京理工大学学报, 2022, 42(5): 523-529. |
WU Y X, LU X T, WANG Z J. Research on integrated design of aircraft spiral maneuver, guidance and control based on sliding mode control[J]. Transactions of Beijing Institute of Technology, 2022, 42(5): 523-529 (in Chinese). | |
5 | FONOD R, SHIMA T. Multiple model adaptive evasion against a homing missile[J]. Journal of Guidance, Control, and Dynamics, 2016, 39(7): 1578-1592. |
6 | 黄鲁豫, 曲鑫, 凡永华, 等. 多约束下的导弹螺旋机动制导控制一体化设计[J]. 宇航学报, 2021, 42(9): 1108-1118. |
HUANG L Y, QU X, FAN Y H, et al. Integrated guidance and control design for spiral maneuvering missile with multiple constraints?[J]. Journal of Astronautics, 2021, 42(9): 1108-1118 (in Chinese). | |
7 | ZHAO D J, SONG Z Y. Reentry trajectory optimization with waypoint and no-fly zone constraints using multiphase convex programming?[J]. Acta Astronautica, 2017, 137: 60-69. |
8 | AKDAG R, ALTILAR D. Modeling evasion tactics of a fighter against missiles in three dimensions: AIAA-2006-6604[R]. Reston: AIAA, 2006. |
9 | EXARCHOS I, TSIOTRAS P, PACHTER M. UAV collision avoidance based on the solution of the suicidal pedestrian differential game: AIAA-2016-2100[R]. Reston: AIAA, 2016. |
10 | YU P, SHTESSEL Y B, EDWARDS C. Adaptive continuous higher order sliding mode control of air breathing hypersonic missile for maximum target penetration: AIAA-2015-2003[R]. Reston: AIAA, 2015. |
11 | 武天才, 王宏伦, 任斌, 等. 考虑规避与突防的高超声速飞行器智能容错制导控制一体化设计[J]. 航空学报, 2024, 45(15): 329607. |
WU T C, WANG H L, REN B, et al. Learning-based integrated fault-tolerant guidance and control for hypersonic vehicles considering avoidance and penetration[J]. Acta Aeronautica et Astronautica Sinica, 2024, 45(15): 329607 (in Chinese). | |
12 | BARES P, LAZARUS S, TSOURDOS A, et al. Adaptive guidance for UAV based on dubins path: AIAA-2013-5181[R]. Reston: AIAA, 2013. |
13 | KIM Y H, RYOO C K, TAHK M J. Guidance synthesis for evasive maneuver of anti-ship missiles against close-in weapon systems[J]. IEEE Transactions on Aerospace and Electronic Systems, 2010, 46(3): 1376-1388. |
14 | HOU L, WANG J, KUANG M, et al. Practical implementation of optimal bang-bang evasive guidance[J]. Journal of Guidance, Control, and Dynamics, 2024: 1-7. |
15 | 邱潇颀, 高长生, 荆武兴, 拦截大气层内机动目标的深度强化学习制导律 [J]. 宇航学报, 2022. 43(5): 685-695. |
QIU X X, GAO C S, JING W X. (2022). Deep reinforcement learning guidance law for intercepting maneuvering targets within the atmosphere[J]. Journal of Astronautics, 43(5), 685-695 (in Chinese). | |
16 | HE S M, SHIN H S, TSOURDOS A. Computational missile guidance: A deep reinforcement learning approach[J]. Journal of Aerospace Information Systems, 2021, 18(8): 571-582. |
17 | WU M Y, HE X J, QIU Z M, et al. Guidance law of interceptors against a high-speed maneuvering target based on deep Q-Network[J]. Transactions of the Institute of Measurement and Control, 2022, 44(7): 1373-1387. |
18 | MERKULOV G, ICELAND E, MICHAELI S, et al. Reinforcement learning based decentralized weapon-target assignment and guidance: AIAA-2024-0125[R]. Reston: AIAA, 2024. |
19 | 肖柳骏, 李雅轩, 刘新福. 基于强化学习的高超声速滑翔飞行器自适应末制导[J]. 兵工学报, 2025, 46(02): 57-66. |
XIAO L J, LI Y X, LIU X F. Adaptive terminal guidance for hypersonic gliding vehicle based on reinforcement learning[J]. Acta Armamentarii, 2025,46(02):57-66. (in Chinese). | |
20 | SINHA A, WHITE D, CAO Y C. Deep reinforcement learning-based optimal time-constrained intercept guidance: AIAA-2024-2206[R]. Reston: AIAA, 2006. |
21 | FEDERICI L, BENEDIKTER B, ZAVOLI A. Deep learning techniques for autonomous spacecraft guidance during proximity operations[J]. Journal of Spacecraft and Rockets, 2021, 58(6): 1774-1785. |
22 | CHEN W X, GAO C S, JING W X. Proximal policy optimization guidance algorithm for intercepting near-space maneuvering targets[J]. Aerospace Science and Technology, 2023, 132: 108031. |
23 | 惠俊鹏, 汪韧, 郭继峰, 基于强化学习的禁飞区绕飞智能制导技术 [J]. 航空学报, 2023. 44(11): 327416. |
HUI J P, WANG R, GUO J F. Intelligent guidance technology for bypassing no-fly zones based on reinforcement learning?[J]. Acta Aeronautica et Astronautica Sinica, 2023, 44(11): 327416 (in Chinese). | |
24 | 高树一, 林德福, 郑多, 等. 针对集群攻击的飞行器智能协同拦截策略[J]. 航空学报, 2023, 44(18): 328301. |
GAO S Y, LIN D F, ZHENG D, et al. Intelligent cooperative interception strategy of aircraft against cluster attack[J]. Acta Aeronautica et Astronautica Sinica, 2023, 44(18): 328301 (in Chinese). | |
25 | SCHULMAN J, WOLSKI F, DHARIWAL P, et al. Proximal policy optimization algorithms[DB/OL]. arxiv preprint: 1707.06347; 2017. |
26 | DENG T B, HUANG H, FANG Y W, et al. Reinforcement learning-based missile terminal guidance of maneuvering targets with decoys[J]. Chinese Journal of Aeronautics, 2023, 36(12): 309-324. |
27 | 王雨琪, 宁国栋, 王晓峰, 等. 基于微分对策的临近空间飞行器机动突防策略[J]. 航空学报, 2020, 41(S2): 724276. |
WANG Y Q, NING G D, WANG X F, et al. Maneuvering penetration strategy of near space vehicle based on differential game[J]. Acta Aeronautica et Astronautica Sinica, 2020, 41(S2): 724276 (in Chinese). |
/
〈 |
|
〉 |