Electronics and Electrical Engineering and Control

Intelligent maneuvering penetration guidance strategies for aerial vehicles considering interceptor detection capability limitations

  • Shuyi GAO ,
  • Defu LIN ,
  • Duo ZHENG ,
  • Cheng XU
Expand
  • 1.School of Aerospace Engineering,Beijing Institute of Technology,Beijing 100081,China
    2.Science and Technology on Complex System Control and Intelligent Agent Cooperative Laboratory,Beijing 100074,China

Received date: 2024-09-30

  Revised date: 2024-10-29

  Accepted date: 2024-12-04

  Online published: 2024-12-10

Supported by

National Natural Science Foundation of China(61903350);Ministry of Education’s Industry-University-Research Innovation Project(2021ZYA02002);Beijing Institute of Technology Research Fund Program for Young Scholars(3010011182130)

Abstract

In the face of the development of air defense and missile defense interception technologies and equipment, attack aircraft are confronted with issues such as low battlefield survivability and poor effectiveness due to the interception by defensive weapons. To address the aircraft penetration game and countermeasures problem under the interception scenario, this research proposes an intelligent maneuvering penetration guidance strategy for aircraft that considers the limitations of the interceptor detection capabilities. Initially, the interceptor’s line-of-sight angle and detection range are defined, and the relative motion relationship between the interceptor and the attack aircraft is used to describe the evolution of the confrontation situation between the attack and the defense sides. Subsequently, a proximal policy optimization guidance method is designed based on the principles of deep reinforcement learning, constructing a Markov decision chain that guides the aircraft to actively evade the interceptor’s detection, and further optimizing the aircraft’s reward function design method to achieve precise targeting. On this basis, the convergence speed of the intelligent algorithm is addressed by introducing action exploration and generalized advantage functions. Simulation results show that the intelligent maneuvering penetration guidance strategy endows the aircraft with autonomous learning and optimization attributes, allowing it to increase the difficulty of detection for the interceptor through active evasive maneuvers, ultimately breaking through the detection capability limit of the interceptor to achieve penetration and escape. Compared with the traditional PN-sin penetration guidance method, the penetration guidance strategy proposed in this paper can maintain a higher penetration success rate in scenarios where the attack and defense sides have asymmetric maneuvering capabilities.

Cite this article

Shuyi GAO , Defu LIN , Duo ZHENG , Cheng XU . Intelligent maneuvering penetration guidance strategies for aerial vehicles considering interceptor detection capability limitations[J]. ACTA AERONAUTICAET ASTRONAUTICA SINICA, 2025 , 46(10) : 331304 -331304 . DOI: 10.7527/S1000-6893.2024.31304

References

1 LAYNO S B. A model of the ABM-vs.-RV engagement with imperfect RV discrimination?[J]. Operations Research197119(6): 1502-1517.
2 HE L, YAN X D. Adaptive terminal guidance law for spiral-diving maneuver based on virtual sliding targets[J]. Journal of Guidance, Control, and Dynamics201841(7): 1591-1601.
3 ZARCHAN P. Proportional navigation and weaving targets[J]. Journal of Guidance, Control, and Dynamics199518(5): 969-974.
4 吴炎烜, 陆胥坛, 王正杰. 基于滑模控制的飞行器螺旋机动、制导与控制一体化设计研究[J]. 北京理工大学学报202242(5): 523-529.
  WU Y X, LU X T, WANG Z J. Research on integrated design of aircraft spiral maneuver, guidance and control based on sliding mode control[J]. Transactions of Beijing Institute of Technology202242(5): 523-529 (in Chinese).
5 FONOD R, SHIMA T. Multiple model adaptive evasion against a homing missile[J]. Journal of Guidance, Control, and Dynamics201639(7): 1578-1592.
6 黄鲁豫, 曲鑫, 凡永华, 等. 多约束下的导弹螺旋机动制导控制一体化设计[J]. 宇航学报202142(9): 1108-1118.
  HUANG L Y, QU X, FAN Y H, et al. Integrated guidance and control design for spiral maneuvering missile with multiple constraints?[J]. Journal of Astronautics202142(9): 1108-1118 (in Chinese).
7 ZHAO D J, SONG Z Y. Reentry trajectory optimization with waypoint and no-fly zone constraints using multiphase convex programming?[J]. Acta Astronautica2017137: 60-69.
8 AKDAG R, ALTILAR D. Modeling evasion tactics of a fighter against missiles in three dimensions: AIAA-2006-6604[R]. Reston: AIAA, 2006.
9 EXARCHOS I, TSIOTRAS P, PACHTER M. UAV collision avoidance based on the solution of the suicidal pedestrian differential game: AIAA-2016-2100[R]. Reston: AIAA, 2016.
10 YU P, SHTESSEL Y B, EDWARDS C. Adaptive continuous higher order sliding mode control of air breathing hypersonic missile for maximum target penetration: AIAA-2015-2003[R]. Reston: AIAA, 2015.
11 武天才, 王宏伦, 任斌, 等. 考虑规避与突防的高超声速飞行器智能容错制导控制一体化设计[J]. 航空学报202445(15): 329607.
  WU T C, WANG H L, REN B, et al. Learning-based integrated fault-tolerant guidance and control for hypersonic vehicles considering avoidance and penetration[J]. Acta Aeronautica et Astronautica Sinica202445(15): 329607 (in Chinese).
12 BARES P, LAZARUS S, TSOURDOS A, et al. Adaptive guidance for UAV based on dubins path: AIAA-2013-5181[R]. Reston: AIAA, 2013.
13 KIM Y H, RYOO C K, TAHK M J. Guidance synthesis for evasive maneuver of anti-ship missiles against close-in weapon systems[J]. IEEE Transactions on Aerospace and Electronic Systems201046(3): 1376-1388.
14 HOU L, WANG J, KUANG M, et al. Practical implementation of optimal bang-bang evasive guidance[J]. Journal of Guidance, Control, and Dynamics2024: 1-7.
15 邱潇颀, 高长生, 荆武兴, 拦截大气层内机动目标的深度强化学习制导律 [J]. 宇航学报2022. 43(5): 685-695.
  QIU X X, GAO C S, JING W X. (2022). Deep reinforcement learning guidance law for intercepting maneuvering targets within the atmosphere[J]. Journal of Astronautics43(5), 685-695 (in Chinese).
16 HE S M, SHIN H S, TSOURDOS A. Computational missile guidance: A deep reinforcement learning approach[J]. Journal of Aerospace Information Systems202118(8): 571-582.
17 WU M Y, HE X J, QIU Z M, et al. Guidance law of interceptors against a high-speed maneuvering target based on deep Q-Network[J]. Transactions of the Institute of Measurement and Control202244(7): 1373-1387.
18 MERKULOV G, ICELAND E, MICHAELI S, et al. Reinforcement learning based decentralized weapon-target assignment and guidance: AIAA-2024-0125[R]. Reston: AIAA, 2024.
19 肖柳骏, 李雅轩, 刘新福. 基于强化学习的高超声速滑翔飞行器自适应末制导[J]. 兵工学报202546(02): 57-66.
  XIAO L J, LI Y X, LIU X F. Adaptive terminal guidance for hypersonic gliding vehicle based on reinforcement learning[J]. Acta Armamentarii202546(02):57-66. (in Chinese).
20 SINHA A, WHITE D, CAO Y C. Deep reinforcement learning-based optimal time-constrained intercept guidance: AIAA-2024-2206[R]. Reston: AIAA, 2006.
21 FEDERICI L, BENEDIKTER B, ZAVOLI A. Deep learning techniques for autonomous spacecraft guidance during proximity operations[J]. Journal of Spacecraft and Rockets202158(6): 1774-1785.
22 CHEN W X, GAO C S, JING W X. Proximal policy optimization guidance algorithm for intercepting near-space maneuvering targets[J]. Aerospace Science and Technology2023132: 108031.
23 惠俊鹏, 汪韧, 郭继峰, 基于强化学习的禁飞区绕飞智能制导技术 [J]. 航空学报2023. 44(11): 327416.
  HUI J P, WANG R, GUO J F. Intelligent guidance technology for bypassing no-fly zones based on reinforcement learning?[J]. Acta Aeronautica et Astronautica Sinica202344(11): 327416 (in Chinese).
24 高树一, 林德福, 郑多, 等. 针对集群攻击的飞行器智能协同拦截策略[J]. 航空学报202344(18): 328301.
  GAO S Y, LIN D F, ZHENG D, et al. Intelligent cooperative interception strategy of aircraft against cluster attack[J]. Acta Aeronautica et Astronautica Sinica202344(18): 328301 (in Chinese).
25 SCHULMAN J, WOLSKI F, DHARIWAL P, et al. Proximal policy optimization algorithms[DB/OL]. arxiv preprint: 1707.06347; 2017.
26 DENG T B, HUANG H, FANG Y W, et al. Reinforcement learning-based missile terminal guidance of maneuvering targets with decoys[J]. Chinese Journal of Aeronautics202336(12): 309-324.
27 王雨琪, 宁国栋, 王晓峰, 等. 基于微分对策的临近空间飞行器机动突防策略[J]. 航空学报202041(S2): 724276.
  WANG Y Q, NING G D, WANG X F, et al. Maneuvering penetration strategy of near space vehicle based on differential game[J]. Acta Aeronautica et Astronautica Sinica202041(S2): 724276 (in Chinese).
Outlines

/