ACTA AERONAUTICAET ASTRONAUTICA SINICA >
Nash equilibrium calculation for spacecraft pursuit-evasion game with impulsive maneuver
Received date: 2025-08-07
Revised date: 2025-09-01
Accepted date: 2025-10-31
Online published: 2026-01-09
Supported by
National Natural Science Foundation of China(62303047);Open Fund of National Key Laboratory of Space Intelligent Control(2024-CXPT-GF-JJ-012-05)
In the multi-satellite orbital game mission， each spacecraft obtains the current situation through observation， and then formulates maneuver strategies according to observation results and plans the working time of the thrusters based on the characteristics of the actuator to generate the desired velocity impulses. This process can be described by an integrated Observation-Decision-Actuation （ODA） system. The closed-loop time of the system is crucial to the orbital mission. Making efficient decisions under the time constraints of the integrated system is the key to improving the game efficiency. This paper focuses on the three-satellite pursuit-evasion game， which composes of a pursuer， an evader， and a defender. A fast-solving method for the Nash equilibrium is proposed and then an adaptive pursuing strategy is proposed such that the pursuer can track the evader while avoiding the defender. Firstly， in order to efficiently solve the Nash equilibrium under impulsive thrust， an analytical model of the relative reachable region of the spacecraft is established. Then， the fast-solving method for the Nash equilibrium of the two participants is proposed based on the reachable region and the distribution of the Nash equilibrium for the three participants is analyzed. This method can reduce the optimization range and the calculation complexity of numerical optimization. Besides， in order to improve the tracking ability of the pursuer against different opponents， a parameter-adaptive mechanism is established to dynamically adjust the optimization index parameters such that the the distribution of the Nash equilibrium can be changed accordingly. Finally， the correctness and efficiency of the Nash equilibrium strategy proposed in this paper is verified through numerical simulation.
Yuanzhuo GENG , Li YUAN , Haibo ZHANG , Yingjie WANG . Nash equilibrium calculation for spacecraft pursuit-evasion game with impulsive maneuver[J]. ACTA AERONAUTICAET ASTRONAUTICA SINICA, 2026 , 47(14) : 332695 -332695 . DOI: 10.7527/S1000-6893.2025.32695
| [1] | YE D， SHI M M， SUN Z W. Satellite proximate interception vector guidance based on differential games［J］. Chinese Journal of Aeronautics， 2018， 31（6）： 1352-1361. |
| [2] | 施伟， 冯旸赫， 程光权， 等. 基于深度强化学习的多机协同空战方法研究［J］. 自动化学报， 2021， 47（7）： 1610-1623. |
| SHI W， FENG Y H， CHENG G Q， et al. Research on multi-aircraft cooperative air combat method based on deep reinforcement learning［J］. Acta Automatica Sinica， 2021， 47（7）： 1610-1623 （in Chinese）. | |
| [3] | POPE A P， IDE J S， MI?OVI? D， et al. Hierarchical reinforcement learning for air-to-air combat［C］∥2021 International Conference on Unmanned Aircraft Systems （ICUAS）. Piscataway： IEEE Press， 2021： 275-284. |
| [4] | ZHANG J R， ZHANG K P， ZHANG Y， et al. Near-optimal interception strategy for orbital pursuit-evasion using deep reinforcement learning［J］. Acta Astronautica， 2022， 198： 9-25. |
| [5] | ZHANG K P， ZHANG Y， SHI H， et al. Escape-zone-based optimal evasion guidance against multiple orbital pursuers［J］. IEEE Transactions on Aerospace and Electronic Systems， 2023， 59（6）： 7698-7714. |
| [6] | 王英杰， 袁利， 汤亮， 等. 信息非完备下多航天器轨道博弈强化学习方法［J］. 宇航学报， 2023， 44（10）： 1522-1533. |
| WANG Y J， YUAN L， TANG L， et al. Reinforcement learning method for multi-spacecraft orbital game with incomplete information［J］. Journal of Astronautics， 2023， 44（10）： 1522-1533 （in Chinese）. | |
| [7] | 耿远卓， 袁利， 黄煌， 等. 基于终端诱导强化学习的航天器轨道追逃博弈［J］. 自动化学报， 2023， 49（5）： 974-984. |
| GENG Y Z， YUAN L， HUANG H， et al. Terminal-guidance based reinforcement-learning for orbital pursuit-evasion game of the spacecraft［J］. Acta Automatica Sinica， 2023， 49（5）： 974-984 （in Chinese）. | |
| [8] | GENG Y Z， YUAN L， GUO Y N， et al. Impulsive guidance of optimal pursuit with conical imaging zone for the evader［J］. Aerospace Science and Technology， 2023， 142： 108604. |
| [9] | LI Y， CHEN W C， YANG L. Multistage linear Gauss pseudospectral method for piecewise continuous nonlinear optimal control problems［J］. IEEE Transactions on Aerospace and Electronic Systems， 2021， 57（4）： 2298-2310. |
| [10] | SHEN H X， CASALINO L. Revisit of the three-dimensional orbital pursuit-evasion game［J］. Journal of Guidance， Control， and Dynamics， 2018， 41（8）： 1823-1831. |
| [11] | LI Z Y， ZHU H， YANG Z， et al. Saddle point of orbital pursuit-evasion game under J2-perturbed dynamics［J］. Journal of Guidance， Control， and Dynamics， 2020， 43（9）： 1733-1739. |
| [12] | LI Z Y， ZHU H， YANG Z， et al. A dimension-reduction solution of free-time differential games for spacecraft pursuit-evasion［J］. Acta Astronautica， 2019， 163： 201-210. |
| [13] | VENIGALLA C， SCHEERES D J. Delta-V-based analysis of spacecraft pursuit-evasion games［J］. Journal of Guidance， Control， and Dynamics， 2021， 44（11）： 1961-1971. |
| [14] | ASRI B EL， LALIOUI H. Continuous and impulse controls differential game in finite horizon with Nash-equilibrium and application［J］. Journal of Computational and Applied Mathematics， 2023， 424： 115009. |
| [15] | SADANA U， REDDY P V， ZACCOUR G. Nash equilibria in nonzero-sum differential games with impulse control［J］. European Journal of Operational Research， 2021， 295（2）： 792-805. |
| [16] | SADANA U， REDDY P V， ZACCOUR G. Feedback Nash equilibria in differential games with impulse control［J］. IEEE Transactions on Automatic Control， 2023， 68（8）： 4523-4538. |
| [17] | LIANG H Z， WANG J Y， LIU J Q， et al. Guidance strategies for interceptor against active defense spacecraft in two-on-two engagement［J］. Aerospace Science and Technology， 2020， 96： 105529. |
| [18] | BOYELL R L. Defending a moving target against missile or torpedo attack［J］. IEEE Transactions on Aerospace and Electronic Systems， 1976， AES-12（4）： 522-526. |
| [19] | CASBEER D W， GARCIA E， FUCHS Z E， et al. Cooperative target defense differential game with a constrained-maneuverable defender［C］∥2015 54th IEEE Conference on Decision and Control （CDC）. Piscataway： IEEE Press， 2016： 1713-1718. |
| [20] | GARCIA E， CASBEER D W， PACHTER M. Cooperative strategies for optimal aircraft defense from an attacking missile［J］. Journal of Guidance， Control， and Dynamics， 2015， 38（8）： 1510-1520. |
| [21] | GARCIA E， CASBEER D W， PACHTER M. Active target defense using first order missile models［J］. Automatica， 2017， 78： 139-143. |
| [22] | RUBINSKY S， GUTMAN S. Three-player pursuit and evasion conflict［J］. Journal of Guidance， Control， and Dynamics， 2014， 37（1）： 98-110. |
| [23] | LIANG L， DENG F， PENG Z H， et al. A differential game for cooperative target defense［J］. Automatica， 2019， 102： 58-71. |
| [24] | LIANG L， DENG F， LU M B， et al. Analysis of role switch for cooperative target defense differential game［J］. IEEE Transactions on Automatic Control， 2021， 66（2）： 902-909. |
| [25] | LIU F， DONG X W， LI Q D， et al. Cooperative differential games guidance laws for multiple attackers against an active defense target［J］. Chinese Journal of Aeronautics， 2022， 35（5）： 374-389. |
| [26] | 刘坤， 郑晓帅， 林业茗， 等. 基于微分博弈的追逃问题最优策略设计［J］. 自动化学报， 2021， 47（8）： 1840-1854. |
| LIU K， ZHENG X S， LIN Y M， et al. Design of optimal strategies for the pursuit-evasion problem based on differential game［J］. Acta Automatica Sinica， 2021， 47（8）： 1840-1854 （in Chinese）. | |
| [27] | LIU Y F， LI R F， HU L， et al. Optimal solution to orbital three-player defense problems using impulsive transfer［J］. Soft Computing， 2018， 22（9）： 2921-2934. |
| [28] | 邓子泉. 基于增量机动方式及评分矩阵的三航天器追逃策略研究［D］. 哈尔滨： 哈尔滨工业大学， 2018： 21-28. |
| DENG Z Q. Research on pursuit strategy of three spacecraft based on incremental maneuver mode and scoring matrix［D］. Harbin： Harbin Institute of Technology， 2018： 21-28 （in Chinese）. | |
| [29] | 李昊然. 基于评分矩阵的平面内两航天器姿轨耦合追逃策略研究［D］. 哈尔滨： 哈尔滨工业大学， 2020： 25-29. |
| LI H R. Research on attitude-orbit coupling pursuit strategy of two spacecraft in plane based on scoring matrix［D］. Harbin： Harbin Institute of Technology， 2020： 25-29 （in Chinese）. | |
| [30] | 王淳宝， 叶东， 孙兆伟， 等. 航天器末端拦截自适应博弈策略［J］. 宇航学报， 2020， 41（3）： 309-318. |
| WANG C B， YE D， SUN Z W， et al. Adaptive game strategy of spacecraft terminal interception［J］. Journal of Astronautics， 2020， 41（3）： 309-318 （in Chinese）. | |
| [31] | ZHOU J F， ZHAO L， CHENG J H， et al. Pursuer’s control strategy for orbital pursuit-evasion-defense game with continuous low thrust propulsion［J］. Applied Sciences， 2019， 9（15）： 3190. |
| [32] | 张乘铭. 航天器追逃博弈制导策略研究［D］. 长沙： 国防科技大学， 2021： 59-69. |
| ZHANG C M. Research on guidance strategy for spacecraft pursuit-evasion games［D］. Changsha： National University of Defense Technology， 2021： 59-69 （in Chinese）. | |
| [33] | 赵琳， 周俊峰， 刘源， 等. 三维空间“追-逃-防”三方微分对策方法［J］. 系统工程与电子技术， 2019， 41（2）： 322-335. |
| ZHAO L， ZHOU J F， LIU Y， et al. Three-body differential game approach of pursuit-evasion-defense in three dimensional space［J］. Systems Engineering and Electronics， 2019， 41（2）： 322-335 （in Chinese）. | |
| [34] | ZHANG K P， ZHANG Y， SHI H， et al. Escape-zone-based optimal evasion guidance against multiple orbital pursuers［J］. IEEE Transactions on Aerospace and Electronic Systems， 2023， 59（6）： 7698-7714. |
/
| 〈 |
|
〉 |
CJA