基于对抗强化学习的组合动力发动机模态转换智能鲁棒控制方法
收稿日期: 2026-01-13
修回日期: 2026-03-13
录用日期: 2026-03-27
网络出版日期: 2026-04-14
基金资助
中国航空科学基金(2023L039068002);厦门市自然科学基金(3502Z202673006);深圳市科技基础研究专项(JCYJ20250604122930040)
Intelligent robust control method for modal transition in combined power engines based on adversarial reinforcement learning
Received date: 2026-01-13
Revised date: 2026-03-13
Accepted date: 2026-03-27
Online published: 2026-04-14
Supported by
Aeronautical Science Foundation of China(2023L039068002);Natural Science Foundation of Xiamen(3502Z202673006);Basic Research Program of Science and Technology of Shenzhen(JCYJ20250604122930040)
针对组合动力发动机在模态转换过程中存在的强非线性、多执行器耦合以及对安全性和鲁棒性要求高等问题,对模态转换阶段的智能鲁棒控制方法进行系统研究。围绕推力连续跟踪与安全约束协同满足的控制目标,构建基于深度强化学习的智能控制框架,并引入对抗训练机制提升控制系统对观测扰动和不确定性的适应能力。在部件级仿真模型基础上,针对不同模态转换过程设计多输入多输出控制策略和分阶段训练环境,通过对抗强化学习实现控制策略的自学习与鲁棒性增强。同时,针对发动机参数波动问题,采用多智能体强化学习方法构建分布式控制结构,并在集中式训练、分布式执行的模式下完成控制器训练。进一步通过硬件在环平台开展实时性验证,结果显示控制周期满足毫秒级实时要求。仿真结果表明:在典型模态转换工况下,所设计的控制方法能够实现推力误差小于1%的稳态跟踪性能,模态转换期间推力波动幅值较对比控制方法表现更优,在引入观测扰动和参数拉偏条件下仍能保持安全约束不被触发。该智能鲁棒控制方法能够有效提升组合动力发动机模态转换过程中的控制精度、安全性与鲁棒性,为宽速域组合动力系统的工程应用提供了一种可行的智能控制方案。
程梓昭 , 刘利军 , 林君健 . 基于对抗强化学习的组合动力发动机模态转换智能鲁棒控制方法[J]. 航空学报, 2026 , 47(15) : 633361 -633361 . DOI: 10.7527/S1000-6893.2026.33361
To address the strong nonlinearity, multi-actuator coupling, and stringent safety and robustness requirements of combined power engines during modal transition, an intelligent robust control method for the modal transition process is investigated. Focusing on the coordinated satisfaction of thrust tracking performance and safety constraints, an intelligent control framework based on deep reinforcement learning is established, in which an adversarial training mechanism is introduced to enhance robustness against observation disturbances and uncertainties. Based on a component-level engine simulation modal, multi-input multi-output control strategies and stage-wise training environments are designed for different modal transition processes, enabling adaptive policy learning and robustness improvement through adversarial reinforcement learning. In addition, to cope with engine parameter variations, a distributed control architecture based on multi-agent reinforcement learning is developed, and controller training is carried out under a centralized training and distributed execution scheme. Furthermore, real-time performance is validated on a hardware-in-the-loop platform, showing that the control cycle meets millisecond-level real-time requirements. Simulation results demonstrate that, under typical modal transition conditions, the proposed control method achieves steady-state thrust tracking errors within 1%, while exhibiting superior performance in thrust fluctuation amplitudes during modal transition compared with conventional control approaches. Under observation disturbances and parameter deviations, safety constraints are consistently satisfied without violation. The results indicate that the proposed intelligent robust control method effectively improves control accuracy, safety, and robustness during modal transition of combined power engines, providing a feasible solution for intelligent control of wide-speed-range combined power propulsion systems.
| [1] | 潘锐, 赵群力. 国外高超声速飞机发展分析[J]. 航空科学技术, 2023, 34(11): 2-7. |
| PAN R, ZHAO Q L. Analysis on the development of hypersonic aircraft abroad[J]. Aeronautical Science & Technology, 2023, 34(11): 2-7 (in Chinese). | |
| [2] | CSANK J, THOMAS S. A turbine based combined cycle engine inlet model and mode transition simulation based on HiTECC tool[C]∥ 48th AIAA/ASME/SAE/ASEE Joint Propulsion Conference & Exhibit. Reston: AIAA, 2012. |
| [3] | 李茜, 崔艳林. 2020年高超声速推进技术发展综述[J]. 航空动力, 2021(2): 20-23. |
| LI Q, CUI Y L. Development review of hypersonic propulsion technology in 2020[J]. Aerospace Power, 2021(2): 20-23 (in Chinese). | |
| [4] | O’NEILL S. Supersonic travel seeks an encore[J]. Engineering, 2022, 10: 1-3. |
| [5] | 李文杰. 从研发项目看美国高超声速飞机发展策略[J]. 战术导弹技术, 2023(5): 59-63, 72. |
| LI W J. Analysis of development strategy of US hypersonic aircraft through research projects[J]. Tactical Missile Technology, 2023(5): 59-63, 72 (in Chinese). | |
| [6] | 李文杰, 林旭斌. NASA启动高超声速飞机研究[J]. 飞航导弹, 2021(5): 9-12. |
| LI W J, LIN X B. NASA launches hypersonic aircraft research[J]. Aerodynamic Missile Journal, 2021(5): 9-12 (in Chinese). | |
| [7] | PENEV P, ZAGORSKI N. Aerospace systems “aerial launch” at the modern stage[J]. Aerospace Research in Bulgaria, 2022, 34: 80-94. |
| [8] | LEISHMAN J G. History of rockets & space flight[M]∥ Introduction to aerospace flight vehicles. Daytona Beach: Embry-Riddle Aeronautical University, 2022. |
| [9] | EET-China. British military and industry jointly announce concept of military hypersonic aircraft demonstrator[EB/OL]. [2026-01-13]. . |
| [10] | News Tencent. Overview of the development of foreign hypersonic vehicle technology in 2023[EB/OL]. [2026-01-13]. . |
| [11] | 马婧雪. 含安全边界的TBCC组合发动机控制研究[D]. 哈尔滨: 哈尔滨工业大学, 2018. |
| MA J X. Control study for over-under TBCC engine with safety boundaries[D]. Harbin: Harbin Institute of Technology, 2018 (in Chinese). | |
| [12] | 林威全, 许航瑞, 兰旭东. TBCC发动机的发展历程及关键技术分析[J]. 清华大学学报(自然科学版), 2024, 64(9): 1521-1535. |
| LIN W Q, XU H R, LAN X D. Development and key technology analysis of turbine-based combined cycle engine[J]. Journal of Tsinghua University (Science and Technology), 2024, 64(9): 1521-1535 (in Chinese). | |
| [13] | 韦宝禧, 凌文辉, 冮强, 等. TRRE发动机关键技术分析及推进性能探索研究[J]. 推进技术, 2017, 38(2): 298-305. |
| WEI B X, LING W H, GANG Q, et al. Analysis of key technologies and propulsion performance research of TRRE engine[J]. Journal of Propulsion Technology, 2017, 38(2): 298-305 (in Chinese). | |
| [14] | 赵俊杰, 徐惊雷. 基于CFD/CSD的TRRE排气系统气-热耦合分析[J]. 机械制造与自动化, 2022, 51(2): 103-106. |
| ZHAO J J, XU J L. Fluid-thermal coupling analysis based on CFD/CSD of TRRE exhaust system[J]. Machine Building & Automation, 2022, 51(2): 103-106 (in Chinese). | |
| [15] | 程锋. 组合动力飞行器宽速域气动/推进一体化耦合建模方法研究[D]. 西安: 西北工业大学, 2019. |
| CHENG F. Study on wide speed range aerodynamics/propulsion integrated coupled modeling of combined propulsion vehicle[D]. Xi’an: Northwestern Polytechnical University, 2019 (in Chinese). | |
| [16] | 郭峰, 桂丰, 尤延铖, 等. 一种涡轮基组合动力的整机低速风洞试验研究[J]. 推进技术, 2019, 40(11): 2436-2443. |
| GUO F, GUI F, YOU Y C, et al. Low-speed wind tunnel test of a turbine-based combined cycle propulsion system[J]. Journal of Propulsion Technology, 2019, 40(11): 2436-2443 (in Chinese). | |
| [17] | 尹泽勇, 尤延铖, 朱呈祥, 等. 面向高超声速民机的多通道双涡轮引射冲压组合动力[J]. 航空学报, 2023, 44(2): 627181. |
| YIN Z Y, YOU Y C, ZHU C X, et al. Multi-channel dual-turbine ejector ramjet combined propulsion for hypersonic civil aircraft[J]. Acta Aeronautica et Astronautica Sinica, 2023, 44(2): 627181 (in Chinese). | |
| [18] | 李富霖, 陈敏, 唐海龙, 等. 考虑环境指标的变循环发动机控制规律设计[J]. 航空学报, 2025, 46(16): 231624. |
| LI F L, CHEN M, TANG H L, et al. Control law design for variable cycle engine considering environmental indicators[J]. Acta Aeronautica et Astronautica Sinica, 2025, 46(16): 231624 (in Chinese). | |
| [19] | 聂聆聪, 牟春晖, 李帅衡. 基于强化学习的宽速域冲压发动机燃烧室一维压力分布控制方法研究[J]. 推进技术, 2025, 46(6): 235-245. |
| NIE L C, MU C H, LI S H. One dimensional pressure distribution reinforcement learning control for ramjet combustor with wide range velocity[J]. Journal of Propulsion Technology, 2025, 46(6): 235-245 (in Chinese). | |
| [20] | 卢则鹏, 王建锋, 李清, 等. 有限功率下航空发动机伺服机构最优控制[J]. 海军航空大学学报, 2025, 40(5): 745-751, 790. |
| LU Z P, WANG J F, LI Q, et al. Optimal control of servo mechanism for aero-engine under limited power constraints[J]. Journal of Naval Aviation University, 2025, 40(5): 745-751, 790 (in Chinese). | |
| [21] | 张悦, 杨刚, 谭慧俊, 等. 外并联型进气道模态转换过程中低速通道再起动特性[J]. 航空学报, 2026, 47(6): 132842. |
| ZHANG Y, YANG G, TAN H J, et al. Restart characteristics of low-speed duct during mode transition in an over-under inlet[J]. Acta Aeronautica et Astronautica Sinica, 2026, 47(6): 132842 (in Chinese). | |
| [22] | GAO W B, ZHOU X, PAN M X, et al. Acceleration control strategy for aero-engines based on model-free deep reinforcement learning method[J]. Aerospace Science and Technology, 2022, 120: 107248. |
| [23] | QIAN R R, FENG Y M, JIANG M M, et al. Design and realization of intelligent aero-engine DDPG controller[J]. Journal of Physics: Conference Series, 2022, 2195(1): 012056. |
| [24] | GAO W B, PAN M X, ZHOU W X, et al. Aero-engine modeling and control method with model-based deep reinforcement learning[J]. Aerospace, 2023, 10(3): 209. |
| [25] | ZHU J M, TANG W, DONG J H, et al. A virtual reinforcement learning method for aero-engine intelligent control[C]∥ 2023 8th International Conference on Automation, Control and Robotics Engineering (CACRE). Piscataway: IEEE Press, 2023: 138-143. |
| [26] | HU Q K, ZHAO Y P. Aero-engine acceleration control using deep reinforcement learning with phase-based reward function[J]. Proceedings of the Institution of Mechanical Engineers, Part G: Journal of Aerospace Engineering, 2022, 236(9): 1878-1894. |
| [27] | 张栋, 唐硕. 超燃冲压发动机燃烧室准一维建模与分析[J]. 弹道学报, 2015, 27(1): 85-91. |
| ZHANG D, TANG S. Quasi one-dimensional modeling and analysis of scramjet combustor[J]. Journal of Ballistics, 2015, 27(1): 85-91 (in Chinese). | |
| [28] | 戴黄山. TBCC发动机安全强化学习智能控制方法研究[D]. 厦门: 厦门大学, 2023. |
| DAI H S. Safety-oriented reinforcement learning control of TBCC engines[D]. Xiamen: Xiamen University, 2023 (in Chinese). |
/
| 〈 |
|
〉 |