针对高速滑翔飞行器末段在终端落角约束、模型不确定性和外部扰动条件下的一体化控制问题,提出一种视线角示范的深度强化学习一体化控制方法。首先,建立飞行器与目标相对运动及姿态动力学耦合模型并结合终端落角约束设计任务先验信息,构造融合飞行状态、视线角误差参考剖面跟踪误差及积分误差的状态表示,将末段一体化控制任务表述为增强马尔可夫决策过程下的策略优化问题。然后,设计基于反步法的专家控制器生成示范动作,并通过模仿学习方式为深度强化学习策略提供专家先验,从而提高训练初期的探索效率。最后,通过仿真验证表明,所提方法可在满足终端落角约束的同时实现由增强状态特征到控制指令的直接策略映射,并在模型不确定性和外部扰动条件下保持较好的鲁棒性。
To address the integrated guidance and control problem of high-speed gliding vehicles in dive phase under terminal impact angle constraints, model uncertainties, and external disturbances, this paper proposes a line-of-sight angle demonstration-guided deep reinforcement learning-based integrated guidance and control method. First, a coupled model of vehicle-target relative motion and attitude dynamics is established. By incorporating task prior information associated with terminal impact angle constraints, an augmented state representation is constructed by integrating flight states, LOS angle error reference profiles, tracking errors, and integral errors. The terminal integrated guidance and control problem is then formulated as a policy optimization problem under an augmented Markov decision process. Subsequently, a backstepping-based expert controller is designed to generate demonstration actions, and an imitation learning mechanism is introduced to provide expert priors for the deep reinforcement learning policy, thereby improving the exploration efficiency during the early training stage. Finally, simulation results demonstrate that the proposed method can satisfy terminal impact angle constraints while achieving policy generation from augmented state features to control commands, and maintains satisfactory robustness under model uncertainties and external disturbances.