失效卫星姿态接管的并行学习合作博弈控制

doi:10.7527/S1000-6893.2020.24307

电子电气工程与控制

本期目录 | 过刊浏览 | 高级检索

前一篇 | 后一篇

失效卫星姿态接管的并行学习合作博弈控制

韩楠^1,2, 罗建军^1,2, 马卫华^1,2

1. 西北工业大学航天学院, 西安 710072;
2. 西北工业大学航天飞行动力技术重点实验室, 西安 710072

收稿日期:2020-05-27 修回日期:2020-07-11 发布日期:2020-08-31
通讯作者: 马卫华 E-mail:whma_npu@nwpu.edu.cn
基金资助:
国家自然科学基金（61690210，61690211）；深圳科创委基金项目（JCYJ20180508151938535）；西北工业大学博士论文创新基金（CX201803）

Concurrent learning cooperative game control for attitude takeover of failed satellites

HAN Nan^1,2, LUO Jianjun^1,2, MA Weihua^1,2

1. School of Astronautics, Northwestern Polytechnical University, Xi'an 710072, China;
2. National Key Laboratory of Aerospace Flight Dynamics, Northwestern Polytechnical University, Xi'an 710072, China

Received:2020-05-27 Revised:2020-07-11 Published:2020-08-31
Supported by:
National Natural Science Foundation of China (61690210, 61690211);Science Foundation of Science, Technology and Innovation Commission of Shenzhen Municipality (JCYJ20180508151938535);Innovation Foundation for Doctor Dissertation of Northwestern Polytechnical University (CX201803)

摘要/Abstract

摘要： 针对多颗微小卫星合作接管失效卫星姿态运动的问题，研究了考虑微小卫星控制约束的多星合作博弈策略学习与协同控制方法。首先，建立了微小卫星合作博弈模型，给出了能够处理微小卫星控制约束的多星合作博弈帕累托最优策略显式表达式。其次，针对微小卫星合作博弈策略学习需求，通过过去与当前时刻数据的并行使用，设计了基于并行学习的策略迭代方法，该方法放松了神经网络（NN）权值矢量学习对持续激励条件的要求。给出了为确保神经网络权值矢量估值收敛，所使用的过去时刻数据所需满足的条件，并通过Lyapunov方法分析了神经网络权值矢量估计误差的一致最终有界性。之后，采用并行学习策略迭代方法进行了微小卫星合作博弈帕累托最优策略数值解的逼近。所获得的合作博弈策略具有反馈控制形式，在进行神经网络权值矢量学习后，各微小卫星能够通过合作博弈策略的独立计算实现失效卫星姿态运动接管过程中的闭环协同控制。所设计方法避免了传统姿态控制方法所需进行的力矩分配，消除了微小卫星数量对其控制计算复杂度的影响。最后，通过数值仿真对所设计方法的有效性进行了验证。

关键词: 接管控制, 微小卫星, 合作博弈, 并行学习, 策略迭代

Abstract: Taking the control constraint of microsatellites into consideration, this paper studies the cooperative game strategy learning and coordinated control problems of multiple microsatellites cooperatively taking over the attitude movement of a failed satellite. The cooperative game model of microsatellites is first established, providing the explicit expression of the Pareto optimal strategy that can handle the control constraint of microsatellites. Secondly, to learn the Pareto optimal strategy of microsatellites, we design a concurrent learning based Policy Iteration (PI) method free of the Persistency of Excitation (PE) condition by concurrent use of the past and current data. The condition that the used past data needs to satisfy to ensure the convergence of the Neural Network (NN) weight estimations is proposed, and the Uniform Ultimate Boundedness (UUB) of NN weight estimation errors is analyzed using the Lyapunov method. Then, the Pareto optimal strategy of microsatellites is approximated using the concurrent learning PI method. The obtained cooperative game strategy of microsatellites has a feedback control form, and after the NN weight learning is accomplished, the closed-loop coordinated control of microsatellites can be realized during the takeover control through independent game strategy calculation. Since the need of torque allocation required by traditional attitude control methods is avoided, the computational complexity of the method is independent of the number of microsatellites. Finally, numerical simulations are conducted to validate the effectiveness of the developed method.

Key words: takeover control, microsatellites, cooperative game, concurrent learning, policy iteration

中图分类号:

V448.2

韩楠, 罗建军, 马卫华. 失效卫星姿态接管的并行学习合作博弈控制[J]. 航空学报, 2021, 42(3): 324307-324307.

HAN Nan, LUO Jianjun, MA Weihua. Concurrent learning cooperative game control for attitude takeover of failed satellites[J]. ACTA AERONAUTICAET ASTRONAUTICA SINICA, 2021, 42(3): 324307-324307.

参考文献

[1] JAEGER T, MIRCZAK W. Satlets-the building blocks of future satellites-and which mold do you use?[C]//AIAA SPACE 2013 Conference and Exposition. Reston:AIAA, 2013.
[2] JOHNSON L K, HOLLMAN J, MCCLELLAN J, et al. Utilizing cubesat architecture and innovative low-complexity devices to repurpose decommissioned apertures for RF communications[C]//AIAA SPACE 2013 Conference and Exposition. Reston:AIAA, 2013.
[3] GOELLER M, OBERLAENDER J, UHL K, et al. Modular robots for on-orbit satellite servicing[C]//2012 IEEE International Conference on Robotics and Biomimetics (ROBIO). Piscataway:IEEE Press, 2012:2018-2023.
[4] WEISE J, BRIE K, ADOMEIT A, et al. An intelligent building blocks concept for on-orbit-satellite servicing[C]//Proceedings of the International Symposium on Artificial Intelligence, Robotics and Automation in Space (iSAIRAS), 2012.
[5] 夏冬冬, 岳晓奎. 基于浸入与不变理论的航天器姿态跟踪自适应控制[J]. 航空学报, 2020, 41(2):323428. XIA D D, YUE X K. Immersion and invariance based attitude adaptive tracking control for spacecraft[J]. Acta Aeronautica et Astronautica Sinica, 2020, 41(2):323428(in Chinese).
[6] WANG Z, YUAN J J, CHE D J. Adaptive attitude takeover control for space non-cooperative targets with stochastic actuator faults[J]. Optik, 2017, 137:279-290.
[7] 殷泽阳, 罗建军, 魏才盛, 等. 非合作航天器姿态接管无辨识预设性能控制[J]. 航空学报, 2018, 39(11):322011. YIN Z Y, LUO J J, WEI C S, et al. Estimation-free and prescribed performance control of attitude takeover for non-cooperative spacecraft[J]. Acta Aeronautica et Astronautica Sinica, 2018, 39(11):322011(in Chinese).
[8] HU Q L, LI B, ZHANG A H. Robust finite-time control allocation in spacecraft attitude stabilization under actuator misalignment[J]. Nonlinear Dynamics, 2013, 73(1-2):53-71.
[9] CHANG H T, HUANG P F, ZHANG Y Z, et al. Distributed control allocation for spacecraft attitude takeover control via cellular space robot[J]. Journal of Guidance, Control, and Dynamics, 2018, 41(11):2495-2502.
[10] 王雨琪, 宁国栋, 王晓峰, 等. 基于微分对策的临近空间飞行器机动突防策略[J]. 航空学报, 2019, 40(S2):324276. WANG Y Q, NING G D, WANG X F, et al. Maneuver penetration strategy of near space vehicle based on differential game[J]. Acta Aeronautica et Astronautica Sinica, 2019, 40(S2):324276(in Chinese).
[11] VAMVOUDAKIS K G, LEWIS F L. Multi-player non-zero-sum games:online adaptive learning solution of coupled Hamilton-Jacobi equations[J]. Automatica, 2011, 47(8):1556-1569.
[12] 韩楠, 罗建军, 柴源. 多颗微小卫星接管失效航天器姿态运动的微分博弈学习控制[J]. 中国科学:信息科学, 2020, 50(4):588-602. HAN N, LUO J J, CHAI Y. Differential game learning approach for multiple microsatellites takeover of the attitude movement of failed spacecraft[J]. Scientia Sinica Informationis, 2020, 50(4):588-602(in Chinese).
[13] 柴源, 罗建军, 韩楠. 失效航天器姿态接管的SDRE微分博弈控制[J]. 宇航学报, 2020, 41(2):191-198. CHAI Y, LUO J J, HAN N. Attitude takeover control of failed spacecraft using SDRE based differential game approach[J]. 2020, 41(2):191-198(in Chinese).
[14] 罗建军, 韩楠, 柴源. 基于微小卫星合作博弈的失效航天器姿态接管控制[J]. 飞控与探测, 2019, 2(3):1-9. LUO J J, HAN N, CHAI Y. Taking over attitude control of failed spacecraft through cooperative game among multiple microsatellite[J]. Flight Control & Detection, 2019, 2(3):1-9(in Chinese).
[15] SHUSTER M D. A survey of attitude representations[J]. Journal of the Astronautical Sciences, 1993, 41(4):439-517.
[16] ABU-KHALAF M, LEWIS F L. Nearly optimal control laws for nonlinear systems with saturating actuators using a neural network HJB approach[J]. Automatica, 2005, 41(5):779-791.
[17] BEARD R W, SARIDIS G N, WEN J T. Galerkin approximations of the generalized Hamilton-Jacobi-Bellman equation[J]. Automatica, 1997, 33(12):2159-2177.
[18] FARINA M, AMATO P. On the optimal solution definition for many-criteria optimization problems[C]//2002 Annual Meeting of the North American Fuzzy Information Processing Society Proceedings, 2002:233-238.
[19] LIU D R, YANG X, WANG D, et al. Reinforcement-learning-based robust controller design for continuous-time uncertain nonlinear systems subject to input constraints[J]. IEEE Transactions on Cybernetics, 2015, 45(7):1372-1385.
[20] CHOWDHARY G, JOHNSON E. Concurrent learning for convergence in adaptive control without persistency of excitation[C]//49th IEEE Conference on Decision and Control, Atlanta. Piscataway:IEEE Press, 2010:3674-3679.

E-mail：hkxb@buaa.edu.cn

关于我们

期刊社服务

专业学科

封面文章

友情链接

主管单位：中国科学技术协会主办单位：中国航空学会北京航空航天大学

失效卫星姿态接管的并行学习合作博弈控制

Concurrent learning cooperative game control for attitude takeover of failed satellites

RichHTML

PDF (PC)

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 12

编辑推荐

Metrics

本文评价

[1]	任乐亮, 鲜勇, 李少朋, 雷刚, 伍薇, 李冰. 基于改进二阶优化器并行学习的弹道导弹神经网络落点预测方法[J]. 航空学报, 2023, 44(14): 327964-327964.
[2]	柴源, 罗建军, 王明明. 脉冲推力下多星协同搬运的预测博弈控制[J]. 航空学报, 2022, 43(12): 326112-326112.
[3]	靳标, 邝晓飞, 彭宇, 张贞凯. 基于合作博弈的组网雷达分布式功率分配方法[J]. 航空学报, 2022, 43(1): 324776-324776.
[4]	唐清君, 陈厚磊, 梁惊涛, 蔡京辉. 空间微小脉冲管制冷机研制[J]. 航空学报, 2018, 39(S1): 722321-722321.
[5]	常海涛, 黄攀峰, 王明, 孟中杰. 空间细胞机器人接管控制的分布式控制分配[J]. 航空学报, 2016, 37(9): 2864-2873.
[6]	王明, 黄攀峰, 孟中杰, 常海涛. 空间机器人抓捕目标后姿态接管控制[J]. 航空学报, 2015, 36(9): 3165-3175.
[7]	付健, 岑继文, 徐进良, 黄元东, 赖喜锐. 微推进系统中微型喷嘴结构参数的实验研究[J]. 航空学报, 2011, 32(4): 608-616.
[8]	苏抗, 周建江. 微小卫星低可观测外形飞行姿态规划[J]. 航空学报, 2011, 32(4): 720-728.
[9]	苏抗;周建江. 有限姿控能力的低RCS微小卫星姿态实时规划[J]. 航空学报, 2010, 31(9): 1841-1848.
[10]	岑继文;徐进良. 一种微推力测量的简化处理方法[J]. 航空学报, 2008, 29(2): 297-303.
[11]	郁丰;刘建业;熊智. 微小卫星剩磁在轨标定技术研究[J]. 航空学报, 2007, 28(5): 1142-1145.
[12]	段方;刘建业;李丹. 微小卫星太阳敏感器/磁强计实时标定算法研究[J]. 航空学报, 2007, 28(1): 173-176.