未来智能空战发展综述

doi:10.7527/S1000-6893.2021.25799

Abstract

Abstract: The development trend of future fighter jets has been evolving into mechanization, informationization and intelligence. Thus, essential revolution may be induced by the new application form of future fighter jets. Challenges of high complexity and opposability of the combat environment, real-time responses and incompleteness of the battle information are faced in such circumstances. The crossover of Artificial Intelligence (AI) and air combat might potentially dominate the next generation of air operation. This paper comprehensively sorts out the development history of modern air combat AI, and summarizes its theoretical foundations of represented by combat maneuvering logic, automatic confrontation-rule generation and evolution, and machine learning. The development trend of air combat AI is analyzed in terms of system, application, and technique. Several issues centered around the uncertainty, safety, interpretability, transfer ability, and coordination of air combat AI are elaborated. Moreover, an analysis of future air combat AI outlines a new path and provides inspiration for cross-field research of AI and aviation science and technology.

Key words: air combat, Artificial Intelligence (AI), evolutionary computation, game, reinforcement learning

CLC Number:

V271

SUN Zhixiao, YANG Shengqi, PIAO Haiyin, BAI Chengchao, GE Jun. A survey of air combat artificial intelligence[J]. ACTA AERONAUTICAET ASTRONAUTICA SINICA, 2021, 42(8): 525799-525799.

References

[1] BURGIN G H, OWENS A J. An adaptive maneuvering logic computer program for the simulation of one-on-one air-to-air combat:NASA CR-2582, CR-2583[R]. Washington, D.C.:NASA, 1975:Vol I and II.
[2] BURGIN G. Improvements to the adaptive maneuvering logic program:NASA CR 3985[R]. Washington, D.C.:NASA, 1986.
[3] GOODRICH K, MCMANUS J. Development of a tactical guidance research and evaluation system (TGRES)[C]//Flight Simulation Technologies Conference and Exhibit. Reston:AIAA, 1989
[4] MCMANUS J, GOODRICH K. Application of artificial intelligence (AI) programming techniques to tactical guidance for fighter aircraft[C]//Guidance, Navigation and Control Conference. Reston:AIAA, 1989
[5] GOODRICH K H. A high-fidelity, six-degree-of-freedom batch simulation environment for tactical guidance research and evaluation[EB/OL]. Hampton:National Aeronautics and Space Administration, 1993. (2010-05-06)[2021-03-10]. https://www.cs.odu.edu/~mln/ltrs-pdfs/tm4440.pdf.
[6] ERNEST N, CARROLL D. Genetic fuzzy based artificial intelligence for unmanned combat aerial vehicle control in simulated air combat missions[J]. Journal of Defense Management, 2016, 6(1):1-8
[7] SMITH R E, DIKE B A, MEHRA R K, et al. Classifier systems in combat:two-sided learning of maneuvers for advanced fighter aircraft[J]. Computer Methods in Applied Mechanics and Engineering, 2000, 186(2-4):421-437.
[8] CLIVE P D, JOHNSON J A, MOSS M J, et al. Advanced framework for simulation, integration and modeling (AFSIM) (Case Number:88ABW-2015-2258)[C]//Proceedings of the International Conference on Scientific Computing (CSC),2015.
[9] MCGREW J S. Real-time maneuvering decisions for autonomous air combat[D]. Cambridge:Massachusetts Institute of Technology, 2008:91-104.
[10] 薛羽, 庄毅, 张友益, 等. 基于启发式自适应离散差分进化算法的多UCAV协同干扰空战决策[J]. 航空学报, 2013, 34(2):343-351. XUE Y, ZHUANG Y, ZHANG Y Y, et al. Multiple UCAV cooperative jamming air combat decision making based on heuristic self-adaptive discrete differential evolution algorithm[J]. Acta Aeronautica et Astronautica Sinica, 2013, 34(2):343-351(in Chinese).
[11] ABBEEL P, COATES A, QUIGLEY M, et al. An application of reinforcement learning to aerobatic helicopter flight[C]//SCHÖLKOPF B, PLATT J, HOFMANN T. Advances in Neural Information Processing Systems 19:Proceedings of the 2006 Conference, 2007:1-8.
[12] Defense Advanced Research Projects Agency. AlphaDogfight trials go virtual for final event[EB/OL]. (2020-08-07)[2021-03-10]. https://www.darpa.mil/news-events/2020-08-07.
[13] THERESA H. DARPA's AlphaDogfight tests AI pilot's combat chops[EB/OL]. (2020-08-18)[2021-03-10]. https://breakingdefense.com/2020/08/darpas-alphadogfight-tests-ai-pilots-combat-chops/.
[14] Air Force Research Lab. Skyborg program seeks industry input for artificial intelligence initiative[EB/OL]. (2019-05-26)[2021-03-10]. https://afresearchlab.com/news/skyborg-program-seeks-industry-input-for-artificial-intelligence-initiative-2/.
[15] US Department of Defense. Summary of the 2018 Department of Defense artificial intelligence strategy[EB/OL]. (2018-11-08)[2021-03-10]. http://www.defense-aerospace.com/articles-view/reports/2/199929/pentagon-releases-artificial-intelligence-strategy.html.
[16] The Networking and Information Technology Research and Development (NITRD) Program. The national artificial intelligence research and development strategic plan:2019 update[EB/OL]. (2019-07-21)[2021-03-10]. https://www.nitrd.gov/news/National-AI-RD-Strategy-2019.aspx.
[17] MYERSON R B. Game theory[M]. London:Harvard University Press, 2013:1.
[18] XU G Y, LIU Q, ZHANG H. The application of situation function in differential game problem of the air combat[C]//2018 Chinese Automation Congress (CAC). Piscataway:IEEE Press, 2018:1190-1195.
[19] VIRTANEN K, KARELAHTI J, RAIVIO T. Modeling air combat by a moving horizon influence diagram game[J]. Journal of Guidance, Control, and Dynamics, 2006, 29(5):1080-1091.
[20] WEINTRAUB I E, PACHTER M, GARCIA E. An introduction to pursuit-evasion differential games[C]//2020 American Control Conference (ACC). Piscataway:IEEE Press, 2020:1049-1066.
[21] PARK H, LEE B Y, TAHK M J, et al. Differential game based air combat maneuver generation using scoring function matrix[J]. International Journal of Aeronautical and Space Sciences, 2016, 17(2):204-213.
[22] ALKAHER D, MOSHAIOV A. Dynamic-escape-zone to avoid energy-bleeding coasting missile[J]. Journal of Guidance, Control, and Dynamics, 2015, 38(10):1908-1921.
[23] ZHENG H Y, DENG Y, HU Y. Fuzzy evidential influence diagram and its evaluation algorithm[J]. Knowledge-Based Systems, 2017, 131:28-45.
[24] SHACHTER R D. Evaluating influence diagrams[J]. Operations Research, 1986, 34(6):871-882.
[25] KOLLER D, MILCH B. Multi-agent influence diagrams for representing and solving games[C]//Proceedings of the 17th International Joint Conference of Artificial Intelligence,2001:319-328.
[26] KOLLER D, MILCH B. Multi-agent influence diagrams for representing and solving games[J]. Games and Economic Behavior, 2003, 45(1):181-221.
[27] VIRTANEN K, RAIVIO T, HAMALAINEN R P. Modeling pilot's sequential maneuvering decisions by a multistage influence diagram[J]. Journal of Guidance, Control, and Dynamics, 2004, 27(4):665-677.
[28] PAN Q, ZHOU D Y, HUANG J C, et al. Maneuver decision for cooperative close-range air combat based on state predicted influence diagram[C]//2017 IEEE International Conference on Information and Automation (ICIA). Piscataway:IEEE Press, 2017:726-731.
[29] HUANG C Q, DONG K S, HUANG H Q, et al. Autonomous air combat maneuver decision using Bayesian inference and moving horizon optimization[J]. Journal of Systems Engineering and Electronics, 2018, 29(1):86-97.
[30] SPRINKLE J, EKLUND J M, KIM H J, et al. Encoding aerial pursuit/evasion games with fixed wing aircraft into a nonlinear model predictive tracking controller[C]//2004 43rd IEEE Conference on Decision and Control (CDC) (IEEE Cat. No.04CH37601). Piscataway:IEEE Press, 2004:2609-2614.
[31] 张菁, 何友, 彭应宁, 等. 基于神经网络和人工势场的协同博弈路径规划[J]. 航空学报, 2019, 40(3):322493. ZHANG J, HE Y, PENG Y N, et al. Neural network and artificial potential field based cooperative and adversarial path planning[J]. Acta Aeronautica et Astronautica Sinica, 2019, 40(3):322493(in Chinese).
[32] KANESHIGE J, KRISHNAKUMAR K. Artificial immune system approach for air combat maneuvering[C]//Proceeding of the SPIE, 2007.
[33] JI H M, YU M J, HAN Q S, et al. Research on the air combat countermeasure generation based on improved TIMS model[J]. Journal of Physics:Conference Series, 2018, 1069:012039.
[34] 国海峰, 侯满义, 张庆杰, 等. 基于统计学原理的无人作战飞机鲁棒机动决策[J]. 兵工学报, 2017, 38(1):160-167. GUO H F, HOU M Y, ZHANG Q J, et al. UCAV robust maneuver decision based on statistics principle[J]. Acta Armamentarii, 2017, 38(1):160-167(in Chinese).
[35] WANG Y, HUANG C Q, TANG C L. Research on unmanned combat aerial vehicle robust maneuvering decision under incomplete target information[J]. Advances in Mechanical Engineering, 2016, 8(10):168781401667438.
[36] YANG Q M, ZHANG J D, SHI G Q, et al. Maneuver decision of UAV in short-range air combat based on deep reinforcement learning[J]. IEEE Access, 2019, 8:363-378.
[37] 傅莉, 谢福怀, 孟光磊, 等. 基于滚动时域的无人机空战决策专家系统[J]. 北京航空航天大学学报, 2015, 41(11):1994-1999. FU L, XIE F H, MENG G L, et al. An UAV air-combat decision expert system based on receding horizon control[J]. Journal of Beijing University of Aeronautics and Astronautics, 2015, 41(11):1994-1999(in Chinese).
[38] 王锐平, 高正红. 无人机空战仿真中基于机动动作库的决策模型[J]. 飞行力学, 2009, 27(6):72-75, 79. WANG R P, GAO Z H. Research on decision system in air combat simulation using maneuver library[J]. Flight Dynamics, 2009, 27(6):72-75, 79(in Chinese).
[39] BURGIN G H, SIDOR L B. Rule-based air combat simulation[EB/OL]. La Jolla:National Aeronautics and Space Administration, 1988. (2009-06-05)[2021-03-10]. https://apps.dtic.mil/sti/pdfs/ADA257194.pdf.
[40] BERCHTOLD S, BÖHM C, KRIEGAL H P. The pyramid-technique:towards breaking the curse of dimensionality[C]//Proceedings of the 1998 ACM SIGMOD International Conference on Management of data-SIGMOD '98. New York:ACM Press, 1998:142-153.
[41] GENG W X, KONG F E, MA D Q. Study on tactical decision of UAV medium-range air combat[C]//The 26th Chinese Control and Decision Conference (2014 CCDC). Piscataway:IEEE Press, 2014:135-139.
[42] CUBUK E D, ZOPH B, MANE D, et al. AutoAugment:learning augmentation policies from data[DB/OL]. arXiv preprint:1805.09501, 2019.
[43] ALIKANIOTIS D, YANNAKOUDAKIS H, REI M. Automatic text scoring using neural networks[C]//Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1:Long Papers), 2016.
[44] JEONG C S, LEE J Y, JUNG K D. Adaptive recommendation system for tourism by personality type using deep learning[J]. International Journal of Internet, Broadcasting and Communication, 2020,12(1):55-60.
[45] BAIN M. A framework for behavioral cloning[J]. Machine Intelligence, 1996, 15:103-129.
[46] RODIN E Y, MASSOUD AMIN S. Maneuver prediction in air combat via artificial neural networks[J]. Computers & Mathematics With Applications, 1992, 24(3):95-112.
[47] SCHVANEVELDT R W, BENSON A E, GOLDSMLTH T E. Neural network models of air combat maneuvering:AD-A254653[R]. Texas:Williams Air Force Base, 1992.
[48] TENG T H, TAN A H, TAN Y S, et al. Self-organizing neural networks for learning air combat maneuvers[C]//The 2012 International Joint Conference on Neural Networks (IJCNN). Piscataway:IEEE Press, 2012:1-8.
[49] SILVER D, HUANG A, MADDISON C J, et al. Mastering the game of Go with deep neural networks and tree search[J]. Nature, 2016, 529(7587):484-489.
[50] VINYALS O, BABUSCHKIN I, CZARNECKI W M, et al. Grandmaster level in StarCraft II using multi-agent reinforcement learning[J]. Nature, 2019, 575(7782):350-354.
[51] BOTVINICK M, WANG J X, DABNEY W, et al. Deep reinforcement learning and its neuroscientific implications[J]. Neuron, 2020, 107(4):603-616.
[52] NGUYEN N D, NGUYEN T, NAHAVANDI S. System design perspective for human-level agents using deep reinforcement learning:a survey[J]. IEEE Access, 2017, 5:27091-27102.
[53] MNIH V, KAVUKCUOGLU K, SILVER D, et al. Human-level control through deep reinforcement learning[J]. Nature, 2015, 518(7540):529-533.
[54] 丁林静, 杨啟明. 基于强化学习的无人机空战机动决策[J]. 航空电子技术, 2018, 49(2):29-35. DING L J, YANG Q M. Research on air combat maneuver decision of UAVs based on reinforcement learning[J]. Avionics Technology, 2018, 49(2):29-35(in Chinese).
[55] LIU P, MA Y F. A deep reinforcement learning based intelligent decision method for UCAV air combat[M]//Communications in Computer and Information Science. Singapore:Springer Singapore, 2017:274-286.
[56] 左家亮, 杨任农, 张滢, 等. 基于启发式强化学习的空战机动智能决策[J]. 航空学报, 2017, 38(10):321168. ZUO J L, YANG R N, ZHANG Y, et al. Intelligent decision-making in air combat maneuvering based on heuristic reinforcement learning[J]. Acta Aeronautica et Astronautica Sinica, 2017, 38(10):321168(in Chinese).
[57] ZHANG X B, LIU G Q, YANG C J, et al. Research on air combat maneuver decision-making method based on reinforcement learning[J]. Electronics, 2018, 7(11):279.
[58] PIAO H. Beyond-visual-range air combat tactics auto-generation by reinforcement learning[C]//International Joint Conference on Neural Networks (IJCNN). Piscataway:IEEE Press, 2020.
[59] HEUILLET A, COUTHOUIS F, DÍAZ-RODRÍGUEZ N. Explainability in deep reinforcement learning[J]. Knowledge-Based Systems, 2021, 214:106685.
[60] MONTAVON G, SAMEK W, MVLLER K R. Methods for interpreting and understanding deep neural networks[J]. Digital Signal Processing, 2018, 73:1-15.
[61] YUAN W H, HANG K Y, KRAGIC D, et al. End-to-end nonprehensile rearrangement with deep reinforcement learning and simulation-to-reality transfer[J]. Robotics and Autonomous Systems, 2019, 119:119-134.
[62] BROWN N, SANDHOLM T. Superhuman AI for multiplayer poker[J]. Science, 2019, 365(6456):885-890.
[63] HERNANDEZ-LEAL P, KARTAL B, TAYLOR M E. A survey and critique of multiagent deep reinforcement learning[J]. Autonomous Agents and Multi-Agent Systems, 2019, 33(6):750-797.
[64] SILVA F L D, COSTA A H R. A survey on transfer learning for multiagent reinforcement learning systems[J]. Journal of Artificial Intelligence Research, 2019, 64:645-703.
[65] BROWN N, SANDHOLM T. Solving imperfect-information games via discounted regret minimization[C]//Proceedings of the AAAI Conference on Artificial Intelligence, 2019, 33:1829-1836.
[66] SCHOFIELD M, THIELSCHER M. General game playing with imperfect information[J]. Journal of Artificial Intelligence Research, 2019, 66:901-935.
[67] DOSHI-VELEZ F, KIM B. Towards A rigorous science of interpretable machine learning[DB/OL]. arXiv preprint:1702.08608, 2017.
[68] LIPTON Z C. The mythos of model interpretability:In machine learning, the concept of interpretability is both important and slippery[J]. Queue, 2018,16(3):31-57.
[69] ZHANG X, SOLAR-LEZAMA A, SINGH R. Interpreting neural network judgments via minimal, stable, and symbolic corrections[C]//Proceedings of the 32nd International Conference on Neural Information Processing Systems, 2018:4879-4890.
[70] RUSU A A, VECERIK M, ROTHÖRL T, et al. Sim-to-real robot learning from pixels with progressive nets[DB/OL]. arXiv preprint:1610.04286, 2018.
[71] 孙长银, 穆朝絮. 多智能体深度强化学习的若干关键科学问题[J]. 自动化学报, 2020, 46(7):1301-1312. SUN C Y, MU C X. Important scientific problems of multi-agent deep reinforcement learning[J]. Acta Automatica Sinica, 2020, 46(7):1301-1312(in Chinese).
[72] LOWE R, WU Y, TAMAR A, et al. Multi-agent actor-critic for mixed cooperative-competitive environments[C]//Proceedings of the 31 st International Conference on Neural Information Processing Systems, 2017:6382-6393.
[73] 杨伟. 关于未来战斗机发展的若干讨论[J]. 航空学报, 2020, 41(6):524377. YANG W. Development of future fighters[J]. Acta Aeronautica et Astronautica Sinica, 2020, 41(6):524377(in Chinese).

A survey of air combat artificial intelligence

RichHTML

PDF (PC)

Knowledge

Abstract

Cite this article

share this article

References

Related Articles 15

Recommended Articles

Metrics

Comments

[1]	LIU Lei, LIU Dawei, WANG Xiaoguang, CHEN Junnan, LIU Dongxing. Development status and outlook of UAV clusters and anti-UAV clusters [J]. ACTA AERONAUTICAET ASTRONAUTICA SINICA, 2022, 43(S1): 726908-726908.
[2]	HU Yanyan, ZHANG Li, XIA Hui, ZHANG Naiwen, YAN Rongyi. Cooperative capture of maneuvering targets with incomplete information based on differential game [J]. ACTA AERONAUTICAET ASTRONAUTICA SINICA, 2022, 43(S1): 726905-726905.
[3]	HUI Junpeng, WANG Ren, YU Qidong. Generating new quality flight corridor for reentry aircraft based on reinforcement learning [J]. ACTA AERONAUTICAET ASTRONAUTICA SINICA, 2022, 43(9): 325960-325960.
[4]	WANG Xin, YAN Jie, MENG Tingwei. High-speed target multi-stage interception scheme based on game theory [J]. ACTA AERONAUTICAET ASTRONAUTICA SINICA, 2022, 43(9): 325598-325598.
[5]	LU Fangxu, MI Zhichao, MA Jun, LI Aijing, WANG Hai. Optimal 3D placement of multi-QoS UAV base station based on potential game for communications [J]. ACTA AERONAUTICAET ASTRONAUTICA SINICA, 2022, 43(9): 326137-326137.
[6]	FU Xiaowei, WANG Hui, XU Zhe. Cooperative pursuit strategy for multi-UAVs based on DE-MADDPG algorithm [J]. ACTA AERONAUTICAET ASTRONAUTICA SINICA, 2022, 43(5): 325311-325311.
[7]	CHAI Yuan, LUO Jianjun, WANG Mingming. Predictive game control for on-orbit transportation by multiple microsatellites with impulsive thrust [J]. ACTA AERONAUTICAET ASTRONAUTICA SINICA, 2022, 43(12): 326112-326112.
[8]	FAN Huitao, YAN Jun. Evolution and development trend of air combat system [J]. ACTA AERONAUTICAET ASTRONAUTICA SINICA, 2022, 43(10): 527397-527397.
[9]	JIN Biao, KUANG Xiaofei, PENG Yu, ZHANG Zhenkai. Distributed power allocation method for netted radar based on cooperative game theory [J]. ACTA AERONAUTICAET ASTRONAUTICA SINICA, 2022, 43(1): 324776-324776.
[10]	SUN Cong. Development trend of future fighter: A review of evolution of winning mechanism in air combat [J]. ACTA AERONAUTICAET ASTRONAUTICA SINICA, 2021, 42(8): 525826-525826.
[11]	LUO Qing, ZHANG Tao, SHAN Peng, ZHANG Wentao, LIU Zihao. Generating reconfiguration blueprints for IMA systems based on improved Q-learning [J]. ACTA AERONAUTICAET ASTRONAUTICA SINICA, 2021, 42(8): 525792-525792.
[12]	REN Feng, GAO Chuanqiang, TANG Hui. Machine learning for flow control: Applications and development trends [J]. ACTA AERONAUTICAET ASTRONAUTICA SINICA, 2021, 42(4): 524686-524686.
[13]	NI Yuan, YANG Hao, JIANG Bin. Fault tolerant game control of swarm confrontation with decision faults [J]. ACTA AERONAUTICAET ASTRONAUTICA SINICA, 2021, 42(4): 524978-524978.
[14]	ZHANG Weiwei, KOU Jiaqing, LIU Yilang. Prospect of artificial intelligence empowered fluid mechanics [J]. ACTA AERONAUTICAET ASTRONAUTICA SINICA, 2021, 42(4): 524689-524689.
[15]	LI Runze, ZHANG Yufei, CHEN Haixin. Reinforcement learning method for supercritical airfoil aerodynamic design [J]. ACTA AERONAUTICAET ASTRONAUTICA SINICA, 2021, 42(4): 523810-523810.