为解决目前面向林火持续侦察多无人机（UAV）协同控制实用性与自主性不足的问题，基于蔓延速度诱导元胞自动机（SVICA）林火蔓延算法、无人机与传感器建模，构建了较为真实的三维多无人机火场侦察仿真环境与侦察效能指标，提出了一种面向林火持续侦察的多无人机双层分布式控制架构，在行动层基于强化学习训练的人工神经网络（ANN），实现了有风条件下无人机自主火场环绕与地形跟随功能，在策略层设计通过时域均匀分布算法进行各无人机空速的离散自主调节，最终达到多无人机林火持续侦察时域分布的均匀性与即时性目的。通过一系列数值仿真实验，验证了所提出的无人机分布控制策略在无人机损失和补充突发情况下的自适应性。基于无人机数量与侦察效能指标关系的实验与研究，定义了无人机出动阈值并验证了无人机长时间出动回收策略。最终实验结果表明，针对林火持续侦察任务，所提出的多无人机分布式控制方法具备一定的有效性与实用性。
In order to improve the practicality and autonomy in multiple UAV collaborative control for persistent wildfire surveillance, based on the Spread Vector Induced Celluar Automata (SVICA) fire spread algorithm, UAV kinematic, and sensor modeling, a more realistic three-dimension simulation environment for multiple UAV fire surveillance and the surveillance effectiveness indicators are constructed. A two-layer distributed control architecture for multiple UAV is proposed. Based on the reinforcement learning trained Artificial Neural Networks (ANN), the operational layer control realized the autonomous wildfire surrounding and terrain following under windy conditions. In the tactical layer, through the temporal even-distribution algorithm, the discrete airspeed adjustment of each UAV is performed to achieve the uniformity and immediacy of temporal distribution of UAVs in persistent wildfire surveillance. Then through a series of numerical experiments, the adaptability of the proposed distribution control method is verified under sudden UAV loss and supplement during the surveillance. In addition, based on the research on the relationship between the number of UAVs and the surveillance effectiveness, the UAV dispatch threshold is defined and enduring UAV dispatch and recycling strategy is examined. The final simulation results show that the proposed multiple UAV distributed control algorithm is effective and practical for persistent surveillance of wildfire.
[1] TAO S, ZHANG L, CHEN W, et al. Mountains forest fire spread simulator based on geo-cellular automaton combined with Wang Zhengfei velocity model[J]. IEEE Journal of Selected Topics in Applied Earth Observations & Remote Sensing, 2013, 6(4):1971-1987.
[2] PHAM H X, LA H M, FEIL-SEIFER D, et al. A distributed control framework for a team of unmanned aerial vehicles for dynamic wildfire tracking[C]//2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). Piscataway, NJ:IEEE Press, 2017:6648-6653.
[3] CASBEER D W, KINGSTON D B, BEARD R W, et al. Cooperative forest fire surveillance using a team of small unmanned air vehicles[J]. International Journal of Systems Science, 2006, 37(6):351-360.
[4] GHAMRY K A, ZHANG Y. Cooperative control of multiple UAVs for forest fire monitoring and detection[C]//2016 12th IEEE/ASME International Conference on Mechatronic and Embedded Systems and Applications (MESA). Piscataway, NJ:IEEE Press, 2016:1-6.
[5] YUAN C, ZHANG Y, LIU Z. A survey on technologies for automatic forest fire monitoring, detection, and fighting using unmanned aerial vehicles and remote sensing techniques[J]. Canadian Journal of Forest Research, 2015, 45(7):783-792.
[6] SUJIT P B, KINGSTON D, BEARD R. Cooperative forest fire monitoring using multiple UAVs[C]//2007 46th IEEE Conference on Decision and Control. Piscataway, NJ:IEEE Press, 2007:4875-4880.
[7] AMBROSIA V G, ZAJKOWSKI T. Selection of appropriate class UAS/sensors to support fire monitoring:Experiences in the United States[J]. Handbook of Unmanned Aerial Vehicles, 2015:2723-2754.
[8] AKHLOUFI M A, CASTRO N A, COUTURIER A. UAVs for wildland fires[C]//Autonomous Systems:Sensors, Vehicles, Security, and the Internet of Everything, 2018.
[9] MARTÍNEZ-DE-DIOS J R, MERINO L, OLLERO A, et al. Multiple heterogeneous unmanned aerial vehicles[M]. Berlin:Springer, 2007:207-228.
[10] MERINO L, CABALLERO F, MARTÍNEZ-DE-DIOS J R, et al. Automatic forest fire monitoring and measurement using unmanned aerial vehicles[C]//Proceedings of the 6th International Congress on Forest Fire Research, 2010.
[11] MERINO L, CABALLERO F, MARTÍNEZ-DE-DIOS J R, et al. An unmanned aircraft system for automatic forest fire monitoring and measurement[J]. Journal of Intelligent & Robotic Systems, 2012, 65(1-4):533-548.
[12] MERINO L, MARTÍNEZ-DE DIOS J R, OLLERO A. Cooperative unmanned aerial systems for fire detection, monitoring, and extinguishing[M]//Handbook of Unmanned Aerial Vehicles. Dordrecht:Springer, 2015:2693-2722.
[13] AMBROSIA V G, ZAJKOWSKI T. Selection of appropriate class UAS/sensors to support fire monitoring:experiences in the United States[M]//Handbook of Unmanned Aerial Vehicles. Dordrecht:Springer, 2015:2723-2754.
[14] ALEXIS K, NIKOLAKOPOULOS G, TZES A, et al. Applications of intelligent control to engineering systems[M]. Dordrecht:Springer, 2009, 169-193.
[15] KUMAR M, COHEN K, HOMCHAUDHURI B. Cooperative control of multiple uninhabited aerial vehicles for monitoring and fighting wildfires[J]. Journal of Aerospace Computing, Information, and Communication, 2011, 8(1):1-16.
[16] 王祝,刘莉,龙腾,等. 基于罚函数序列凸规划的多无人机轨迹规划[J]. 航空学报, 2016, 37(10):3149-3158. WANG Z, LIU L, LONG T, et al. Trajectory planning for multi-UAVs using penalty sequential convex programming[J]. Acta Aeronautica et Astronautica Sinica, 2016, 37(10):3149-3158(in Chinese).
[17] YAO P, WANG H, SU Z. Cooperative path planning with applications to target tracking and obstacle avoidance for multi-UAVs[J]. Aerospace Science and Technology, 2016, 54:10-22.
[18] SULLIVAN A L. Wildland surface fire spread modelling, 1990-2007.3:Simulation and mathematical analogue models[J]. International Journal of Wildland Fire, 2009, 18(4):387-403.
[19] LIU Y, LIU H, ZHOU Y, et al. Spread vector induced cellular automata model for real-time crown fire behavior simulation[J]. Environmental Modelling & Software, 2018, 108:14-39.
[20] MARTÍNEZ-DE DIOS J, MERINO L, CABALLERO F, et al. Automatic forest-fire measuring using ground stations and unmanned aerial systems[J]. Sensors, 2011, 11(6):6328-6353.
[21] RAMACHANDRAN P, ZOPH B, LE Q V. Searching for activation functions[EB/OL]. (2017-10-27)[2019-08-06]. https://arxiv.org/abs/1710.05941.
[22] SCHULMAN J, WOLSKI F, DHARIWAL P, et al. Proximal policy optimization algorithms[EB/OL]. (2017-08-28)[2019-08-06]. https://arxiv.org/abs/1707.06347.
[23] LUGO-CARDENAS I, FLORES G, SALAZAR S, et al. Dubins path generation for a fixed wing UAV[C]//2014 International conference on unmanned aircraft systems (ICUAS). Piscataway, NJ:IEEE Press, 2014:339-346.
[24] Unity Technologies. Unity[EB/OL].[2019-08-06]. http://unity3d.com.
[25] JULIANI A, BERGES V, VCKAY E, et al. Unity:A general platform for intelligent agents[EB/OL]. (2018-09-07)[2019-08-06]. https://arxiv.org/abs/1809.02627.
CJA