Research on air combat decision algorithm based on proximal policy optimization

Autor: ZHANG Bochao, WEN Xiaoling, LIU Lu, ZHANG Yaqian, WANG Hongguang
Jazyk: čínština
Rok vydání: 2023
Předmět:
Zdroj: Hangkong gongcheng jinzhan, Vol 14, Iss 2, Pp 145-151 (2023)
Druh dokumentu: article
ISSN: 1674-8190
DOI: 10.16615/j.cnki.1674-8190.2023.02.17
Popis: Facing the future combat scenario with manned and unmanned aerial vehicle cooperation, real-time and accurate air combat decision-making is the basis of winning. The complex air environment, transient situation data, and multiple cumbersome combat tasks make coordinated combat with unmanned aerial vehicles a trend in future air combat, replacing single machine combat. However, multi-agent modeling and training processes face difficulties in reward allocation and network convergence. Air combat scenarios for 5v5 manned and unmanned aerial vehicle cooperation, the characteristic model of single agent is abstracted in this paper, and an algorithm based on proximal policy optimization is proposed to obtain the air combat decision sequence by using reward and punishment incentive in the real-time interaction with the environment. The simulation results show that the algorithm proposed in this paper can adapt to the complex battlefield situation and get a stable and reasonable decision-making strategy in continuous action space after training and learning.
Databáze: Directory of Open Access Journals