The unmanned vehicle on-ramp merging model based on AM-MAPPO algorithm

Autor: Zhao Shixin, Pan Feng, Jiang Anni, Zhang Hao, Gao Qiuqi
Jazyk: angličtina
Rok vydání: 2024
Předmět:
Zdroj: Scientific Reports, Vol 14, Iss 1, Pp 1-11 (2024)
Druh dokumentu: article
ISSN: 2045-2322
DOI: 10.1038/s41598-024-70509-0
Popis: Abstract In response to the issues of low merging success rates and poor safety in the on-ramp merging scenario within autonomous driving, we propose an on-ramp merging model for unmanned vehicles based on the Multi-Agent Proximal Policy Optimization (MAPPO) algorithm. Firstly, we introduce an Action-Mask (AM) to prevent the sampling of invalid actions during merging, thus enhancing safety by ensuring only valid actions are considered. Secondly, we incorporate noise advantage values to encourage unmanned vehicles to thoroughly explore the environment and avoid being trapped in local optimal solutions. Experimental results demonstrate that the AM-MAPPO algorithm model improves both safety and traffic efficiency.
Databáze: Directory of Open Access Journals
Nepřihlášeným uživatelům se plný text nezobrazuje