Approaches That Use Domain-Specific Expertise: Behavioral-Cloning-Based Advantage Actor-Critic in Basketball Games

Autor: Taehyeok Choi, Kyungeun Cho, Yunsick Sung
Jazyk: angličtina
Rok vydání: 2023
Předmět:
Zdroj: Mathematics, Vol 11, Iss 5, p 1110 (2023)
Druh dokumentu: article
ISSN: 2227-7390
DOI: 10.3390/math11051110
Popis: Research on the application of artificial intelligence (AI) in games has recently gained momentum. Most commercial games still use AI based on a finite state machine (FSM) due to complexity and cost considerations. However, FSM-based AI decreases user satisfaction given that it performs the same patterns of consecutive actions in the same situations. This necessitates a new AI approach that applies domain-specific expertise to existing reinforcement learning algorithms. We propose a behavioral-cloning-based advantage actor-critic (A2C) that improves learning performance by applying a behavioral cloning algorithm to an A2C algorithm in basketball games. The state normalization, reward function, and episode classification approaches are used with the behavioral-cloning-based A2C. The results of the comparative experiments with the traditional A2C algorithms validated the proposed method. Our proposed method using existing approaches solved the difficulty of learning in basketball games.
Databáze: Directory of Open Access Journals
Nepřihlášeným uživatelům se plný text nezobrazuje