Multi-agent Reinforcement Learning for Autonomous Vehicles in Wireless Sensor Networks

Autor: Haitham Afifi
Rok vydání: 2021
Předmět:
Popis: We develop a Deep Reinforcement Learning (DeepRL) based multi-agent algorithm to efficiently controlautonomous vehicles in the context of Wireless Sensor Networks (WSNs). In contrast to other applications, WSNshave two metrics for performance evaluation. First, quality of information (QoI) which is used to measure thequality of sensed data. Second, quality of service (QoS) which is used to measure the network’s performance. Asa use case, we consider wireless acoustic sensor networks; a group of speakers move inside a room and thereare microphones installed on vehicles for streaming the audio data. We formulate an appropriate Markov DecisionProcess (MDP) and present, besides a centralized solution, a multi-agent Deep Q-learning solution to control the vehicles. We compare the proposed solutions to a naive heuristic and two different real-world implementations: microphones being hold or preinstalled. We show using simulations that the performance of autonomous vehicles in terms of QoI and QoS is better than the real-world implementation and the proposed heuristic. Additionally, we provide theoretical analysis of the performance with respect to WSNs dynamics, such as speed, rooms dimensions and speaker’s talking time.
Databáze: OpenAIRE