Learning near‐optimal broadcasting intervals in decentralized multi‐agent systems using online least‐square policy iteration

Autor: Ivana Palunko, Domagoj Tolić, Vicko Prkačin
Jazyk: angličtina
Rok vydání: 2021
Předmět:
Zdroj: IET Control Theory & Applications, Vol 15, Iss 8, Pp 1054-1067 (2021)
Druh dokumentu: article
ISSN: 1751-8652
1751-8644
DOI: 10.1049/cth2.12102
Popis: Abstract Here, agents learn how often to exchange information with neighbours in cooperative multi‐agent systems (MASs) such that their linear quadratic regulator (LQR)‐like performance indices are minimized. The investigated LQR‐like cost functions capture trade‐offs between the energy consumption of each agent and MAS local control performance in the presence of exogenous disturbances, delayed and noisy data. Agent energy consumption is critical for prolonging the MAS mission and is composed of both control (e.g. acceleration, velocity) and communication efforts. Taking provably stabilizing upper bounds on broadcasting intervals as optimization constraints, an online off‐policy model‐free learning algorithm based on least square policy iteration (LSPI) to minimize the cost function of each agent is employed. Consequently, the obtained broadcasting intervals adapt to the most recent information (e.g. delayed and noisy agents' inputs and/or outputs) received from neighbours whilst provably stabilize the MAS. Chebyshev polynomials are utilized as the approximator in the LSPI whereas Kalman filtering handles sampled, corrupted, and delayed data. Subsequently, convergence and near‐optimality of our LSPI scheme are inspected. The proposed methodology is verified experimentally using an inexpensive motion capture system and nano quadrotors.
Databáze: Directory of Open Access Journals
Externí odkaz: