Explainable Agents Adapt to Human Behaviour
| Autor: | Tormos, Adrian, Gimenez-Abalos, Victor, Domènech I Vila, Marc, Gnatyshak, Dmitry, Alvarez-Napagao, Sergio, Vázquez-Salceda, Javier |
|---|---|
| Přispěvatelé: | Universitat Politècnica de Catalunya. Doctorat en Intel·ligència Artificial, Universitat Politècnica de Catalunya. Departament de Ciències de la Computació, Barcelona Supercomputing Center, Universitat Politècnica de Catalunya. IDEAI-UPC - Intelligent Data sciEnce and Artificial Intelligence Research Group |
| Rok vydání: | 2023 |
| Předmět: |
Intelligent agents (Computer software)
Cooperative AI Agents intel·ligents (Programari) Machine learning Reinforcement learning Explainable AI Aprenentatge automàtic Aprenentatge per reforç Interactive reinforcement learning Multi-agent reinforcement learning Informàtica::Intel·ligència artificial::Agents intel·ligents [Àrees temàtiques de la UPC] |
| DOI: | 10.6084/m9.figshare.22821836.v1 |
| Popis: | When integrating artificial agents into physical or digital environments that are shared with humans, agents are often equipped with opaque Machine Learning methods to enable adapting their behaviour to dynamic human needs and environment. This brings about agents that are also opaque and therefore hard to explain. In previous work, we show that we can reduce an opaque agent into an explainable Policy Graph (PG) which works accurately in multi-agent environments. Policy Graphs are based on a discretisation of the world into propositional logic to identify states, and the choice of which discretiser to apply is key to the performance of the reduced agent. In this work, we explore this further by 1) reducing a single agent into an explainable PG, and 2) enforcing collaboration between this agent and an agent trained from human behaviour. The human agent is computed by using GAIL from a series of human-played episodes, and kept unchanged. We show that an opaque agent created and trained to collaborate with the human agent can be reduced to an explainable, non-opaque PG, so long as predicates regarding collaboration are included in the state representation, by showing the difference in reward between the agent and its PG. Code is available at https://github.com/HPAI-BSC/explainable-agents-with-humans This work has been partially supported by EU Horizon 2020 Project StairwAI (grant agreement No. 101017142). |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|