Objective learning from human demonstrations
Autor: | Jonathan Feng-Shun Lin, Dana Kulic, Maram Sakr, Pamela Carreno-Medrano, Mahsa Parsapour |
---|---|
Rok vydání: | 2021 |
Předmět: |
Structure (mathematical logic)
0209 industrial biotechnology Computer science 020208 electrical & electronic engineering 02 engineering and technology Data science Identification (information) 020901 industrial engineering & automation Control and Systems Engineering Inverse reinforcement learning Similarity (psychology) 0202 electrical engineering electronic engineering information engineering Key (cryptography) Inverse optimal control Reward learning Software |
Zdroj: | Annual Reviews in Control. 51:111-129 |
ISSN: | 1367-5788 |
DOI: | 10.1016/j.arcontrol.2021.04.003 |
Popis: | Researchers in biomechanics, neuroscience, human–machine interaction and other fields are interested in inferring human intentions and objectives from observed actions. The problem of inferring objectives from observations has received extensive theoretical and methodological development from both the controls and machine learning communities. In this paper, we provide an integrating view of objective learning from human demonstration data. We differentiate algorithms based on the assumptions made about the objective function structure, how the similarity between the inferred objectives and the observed demonstrations is assessed, the assumptions made about the agent and environment model, and the properties of the observed human demonstrations. We review the application domains and validation approaches of existing works and identify the key open challenges and limitations. The paper concludes with an identification of promising directions for future work. |
Databáze: | OpenAIRE |
Externí odkaz: |