Transferring Domain Knowledge with an Adviser in Continuous Tasks

Autor: Wijesinghe, Rukshan, Vithanage, Kasun, Tissera, Dumindu, Xavier, Alex, Fernando, Subha, Samarawickrama, Jayathu
Rok vydání: 2021
Předmět:
Druh dokumentu: Working Paper
Popis: Recent advances in Reinforcement Learning (RL) have surpassed human-level performance in many simulated environments. However, existing reinforcement learning techniques are incapable of explicitly incorporating already known domain-specific knowledge into the learning process. Therefore, the agents have to explore and learn the domain knowledge independently through a trial and error approach, which consumes both time and resources to make valid responses. Hence, we adapt the Deep Deterministic Policy Gradient (DDPG) algorithm to incorporate an adviser, which allows integrating domain knowledge in the form of pre-learned policies or pre-defined relationships to enhance the agent's learning process. Our experiments on OpenAi Gym benchmark tasks show that integrating domain knowledge through advisers expedites the learning and improves the policy towards better optima.
Comment: Accepted by the 25th Pacific-Asia Conference on Knowledge Discovery and Data Mining (PAKDD-2021)
Databáze: arXiv