Path Planning for Multi-Arm Manipulators Using Deep Reinforcement Learning: Soft Actor–Critic with Hindsight Experience Replay

Autor: Evan Prianto, MyeongSeop Kim, Jae-Han Park, Ji-Hun Bae, Jung-Su Kim
Jazyk: angličtina
Rok vydání: 2020
Předmět:
Zdroj: Sensors, Vol 20, Iss 20, p 5911 (2020)
Druh dokumentu: article
ISSN: 1424-8220
DOI: 10.3390/s20205911
Popis: Since path planning for multi-arm manipulators is a complicated high-dimensional problem, effective and fast path generation is not easy for the arbitrarily given start and goal locations of the end effector. Especially, when it comes to deep reinforcement learning-based path planning, high-dimensionality makes it difficult for existing reinforcement learning-based methods to have efficient exploration which is crucial for successful training. The recently proposed soft actor–critic (SAC) is well known to have good exploration ability due to the use of the entropy term in the objective function. Motivated by this, in this paper, a SAC-based path planning algorithm is proposed. The hindsight experience replay (HER) is also employed for sample efficiency and configuration space augmentation is used in order to deal with complicated configuration space of the multi-arms. To show the effectiveness of the proposed algorithm, both simulation and experiment results are given. By comparing with existing results, it is demonstrated that the proposed method outperforms the existing results.
Databáze: Directory of Open Access Journals
Nepřihlášeným uživatelům se plný text nezobrazuje