Closed-loop dynamic control of a soft manipulator using deep reinforcement learning
| Autor: | Andrea Centurelli, Luca Arleo, Alessandro Rizzo, Silvia Tolu, Cecilia Laschi, Egidio Falotico |
|---|---|
| Jazyk: | angličtina |
| Rok vydání: | 2022 |
| Předmět: |
soft robotics
Control and Optimization Mechanical Engineering Biomedical Engineering robot learning Manipulator dynamics robot control Computer Science Applications Human-Computer Interaction Artificial Intelligence Control and Systems Engineering Computer Vision and Pattern Recognition Manipulator dynamics robot control robot learning soft robotics |
| Zdroj: | Centurelli, A, Arleo, L, Rizzo, A, Tolu, S, Laschi, C & Falotico, E 2022, ' Closed-loop Dynamic Control of a Soft Manipulator using Deep Reinforcement Learning ', IEEE Robotics and Automation Letters, vol. 7, no. 2, pp. 4741-4748 . https://doi.org/10.1109/LRA.2022.3146903 IEEE Robotics and Automation Letters |
| DOI: | 10.1109/LRA.2022.3146903 |
| Popis: | The focus of the research community in the soft robotic field has been on developing innovative materials, but the design of control strategies applicable to these robotic platforms is still an open challenge. This is due to their highly nonlinear dynamics which is difficult to model and the degree of stochasticity they often incorporate. Data-driven controllers based on neural networks have recently been explored as a viable solution to be employed for these manipulators. This paper presents a neural network-based closed-loop controller, trained by a deep reinforcement learning algorithm called Trust Region PolicyOptimization (TRPO). The training takes place in simulation, using an approximation of the robot forward dynamic model obtained with a Long-short Term Memory (LSTM) network. The trained controller allows following different paths executed with different velocities in the workspace of the robot. The results demonstrate that the controller is effective in normal working conditions and with a payload attached to the end-effector of the manipulator. |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|