Actuation Strategy of a Virtual Skydiver Derived by Reinforcement Learning
| Autor: | Per-Olof Gutman, Anna Clarke |
|---|---|
| Rok vydání: | 2020 |
| Předmět: |
0209 industrial biotechnology
business.industry Movement (music) Computer science 020208 electrical & electronic engineering Process (computing) 02 engineering and technology Coaching 020901 industrial engineering & automation Control and Systems Engineering Control theory 0202 electrical engineering electronic engineering information engineering Key (cryptography) Reinforcement learning business Motor learning Motor skill Hierarchical design |
| Zdroj: | IFAC-PapersOnLine. 53:1569-1574 |
| ISSN: | 2405-8963 |
| DOI: | 10.1016/j.ifacol.2020.12.2187 |
| Popis: | An innovative approach of training motor skills involved in human body flight is proposed. Body flight is the art of maneuvering during the free fall stage of skydiving. The key idea is gradually constructing the movement patterns which are the combinations of body degrees-of-freedom that are activated synchronously and proportionally as a single unit, and turning this process into a coaching strategy. The proposed method is iterative: at each skill level an optimal movement pattern is constructed from the basic elements of the current movement repertoire. The free-fall maneuvers of each learning stage can be executed using any one of the basic elements. The construction has two stages: 1. tracking the desired maneuver while the body is actuated by each one of the basic patterns; 2. finding an optimal combination of these patterns to form a new way of body actuation. This hierarchical design resolves stage 2 by Reinforcement Learning with pure exploration and a minimal number of episodes. The method was tested in a Skydiver Simulator and resulted in deriving a movement pattern that showed a superior performance of the studied maneuver. The states and the reward of the Reinforcement Learning algorithm were converted into motor learning aids. |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|