Nonholonomic Yaw Control of an Underactuated Flying Robot With Model-Based Reinforcement Learning
Autor: | Nathan Lambert, Daniel S. Drew, Craig B. Schindler, Kristofer S. J. Pister |
---|---|
Rok vydání: | 2021 |
Předmět: |
FOS: Computer and information sciences
0209 industrial biotechnology Control and Optimization Computer science Biomedical Engineering 02 engineering and technology 010501 environmental sciences Nonlinear control 01 natural sciences Attitude control Vehicle dynamics Computer Science - Robotics 020901 industrial engineering & automation Artificial Intelligence Control theory Reinforcement learning 0105 earth and related environmental sciences Nonholonomic system Underactuation Mechanical Engineering Yaw Computer Science Applications Human-Computer Interaction Nonlinear system Control and Systems Engineering Robot Computer Vision and Pattern Recognition Robotics (cs.RO) |
Zdroj: | IEEE Robotics and Automation Letters. 6:455-461 |
ISSN: | 2377-3774 |
Popis: | Nonholonomic control is a candidate to control nonlinear systems with path-dependant states. We investigate an underactuated flying micro-aerial-vehicle, the ionocraft, that requires nonholonomic control in the yaw-direction for complete attitude control. Deploying an analytical control law involves substantial engineering design and is sensitive to inaccuracy in the system model. With specific assumptions on assembly and system dynamics, we derive a Lie bracket for yaw control of the ionocraft. As a comparison to the significant engineering effort required for an analytic control law, we implement a data-driven model-based reinforcement learning yaw controller in a simulated flight task. We demonstrate that a simple model-based reinforcement learning framework can match the derived Lie bracket control (in yaw rate and chosen actions) in a few minutes of flight data, without a pre-defined dynamics function. This paper shows that learning-based approaches are useful as a tool for synthesis of nonlinear control laws previously only addressable through expert-based design. Comment: 7 pages, 1 page appendix |
Databáze: | OpenAIRE |
Externí odkaz: |