Worst-case Satisfaction of STL Specifications Using Feedforward Neural Network Controllers

Autor: Shakiba Yaghoubi, Georgios Fainekos
Rok vydání: 2019
Předmět:
Zdroj: ITA
ISSN: 1558-3465
1539-9087
DOI: 10.1145/3358239
Popis: In this paper, a reinforcement learning approach for designing feedback neural network controllers for nonlinear systems is proposed. Given a Signal Temporal Logic (STL) specification which needs to be satisfied by the system over a set of initial conditions, the neural network parameters are tuned in order to maximize the satisfaction of the STL formula. The framework is based on a max-min formulation of the robustness of the STL formula. The maximization is solved through a Lagrange multipliers method, while the minimization corresponds to a falsification problem. We present our results on a vehicle and a quadrotor model and demonstrate that our approach reduces the training time more than 50 percent compared to the baseline approach.
Databáze: OpenAIRE