Reliable Learning-based Controllers and How Structured Simulation is a Path towards Them

Autor: Kušić, Krešimir, Schumann, René, Gregurić, Martin, Ivanjko, Edouard, Šoštarić, Marko
Přispěvatelé: Yurish, Sergey Y.
Jazyk: angličtina
Rok vydání: 2023
Předmět:
Popis: New approaches to control stochastic non-linear time-variant processes include the application of machine learning techniques. One of the problems with learning- based controllers is their reliability in a wide area of process parameters as the controller is trained using a limited set of representative scenarios, either chosen by the designer or taken from historic records. Thus, reliable controller behavior can be guaranteed only in scenarios applied during controller training. Due to the very larger number of random variables and possible scenarios, not all variations can be applied in the controller training process using simulators to guarantee good controller behavior when applied in a real system. One case is traffic control (signal programs, variable speed limit, ramp metering) having large travel patterns variety. The concept of Structured Simulations Framework (SSF) can cover most probable learning scenarios. Thus, applying SSF enables a systematic controller training approach by complementing existing scenarios with synthesized ones that evoke or replicate substantial aspects of real traffic. Such training is necessary to ensure reliable learning-based controllers. This paper discusses the concept of applying SSF to ensure the reliability of learning-based controllers and proposes the application in traffic control for the case of variable speed limits on motorways.
Databáze: OpenAIRE