A Real-Time Intelligent Energy Management Strategy for Hybrid Electric Vehicles Using Reinforcement Learning
| Autor: | Woong Soo Lee, Haeseong Jeoung, Heeyun Lee, Dohyun Park, Tacksu Kim, Namwook Kim |
|---|---|
| Rok vydání: | 2021 |
| Předmět: |
reinforcement learning
Mathematical optimization General Computer Science Computer science Energy management 020209 energy Control (management) Energy management strategy 02 engineering and technology adaptive ECMS hybrid electric vehicles 0203 mechanical engineering Control theory 0202 electrical engineering electronic engineering information engineering Reinforcement learning General Materials Science deep Q-learning Artificial neural network General Engineering 020302 automobile design & engineering Optimal control TK1-9971 machine learning State of charge Electronic countermeasure Electrical engineering. Electronics. Nuclear engineering |
| Zdroj: | IEEE Access, Vol 9, Pp 72759-72768 (2021) |
| ISSN: | 2169-3536 |
| DOI: | 10.1109/access.2021.3079903 |
| Popis: | Equivalent Consumption Management Strategy (ECMS), a representative energy management strategy for hybrid electric vehicles (HEVs) derived from Pontryagin’s minimum principle, is known to produce a near-optimal solution if the costate or equivalent factor of electric use is appropriately determined according to the driving conditions. One problem when applying the control concept to real-world scenarios is that it is difficult to precisely evaluate the performance of the control parameter before driving is complete, so the costate cannot be determined properly. To address this issue, this study proposes a practical method for estimating an appropriate costate based on Deep Q-Networks (DQNs), which is a reinforcement learning algorithm that uses a Deep Neural Network to evaluate the performances and determine the best control parameter or costate. The control concept benefits vehicle energy management by selecting the control parameter most related to stochastic conditions or future driving information based on artificial intelligence (AI), while optimal control is deterministically conducted by ECMS if the control parameter is given. Simply, only the implicit part of the optimal controller is solved via artificial intelligence. In the simulation results, not only does the proposed control concept outperform an existing ECMS that uses an adaptive technique for determining the costate, but the concept is also very feasible, in that it does not need a model for evaluating the performances. |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|