Application of new training methods for neural model reference control
| Autor: | Amir Jafari, Martin T. Hagan |
|---|---|
| Rok vydání: | 2018 |
| Předmět: |
Training set
Computer science System identification Extrapolation 020206 networking & telecommunications 02 engineering and technology computer.software_genre Data set Maxima and minima Recurrent neural network Artificial Intelligence Control and Systems Engineering Search algorithm 0202 electrical engineering electronic engineering information engineering 020201 artificial intelligence & image processing Data mining Electrical and Electronic Engineering Cluster analysis computer |
| Zdroj: | Engineering Applications of Artificial Intelligence. 74:312-321 |
| ISSN: | 0952-1976 |
| DOI: | 10.1016/j.engappai.2018.07.005 |
| Popis: | In this paper, we introduce new, more efficient, methods for training recurrent neural networks (RNNs) for system identification and Model Reference Control (MRC). These methods are based on a new understanding of the error surfaces of RNNs that has been developed in recent years. These error surfaces contain spurious valleys that disrupt the search for global minima. The spurious valleys are caused by instabilities in the networks, which become more pronounced with increased prediction horizons. The new methods described in this paper increase the prediction horizons in a principled way that enables the search algorithms to avoid the spurious valleys. The work also presents a novelty sampling method for collecting new data wisely. A clustering method determines when an RNN is extrapolating, which occurs when the RNN operates outside the region spanned by the training set, where adequate performance cannot be guaranteed. The new method presented in this paper uses a clustering method for extrapolation detection, and then the novel data is added to the original training set. The network performance is improved when additional training is performed with the augmented data set. The new techniques are applied to the model reference control of a magnetic levitation system. The techniques are tested on both simulated and experimental versions of the system. |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|
Full Text from ScienceDirect