A new echo state network with variable memory length
| Autor: | Hai-feng Hu, Shu-xian Lun, Xian-shuang Yao |
|---|---|
| Rok vydání: | 2016 |
| Předmět: |
0209 industrial biotechnology
Information Systems and Management Computer science Echo (computing) Autocorrelation Leaky integrator 02 engineering and technology Kalman filter Computer Science Applications Theoretical Computer Science Extended Kalman filter 020901 industrial engineering & automation Artificial Intelligence Control and Systems Engineering Control theory 0202 electrical engineering electronic engineering information engineering 020201 artificial intelligence & image processing State (computer science) Echo state network Software |
| Zdroj: | Information Sciences. :103-119 |
| ISSN: | 0020-0255 |
| DOI: | 10.1016/j.ins.2016.07.065 |
| Popis: | This paper proposes a new echo state network (ESN) with variable memory length. For input-driven applications, existing ESNs do not fully consider the characteristics of input signals and usually ignore output feedback connections. Therefore, the echo state property of ESN cannot be completely satisfied for a certain period of time, and thus ESNs cannot provide higher accuracy and faster convergence speed for time-series prediction. To overcome the abovementioned problems of existing ESNs, we propose a variable memory length echo state network (VML-ESN) that can adaptively adjust the state update pattern according to the autocorrelation characteristic of the input signals. For different input signals, the reservoir of VML-ESN is composed of different leaky integrator units with multiple delays. Therefore, the reservoir of VML-ESN has a variable state update equation for different types of input signals. A sufficient condition is given to guarantee that the VML-ESN model has the echo state property. The extended Kalman filtering (EKF) method is utilized to obtain the global optimal parameters of VML-ESN. To validate the effectiveness of VML-ESN, we use VML-ESN to predict different types of time series. Simulation results showed that VML-ESN can greatly improve the prediction accuracy and training time for different input signals. |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|
Full Text from ScienceDirect