Constructing optimized binary masks for reservoir computing with delay systems

Autor: Ingo Fischer, Lennert Appeltant, Jan Danckaert, Guy Van der Sande
Přispěvatelé: European Commission, Ministerio de Ciencia e Innovación (España), Belgian Science Policy Office, Research Foundation - Flanders, Govern de les Illes Balears, Applied Physics, Physics, Applied Physics and Photonics
Rok vydání: 2014
Předmět:
Zdroj: Scientific Reports
Digital.CSIC. Repositorio Institucional del CSIC
instname
Popis: This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 3.0 Unported License.
Reservoir computing is a novel bio-inspired computing method, capable of solving complex tasks in a computationally efficient way. It has recently been successfully implemented using delayed feedback systems, allowing to reduce the hardware complexity of brain-inspired computers drastically. In this approach, the pre-processing procedure relies on the definition of a temporal mask which serves as a scaled time-mutiplexing of the input. Originally, random masks had been chosen, motivated by the random connectivity in reservoirs. This random generation can sometimes fail. Moreover, for hardware implementations random generation is not ideal due to its complexity and the requirement for trial and error. We outline a procedure to reliably construct an optimal mask pattern in terms of multipurpose performance, derived from the concept of maximum length sequences. Not only does this ensure the creation of the shortest possible mask that leads to maximum variability in the reservoir states for the given reservoir, it also allows for an interpretation of the statistical significance of the provided training samples for the task at hand.
This research was partially supported by the Belgian Science Policy Office, under grant IAP P7/35 Photonics@be, by FWO(Belgium), MICINN (Spain), Comunitat Autonoma de les Illes Balears, FEDER, and the European Commission under Projects TEC2012-36335 (TRIPHOP), Grups Competitius and EC FP7 Projects PHOCUS (Grant No. 240763).
Databáze: OpenAIRE