Oscillatory neural network learning for pattern recognition: an on-chip learning perspective and implementation

Autor: Madeleine Abernot, Nadine Azemard, Aida Todri-Sanial
Jazyk: angličtina
Rok vydání: 2023
Předmět:
Zdroj: Frontiers in Neuroscience, Vol 17 (2023)
Druh dokumentu: article
ISSN: 1662-453X
DOI: 10.3389/fnins.2023.1196796
Popis: In the human brain, learning is continuous, while currently in AI, learning algorithms are pre-trained, making the model non-evolutive and predetermined. However, even in AI models, environment and input data change over time. Thus, there is a need to study continual learning algorithms. In particular, there is a need to investigate how to implement such continual learning algorithms on-chip. In this work, we focus on Oscillatory Neural Networks (ONNs), a neuromorphic computing paradigm performing auto-associative memory tasks, like Hopfield Neural Networks (HNNs). We study the adaptability of the HNN unsupervised learning rules to on-chip learning with ONN. In addition, we propose a first solution to implement unsupervised on-chip learning using a digital ONN design. We show that the architecture enables efficient ONN on-chip learning with Hebbian and Storkey learning rules in hundreds of microseconds for networks with up to 35 fully-connected digital oscillators.
Databáze: Directory of Open Access Journals