A Quantitative Review of Automated Neural Search and On-Device Learning for Tiny Devices

Autor: Danilo Pietro Pau, Prem Kumar Ambrose, Fabrizio Maria Aymone
Jazyk: angličtina
Rok vydání: 2023
Předmět:
Zdroj: Chips, Vol 2, Iss 2, Pp 130-141 (2023)
Druh dokumentu: article
ISSN: 2674-0729
DOI: 10.3390/chips2020008
Popis: This paper presents a state-of-the-art review of different approaches for Neural Architecture Search targeting resource-constrained devices such as microcontrollers, as well as the implementations of on-device learning techniques for them. Approaches such as MCUNet have been able to drive the design of tiny neural architectures with low memory and computational requirements which can be deployed effectively on microcontrollers. Regarding on-device learning, there are various solutions that have addressed concept drift and have coped with the accuracy drop in real-time data depending on the task targeted, and these rely on a variety of learning methods. For computer vision, MCUNetV3 uses backpropagation and represents a state-of-the-art solution. The Restricted Coulomb Energy Neural Network is a promising method for learning with an extremely low memory footprint and computational complexity, which should be considered for future investigations.
Databáze: Directory of Open Access Journals