Exploiting Neural-Network Statistics for Low-Power DNN Inference

Autor: Lennart Bamberg, Ardalan Najafi, Alberto Garcia-Ortiz
Jazyk: angličtina
Rok vydání: 2024
Předmět:
Zdroj: IEEE Open Journal of Circuits and Systems, Vol 5, Pp 178-188 (2024)
Druh dokumentu: article
ISSN: 2644-1225
DOI: 10.1109/OJCAS.2024.3388210
Popis: Specialized compute blocks have been developed for efficient nn execution. However, due to the vast amount of data and parameter movements, the interconnects and on-chip memories form another bottleneck, impairing power and performance. This work addresses this bottleneck by contributing a low-power technique for edge-AI inference engines that combines overhead-free coding with a statistical analysis of the data and parameters of neural networks. Our approach reduces the power consumption of the logic, interconnect, and memory blocks used for data storage and movements by up to 80% for state-of-the-art benchmarks while providing additional power savings for the compute blocks by up to 39 %. These power improvements are achieved with no loss of accuracy and negligible hardware cost.
Databáze: Directory of Open Access Journals