Sparse deep neural networks for embedded intelligence
| Autor: | Steve R. Gunn, Jia Bi |
|---|---|
| Jazyk: | angličtina |
| Rok vydání: | 2018 |
| Předmět: |
Artificial neural network
business.industry Computer science Stochastic process Deep learning Distributed computing Embedded intelligence 02 engineering and technology Energy consumption 010501 environmental sciences 01 natural sciences Regularization (mathematics) 0202 electrical engineering electronic engineering information engineering Memory footprint 020201 artificial intelligence & image processing Artificial intelligence Adaptive learning business 0105 earth and related environmental sciences |
| Zdroj: | ICTAI |
| Popis: | Deep learning is becoming more widespread due to its power in solving complex classification problems. However, deep learning models often require large memory and energy consumption, which may prevent them from being deployed effectively on embedded platforms, limiting their application. This work addresses the problem of memory requirements by proposing a regularization approach to compress the memory footprint of the models. It is shown that the sparsity-inducing regularization problem can be solved effectively using an enhanced stochastic variance reduced gradient optimization approach. Experimental evaluation of our approach shows that it can reduce the memory requirements both in the convolutional and fully connected layers by up to 300$\times$ without affecting overall test accuracy. |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|