An Intelligent Bandwidth Manager for CNN Applications on Embedded Devices
| Autor: | Chandra Kumar Ramasamy, Ashok Vishnoi, Sirish Kumar Pasupuleti, Vasanthakumar Rajagopal, Raj Narayana Gadde, Deepanshu Yadvandu, Aishwarya Rajaram, Narasinga Rao Miniskar |
|---|---|
| Rok vydání: | 2018 |
| Předmět: |
Bandwidth management
Hardware_MEMORYSTRUCTURES Fold (higher-order function) Computer science business.industry 020208 electrical & electronic engineering Memory bandwidth 02 engineering and technology 010501 environmental sciences 01 natural sciences Convolutional neural network Microarchitecture Memory management 0202 electrical engineering electronic engineering information engineering business Frequency modulation Computer hardware 0105 earth and related environmental sciences |
| Zdroj: | ICIP |
| DOI: | 10.1109/icip.2018.8451706 |
| Popis: | Adapting complex Convolution Neural Network (CNN) applications on embedded processors is a challenge due to the massive memory bandwidth and computational requirements. In particular, the CNN memory bandwidth requirement poses a huge challenge for the processors with Scratch Pad Memory (SPM), usually of limited size. In this paper, we present an Intelligent Bandwidth Manager (IBWM) to efficiently handle the CNN bandwidth for SPM based processors. The proposed IBWM is a two fold approach which includes Intelligent SPM Manager (ISM) to optimize the number of accesses to SDRAM by analysing the data patterns, and Feature Map Compression (FMC) to further reduce the bandwidth by exploiting the feature map data sparsity. The IBWM is independent of any processor architecture and can be adopted in any processor with SPM. The proposed IBWM is experimented with ResNet-50 [1] and AlexNet [2] networks on a Samsung Reconfigurable Processor (SRP) [3] for various SPM sizes. The SDRAM bandwidth results show, 2x improvement compared to MIT Eyeriss [4] for AlexNet, and 4x-8x improvement compared to primitive bandwidth management techniques for AlexNet and ResNet-50. The proposed method achieves the bandwidth closer to the minimum possible bandwidth. |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|