DSCU: Accelerating CNN Inference in FPGAs with Dual Sizes of Compute Unit

Autor: Zhenshan Bao, Junnan Guo, Wenbo Zhang, Hongbo Dang
Jazyk: angličtina
Rok vydání: 2022
Předmět:
Zdroj: Journal of Low Power Electronics and Applications, Vol 12, Iss 1, p 11 (2022)
Druh dokumentu: article
ISSN: 2079-9268
DOI: 10.3390/jlpea12010011
Popis: FPGA-based accelerators have shown great potential in improving the performance of CNN inference. However, the existing FPGA-based approaches suffer from a low compute unit (CU) efficiency due to their large number of redundant computations, thus leading to high levels of performance degradation. In this paper, we show that no single CU can perform best across all the convolutional layers (CONV-layers). To this end, we propose the use of dual sizes of compute unit (DSCU), an approach that aims to accelerate CNN inference in FPGAs. The key idea of DSCU is to select the best combination of CUs via dynamic programming scheduling for each CONV-layer and then assemble each CONV-layer combination into a computing solution for the given CNN to deploy in FPGAs. The experimental results show that DSCU can achieve a performance density of 3.36 × 10−3 GOPs/slice on a Xilinx Zynq ZU3EG, which is 4.29 times higher than that achieved by other approaches.
Databáze: Directory of Open Access Journals