Subtensor Quantization for Mobilenets
Autor: | Vasilios Daskalopoulos, Andrey Melnikov, Thu Dinh, Sek M. Chai |
---|---|
Rok vydání: | 2020 |
Předmět: | |
Zdroj: | Computer Vision – ECCV 2020 Workshops ISBN: 9783030682378 ECCV Workshops (5) |
Popis: | Quantization for deep neural networks (DNN) have enabled developers to deploy models with less memory and more efficient low-power inference. However, not all DNN designs are friendly to quantization. For example, the popular Mobilenet architecture has been tuned to reduce parameter size and computational latency with separable depthwise convolutions, but not all quantization algorithms work well and the accuracy can suffer against its float point versions. In this paper, we analyzed several root causes of quantization loss and proposed alternatives that do not rely on per-channel or training-aware approaches. We evaluate the image classification task on ImageNet dataset, and our post-training quantized 8-bit inference top-1 accuracy in within 0.7% of the floating point version. |
Databáze: | OpenAIRE |
Externí odkaz: |