EFFORT: A Comprehensive Technique to Tackle Timing Violations and Improve Energy Efficiency of Near-Threshold Tensor Processing Units
| Autor: | Tahmoures Shabanian, Noel Daniel Gundi, Pramesh Pandey, Sanghamitra Roy, Koushik Chakraborty, Prabal Basu |
|---|---|
| Rok vydání: | 2021 |
| Předmět: |
Artificial neural network
Computer science Clock gating symbols.namesake Computer engineering Hardware and Architecture Dynamic demand symbols Electrical and Electronic Engineering Inference engine Throughput (business) Software Energy (signal processing) Efficient energy use Von Neumann architecture |
| Zdroj: | IEEE Transactions on Very Large Scale Integration (VLSI) Systems. 29:1790-1799 |
| ISSN: | 1557-9999 1063-8210 |
| Popis: | Modern deep neural network (DNN) applications demand a remarkable processing throughput usually unmet by traditional Von Neumann architectures. Consequently, hardware accelerators, comprising a sea of multiplier-and-accumulate (MAC) units, have recently gained prominence in accelerating DNN inference engine. For example, tensor processing units (TPUs) account for a lion’s share of Google’s datacenter inference operations. The proliferation of real-time DNN predictions is accompanied by a tremendous energy budget. In quest of trimming the energy footprint of DNN accelerators, we propose Energy eFFicient and errOr Resilient TPU (EFFORT)—an energy optimized, yet high-performance TPU architecture, operating at the near-threshold computing (NTC) region. EFFORT promotes a better-than-worst case design by operating the NTC TPU at a substantially high frequency while keeping the voltage at the NTC nominal value. In order to tackle the timing errors due to such aggressive operation, we employ an opportunistic error mitigation strategy. In addition, we implement an in situ clock gating architecture, drastically reducing the MACs’ dynamic power consumption. Compared to a cutting-edge error mitigation technique for TPUs, EFFORT enables up to $2.5\times $ better performance at NTC with only 4% average accuracy drop across six out of eight DNN benchmarks. |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|