A Study on Energy-Process-Latency Tradeoff in Embedded Artificial Intelligence

Autor: Jinhwi Kim, Jeongho Kwak, Apostolos Galanopoulos, Jude Vivek Joseph
Rok vydání: 2020
Předmět:
Zdroj: ICTC
DOI: 10.1109/ictc49870.2020.9289270
Popis: In this paper, we explore an impact of GPU/CPU scaling of a state-of-the-art AI embedded device on its energy consumption and AI performance. We use Nvidia Jetson TX2 as an experiment device thanks to its tractability to scale GPU/CPU and modify AI framework and libraries. Via extensive experiment in various ML (Machine Learning) scenarios, i.e., face recognition and objective detection, we demonstrate a clear tradeoff between GPU/CPU scaling, energy consumption (of GPU/CPU as well as entire device) and training/inference speed. Finally, we envision a future work aiming to optimize processing and networking resources simultaneously at an extended scenario that multiple AI embedded devices cooperate with each other for a common AI application.
Databáze: OpenAIRE