Hardware-Aware Neural Architecture Search: Survey and Taxonomy
| Autor: | Hamza Ouarnoughi, Hadjer Benmeziane, Kaoutar El Maghraoui, Martin Wistuba, Naigang Wang, Smail Niar |
|---|---|
| Přispěvatelé: | Laboratoire d'Automatique, de Mécanique et d'Informatique industrielles et Humaines - UMR 8201 (LAMIH), Centre National de la Recherche Scientifique (CNRS)-Université Polytechnique Hauts-de-France (UPHF)-INSA Institut National des Sciences Appliquées Hauts-de-France (INSA Hauts-De-France), IBM Thomas J. Watson Research Center, IBM, IBM Research - Ireland |
| Jazyk: | angličtina |
| Rok vydání: | 2021 |
| Předmět: |
Computer science
business.industry Multidisciplinary topics and applications 020206 networking & telecommunications 02 engineering and technology Taxonomy (general) Machine learning 0202 electrical engineering electronic engineering information engineering 020201 artificial intelligence & image processing Computer vision [INFO]Computer Science [cs] Architecture Software engineering business |
| Zdroj: | Thirtieth International Joint Conference on Artificial Intelligence {IJCAI-21} Thirtieth International Joint Conference on Artificial Intelligence, Aug 2021, Montreal, Canada. pp.4322-4329, ⟨10.24963/ijcai.2021/592⟩ IJCAI |
| DOI: | 10.24963/ijcai.2021/592⟩ |
| Popis: | International audience; There is no doubt that making AI mainstream by bringing powerful, yet power hungry deep neural networks (DNNs) to resource-constrained devices would required an efficient co-design of algorithms, hardware and software. The increased popularity of DNN applications deployed on a wide variety of platforms, from tiny microcontrollers to data-centers, have resulted in multiple questions and challenges related to constraints introduced by the hardware. In this survey on hardware-aware neural architecture search (HW-NAS), we present some of the existing answers proposed in the literature for the following questions: "Is it possible to build an efficient DL model that meets the latency and energy constraints of tiny edge devices?", "How can we reduce the trade-off between the accuracy of a DL model and its ability to be deployed in a variety of platforms?". The survey provides a new taxonomy of HW-NAS and assesses the hardware cost estimation strategies. We also highlight the challenges and limitations of existing approaches and potential future directions. We hope that this survey will help to fuel the research towards efficient deep learning. |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|