Ensemble Model Compression for Fast and Energy-Efficient Ranking on FPGAs
| Autor: | Veronica Gil-Costa, Fernando Loor, Romina Molina, Franco Maria Nardini, Raffaele Perego, Salvatore Trani |
|---|---|
| Rok vydání: | 2022 |
| Předmět: | |
| Zdroj: | Lecture Notes in Computer Science ISBN: 9783030997359 ECIR 2022-44th European Conference on IR Research, pp. 260–273, Stavanger, Norway, 10-14/04/2022 |
| DOI: | 10.1007/978-3-030-99736-6_18 |
| Popis: | We investigate novel SoC-FPGA solutions for fast and energy-efficient ranking based on machine-learned ensembles of decision trees. Since the memory footprint of ranking ensembles limits the effective exploitation of programmable logic for large-scale inference tasks, we investigate binning and quantization techniques to reduce the memory occupation of the learned model and we optimize the state-of-the-art ensemble-traversal algorithm for deployment on low-cost, energy-efficient FPGA devices. The results of the experiments conducted using publicly available Learning-to-Rank datasets, show that our model compression techniques do not impact significantly the accuracy. Moreover, the reduced space requirements allow the models and the logic to be replicated on the FPGA device in order to execute several inference tasks in parallel. We discuss in details the experimental settings and the feasibility of the deployment of the proposed solution in a real setting. The results of the experiments conducted show that our FPGA solution achieves performances at the state of the art and consumes from 9 × up to 19.8 × less energy than an equivalent multi-threaded CPU implementation. |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|