Benchmarking Heterogeneous HPC Systems Including Reconfigurable Fabrics: Community Aspirations for Ideal Comparisons

Autor: Peter Jamieson, Ahmed Sanaullah, Martin C. Herbordt
Rok vydání: 2018
Předmět:
Zdroj: HPEC
Popis: We describe a progressive philosophy to help benchmark systems and designs in the High Performance Computing (HPC) domain. These systems now include heterogeneous multi-node systems where nodes can include combinations of CPUs, GPUs, FPGAs, and other emerging computing devices. Because of the heterogeneous nature of these systems, benchmarking and comparison of systems is an ever increasingly complex process. Currently, there is no benchmark or other process that results good comparisons. We introduce a set of tenets that will allow us to compare one system to another and to include tool innovations. These tenets rely on our research community providing what we call a system context and an instance of a specific design (benchmark). A better benchmarking process will make our future research stronger scientifically, and will allow us to improve future systems, their accompanying compilation/synthesis tools, and the designs that execute on these systems. To achieve this, we survey existing benchmarks and their accompanying philosophies, and we describe our conceived ideal benchmarking scenario with a set of tenets, some definitions, a methodology, and a discussion that we hope will guide our research community forward.
Databáze: OpenAIRE