A Checkpoint of Research on Parallel I/O for High-Performance Computing

Autor: Philippe O. A. Navaux, Eduardo C. Inacio, Mario A. R. Dantas, Jean Luca Bez, Yves Denneulin, Francieli Zanon Boito
Přispěvatelé: Universidade Federal do Rio Grande do Sul [Porto Alegre] (UFRGS), Universidade Federal de Santa Catarina = Federal University of Santa Catarina [Florianópolis] (UFSC), Data Aware Large Scale Computing (DATAMOVE ), Inria Grenoble - Rhône-Alpes, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria)-Laboratoire d'Informatique de Grenoble (LIG ), Institut polytechnique de Grenoble - Grenoble Institute of Technology (Grenoble INP )-Centre National de la Recherche Scientifique (CNRS)-Université Grenoble Alpes [2016-2019] (UGA [2016-2019])-Institut polytechnique de Grenoble - Grenoble Institute of Technology (Grenoble INP )-Centre National de la Recherche Scientifique (CNRS)-Université Grenoble Alpes [2016-2019] (UGA [2016-2019])
Rok vydání: 2018
Předmět:
Zdroj: ACM Computing Surveys
ACM Computing Surveys, Association for Computing Machinery, 2018, 51 (2), pp.23:1-23:35. ⟨10.1145/3152891⟩
ACM Computing Surveys, 2018, 51 (2), pp.23:1-23:35. ⟨10.1145/3152891⟩
ISSN: 1557-7341
0360-0300
Popis: We present a comprehensive survey on parallel I/O in the high-performance computing (HPC) context. This is an important field for HPC because of the historic gap between processing power and storage latency, which causes application performance to be impaired when accessing or generating large amounts of data. As the available processing power and amount of data increase, I/O remains a central issue for the scientific community. In this survey article, we focus on a traditional I/O stack, with a POSIX parallel file system. We present background concepts everyone could benefit from. Moreover, through the comprehensive study of publications from the most important conferences and journals in a 5-year time window, we discuss the state of the art in I/O optimization approaches, access pattern extraction techniques, and performance modeling, in addition to general aspects of parallel I/O research. With this approach, we aim at identifying the general characteristics of the field and the main current and future research topics.
Databáze: OpenAIRE