Fault tolerance of MPI applications in exascale systems: The ULFM solution
Autor: | Keita Teranishi, Patricia González, George Bosilca, Aurelien Bouteiller, Nuria Losada, María Martín |
---|---|
Rok vydání: | 2020 |
Předmět: |
Flexibility (engineering)
Resilience Computer Networks and Communications Computer science Interface (Java) Distributed computing Overhead (engineering) Message Passing Interface 020206 networking & telecommunications Fault tolerance 02 engineering and technology Application-level checkpointing Hardware and Architecture 0202 electrical engineering electronic engineering information engineering Programming paradigm MPI 020201 artificial intelligence & image processing Resilience (network) ULFM Software |
Zdroj: | RUC: Repositorio da Universidade da Coruña Universidade da Coruña (UDC) RUC. Repositorio da Universidade da Coruña instname |
ISSN: | 0167-739X |
Popis: | [Abstract] The growth in the number of computational resources used by high-performance computing (HPC) systems leads to an increase in failure rates. Fault-tolerant techniques will become essential for long-running applications executing in future exascale systems, not only to ensure the completion of their execution in these systems but also to improve their energy consumption. Although the Message Passing Interface (MPI) is the most popular programming model for distributed-memory HPC systems, as of now, it does not provide any fault-tolerant construct for users to handle failures. Thus, the recovery procedure is postponed until the application is aborted and re-spawned. The proposal of the User Level Failure Mitigation (ULFM) interface in the MPI forum provides new opportunities in this field, enabling the implementation of resilient MPI applications, system runtimes, and programming language constructs able to detect and react to failures without aborting their execution. This paper presents a global overview of the resilience interfaces provided by the ULFM specification, covers archetypal usage patterns and building blocks, and surveys the wide variety of application-driven solutions that have exploited them in recent years. The large and varied number of approaches in the literature proves that ULFM provides the necessary flexibility to implement efficient fault-tolerant MPI applications. All the proposed solutions are based on application-driven recovery mechanisms, which allows reducing the overhead and obtaining the required level of efficiency needed in the future exascale platforms. Ministerio de Economía y Competitividad and FEDER; TIN2016-75845-P Xunta de Galicia; ED431C 2017/04 National Science Foundation of the United States; NSF-SI2 #1664142 Exascale Computing Project; 17-SC-20-SC Honeywell International, Inc.; DE-NA0003525 |
Databáze: | OpenAIRE |
Externí odkaz: |