Portable Application-level Checkpointing for Hybrid MPI-OpenMP Applications
| Autor: | Gabriel Rodrguez, Mara J. Martn, Patricia Gonzlez, Nuria Losada |
|---|---|
| Rok vydání: | 2016 |
| Předmět: |
Computer science
Distributed computing Fault Tolerance Checkpointing Fault tolerance 0102 computer and information sciences 02 engineering and technology Thread (computing) 01 natural sciences Consistency (database systems) Software portability Portable application Multicore Clusters 010201 computation theory & mathematics 0202 electrical engineering electronic engineering information engineering Benchmark (computing) General Earth and Planetary Sciences Overhead (computing) 020201 artificial intelligence & image processing Hybrid MPI-OpenMP Protocol (object-oriented programming) General Environmental Science |
| Zdroj: | ICCS |
| ISSN: | 1877-0509 |
| Popis: | As parallel machines increase their number of processors, so does the failure rate of the global system, thus, long-running applications will need to make use of fault tolerance techniques to ensure the successful execution completion. Most of current HPC systems are built as clusters of multicores. The hybrid MPI-OpenMP paradigm provides numerous benefits on these systems. This paper presents a checkpointing solution for hybrid MPI-OpenMP applications, in which checkpoint consistency is guaranteed by using a coordination protocol intra-node, while no inter-node coordination is needed. The proposal reduces network utilization and storage resources in order to optimize the I/O cost of fault tolerance, while minimizing the checkpointing overhead. Besides, the portability of the solution and the dynamic parallelism provided by OpenMP enable the restart of the applications using machines with different architectures, operating systems and/or number of cores, adapting the number of running OpenMP threads for the best exploitation of the available resources. Extensive evaluation using hybrid MPI-OpenMP applications from the ASC Sequoia Benchmark Codes and NERSC-8/Trinity benchmarks is presented, showing the effectiveness and efficiency of the approach. |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|