Performance analysis of asynchronous Jacobi’s method implemented in MPI, SHMEM and OpenMP

Autor: Iain Bethune, Nicholas J. Dingle, Nicholas J. Higham, J. Mark Bull
Rok vydání: 2013
Předmět:
Zdroj: The International Journal of High Performance Computing Applications. 28:97-111
ISSN: 1741-2846
1094-3420
Popis: Ever-increasing core counts create the need to develop parallel algorithms that avoid closely coupled execution across all cores. We present performance analysis of several parallel asynchronous implementations of Jacobi’s method for solving systems of linear equations, using MPI, SHMEM and OpenMP. In particular we have solved systems of over 4 billion unknowns using up to 32,768 processes on a Cray XE6 supercomputer. We show that the precise implementation details of asynchronous algorithms can strongly affect the resulting performance and convergence behaviour of our solvers in unexpected ways, discuss how our specific implementations could be generalised to other classes of problem, and suggest how existing parallel programming models might be extended to allow asynchronous algorithms to be expressed more easily.
Databáze: OpenAIRE