A hybrid HPC/cloud distributed infrastructure: Coupling EC2 cloud resources with HPC clusters to run large tightly coupled multiscale applications
| Autor: | Bastien Chopard, Mohamed Ben Belgacem |
|---|---|
| Jazyk: | angličtina |
| Rok vydání: | 2015 |
| Předmět: |
Computer Networks and Communications
business.industry Computer science Distributed computing Cloud computing Workload Parallel computing Supercomputer Computer Science::Performance Hardware and Architecture Cluster (physics) Overhead (computing) ddc:025.063 business Computer Science::Distributed Parallel and Cluster Computing Software |
| Zdroj: | Future Generation Computer Systems, Vol. 42 (2015) pp. 11-21 |
| ISSN: | 0167-739X |
| Popis: | In this paper, we report on the experimental results of running a large, tightly coupled, distributed multiscale computation over a hybrid High Performance Computing (HPC) infrastructures. We connected EC2 based cloud clusters located in USA to university clusters located in Switzerland. We ran a concurrent multiscale MPI based application on this infrastructure and measured the overhead induced by extending our HPC clusters with EC2 resources. Our results indicate that accommodating some parts of the multiscale computation on cloud resources can lead to low performance without a proper adjustment of CPUs power and workload. However, by enforcing a load-balancing strategy one can benefit from the extra Cloud resources. We connect an EC2-cloud cluster to a university cluster located in Switzerland.We run a distributed multiscale CFD computation over this extended infrastructure.We evaluate and compare the distributed execution to a local execution.We describe our experience of running parallel CFD application on hybrid platforms.Multiscale computation on cloud requires an adjustment of CPUs power and workload. |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|
Full Text from ScienceDirect