Possibility of HPC Application on Cloud Infrastructure by Container Cluster
| Autor: | Kyu-nam Cho, Kideuk Bang, Hyun Seok Lee, Sung-Soo Kim |
|---|---|
| Rok vydání: | 2019 |
| Předmět: |
Computer science
business.industry Distributed computing 05 social sciences InfiniBand 050301 education Cloud computing Solver Supercomputer Server Hardware acceleration 0501 psychology and cognitive sciences Applications of artificial intelligence General-purpose computing on graphics processing units business 0503 education 050104 developmental & child psychology |
| Zdroj: | CSE/EUC |
| DOI: | 10.1109/cse/euc.2019.00059 |
| Popis: | Today, High Performance Computing (HPC) has been used to solve various domain problems including science and engineering field or streaming processing application. All of these domains require a lot of computation resources. For HPC application, wall time and accuracy of calculation are important factors. Therefore, cloud infrastructure was hardly acceptable to the HPC application, because cloud infrastructure has performance overhead as compared with native environments. However, new hardware acceleration devices, increased demand for large scale calculations using AI applications and evolution of container technology have increased the possibility of running HPC applications on cloud infrastructure. In this study, we evaluate and compare the performance of several applications such as ; Poisson's solver, ResNet50, and Recurrent Neural Networks (RNNs) with Long Short-Term Memory models (LSTM) - to confirm the possibility of running HPC applications on cloud infrastructure. We submit that there is only 0.05% overhead for ResNet50 on cloud infrastructure. It indicates the possibility of running special purpose HPC applications such as AI training or General-Purpose computing on Graphics Processing Units (GPGPU) oriented applications on cloud infrastructure. We also observe that there is no performance overhead for cache miss rate and InfiniBand latency. |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|