Profiles of upcoming HPC Applications and their Impact on Reservation Strategies
| Autor: | Brice Goglin, Guillaume Pallez, Valentin Honore, Ana Gainaru |
|---|---|
| Přispěvatelé: | Oak Ridge National Laboratory [Oak Ridge] (ORNL), UT-Battelle, LLC, Topology-Aware System-Scale Data Management for High-Performance Computing (TADAAM), Laboratoire Bordelais de Recherche en Informatique (LaBRI), Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Inria Bordeaux - Sud-Ouest, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria), Université de Bordeaux (UB)-Centre National de la Recherche Scientifique (CNRS)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB), Plafrim, Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS)-Inria Bordeaux - Sud-Ouest, Université de Bordeaux (UB)-École Nationale Supérieure d'Électronique, Informatique et Radiocommunications de Bordeaux (ENSEIRB)-Centre National de la Recherche Scientifique (CNRS) |
| Jazyk: | angličtina |
| Rok vydání: | 2021 |
| Předmět: |
020203 distributed computing
Execution time Stochastic application business.industry Computer science Scheduling Distributed computing Big data Reservation Checkpointing 02 engineering and technology Scheduling (computing) Computational Theory and Mathematics Hardware and Architecture Signal Processing 0202 electrical engineering electronic engineering information engineering Memory footprint [INFO.INFO-DC]Computer Science [cs]/Distributed Parallel and Cluster Computing [cs.DC] business |
| Zdroj: | IEEE Transactions on Parallel and Distributed Systems IEEE Transactions on Parallel and Distributed Systems, Institute of Electrical and Electronics Engineers, 2021, 32 (5), pp.1178-1190. ⟨10.1109/TPDS.2020.3039728⟩ IEEE Transactions on Parallel and Distributed Systems, 2021, 32 (5), pp.1178-1190. ⟨10.1109/TPDS.2020.3039728⟩ |
| ISSN: | 1045-9219 |
| Popis: | International audience; With the expected convergence between HPC, BigData and AI, new applications with different profiles are coming to HPC infrastructures. We aim at better understanding the features and needs of these applications in order to be able to run them efficiently on HPC platforms. The approach followed is bottom-up: we study thoroughly an emerging application, Spatially Localized Atlas Network Tiles (SLANT, originating from the neuroscience community) to understand its behavior. Based on these observations, we derive a generic, yet simple, application model (namely, a linear sequence of stochastic jobs). We expect this model to be representative for a large set of upcoming applications from emerging fields that start to require the computational power of HPC clusters without fitting the typical behavior of large-scale traditional applications. In a second step, we show how one can use this generic model in a scheduling framework. Specifically we consider the problem of making reservations (both time and memory) for an execution on an HPC platform based on the application expected resource requirements. We derive solutions using the model provided by the first step of this work. We experimentally show the robustness of the model, even with very few data points or using another application, to generate the model, and provide performance gains with regards to standard and more recent approaches used in the neuroscience community. |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|