The Case for Dynamic Placement of Distributed Systems Components
| Autor: | Alsayasneh, Maha, Quéma, Vivien, Lachaize, Renaud |
|---|---|
| Přispěvatelé: | Université Grenoble Alpes [2016-2019] (UGA [2016-2019]), Efficient and Robust Distributed Systems (ERODS ), Laboratoire d'Informatique de Grenoble (LIG ), Institut polytechnique de Grenoble - Grenoble Institute of Technology (Grenoble INP )-Centre National de la Recherche Scientifique (CNRS)-Université Grenoble Alpes [2016-2019] (UGA [2016-2019])-Institut polytechnique de Grenoble - Grenoble Institute of Technology (Grenoble INP )-Centre National de la Recherche Scientifique (CNRS)-Université Grenoble Alpes [2016-2019] (UGA [2016-2019]), Institut polytechnique de Grenoble - Grenoble Institute of Technology (Grenoble INP ), GRID5000, ANR-16-CE25-0013,RainbowFS,Cohérence modulaire et conception conjointe d'un système de fichiers massif(2016) |
| Jazyk: | angličtina |
| Rok vydání: | 2018 |
| Předmět: | |
| Zdroj: | Conférence d’informatique en Parallélisme, Architecture et Système 2018 (COMPAS 2018) Conférence d’informatique en Parallélisme, Architecture et Système 2018 (COMPAS 2018), Jul 2018, Toulouse, France |
| Popis: | International audience; Today distributed systems are made of many software components with complex interactions. One of the key challenges in such an environment is determining how to place the components so that the system performs efficiently. In this paper, we illustrate the importance of component placement with a case study, examining the performance of a common stream processing pipeline comprising Kafka, Spark, and Cassandra. We study three applications (word count, Twitter sentiment analysis, machine learning) and three placement strategies. Our results show that (i) placement has a significant impact on the application throughput (up to 52%) and (ii) the placement achieving best results differs depending on the application. We discuss why existing solutions for performance troubleshooting in distributed systems are not sufficient to help choosing an efficient placement or to detect if a chosen placement is significantly under-performing compared to others. Finally, we describe research directions to address this open problem. |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|