A system design for elastically scaling transaction processing engines in virtualized servers
| Autor: | Eliezer Levy, Angelos-Christos G. Anadiotis, Hillel Avni, Raja Appuswamy, Shay Goikhman, Ilan Bronshtein, Anastasia Ailamaki, David Dominguez-Sal |
|---|---|
| Přispěvatelé: | Département d'informatique de l'École polytechnique (X-DEP-INFO), École polytechnique (X), Ecole Polytechnique Fédérale de Lausanne (EPFL), Rich Data Analytics at Cloud Scale (CEDAR), Laboratoire d'informatique de l'École polytechnique [Palaiseau] (LIX), École polytechnique (X)-Centre National de la Recherche Scientifique (CNRS)-École polytechnique (X)-Centre National de la Recherche Scientifique (CNRS)-Inria Saclay - Ile de France, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria), Eurecom [Sophia Antipolis], Huawei Research Center [Tel Aviv], Huawei Technologies Co., Ltd [Shenzhen], Huawei Research Center [Munich], Centre National de la Recherche Scientifique (CNRS)-École polytechnique (X)-Centre National de la Recherche Scientifique (CNRS)-École polytechnique (X)-Inria Saclay - Ile de France, Huawei |
| Rok vydání: | 2020 |
| Předmět: |
[INFO.INFO-DB]Computer Science [cs]/Databases [cs.DB]
business.industry Computer science Transaction processing Distributed computing General Engineering Hypervisor Cloud computing 02 engineering and technology computer.software_genre Virtualization [INFO.INFO-NI]Computer Science [cs]/Networking and Internet Architecture [cs.NI] Virtual machine 020204 information systems Server impact 0202 electrical engineering electronic engineering information engineering Transaction processing system Online transaction processing [INFO.INFO-OS]Computer Science [cs]/Operating Systems [cs.OS] [INFO.INFO-DC]Computer Science [cs]/Distributed Parallel and Cluster Computing [cs.DC] business computer scalability |
| Zdroj: | Proceedings of the VLDB Endowment (PVLDB) Proceedings of the VLDB Endowment (PVLDB), 2020, 13 (12), pp.3085-3098. ⟨10.14778/3415478.3415536⟩ Proceedings of the VLDB Endowment (PVLDB), VLDB Endowment, 2020, 13 (12), pp.3085-3098. ⟨10.14778/3415478.3415536⟩ Proceedings of the VLDB Endowment |
| ISSN: | 2150-8097 |
| DOI: | 10.14778/3415478.3415536 |
| Popis: | Online Transaction Processing (OLTP) deployments are migrating from on-premise to cloud settings in order to exploit the elasticity of cloud infrastructure which allows them to adapt to workload variations. However, cloud adaptation comes at the cost of redesigning the engine, which has led to the introduction of several, new, cloud-based transaction processing systems mainly focusing on: (i) the transaction coordination protocol, (ii) the data partitioning strategy, and, (iii) the resource isolation across multiple tenants. As a result, standalone OLTP engines cannot be easily deployed with an elastic setting in the cloud and they need to migrate to another, specialized deployment. In this paper, we focus on workload variations that can be addressed by modern multi-socket, multi-core servers and we present a system design for providing fine-grained elasticity to multi-tenant, scale-up OLTP deployments. We introduce novel components to the virtualization software stack that enable on-demand addition and removal of computing and memory resources. We provide a bi-directional, low-overhead communication stack between the virtual machine and the hypervisor, which allows the former to adapt to variations coming both from the workload and the resource availability. We show that our system achieves NUMA-aware, millisecond-level, stateful and fine-grained elasticity, while it is not intrusive to the design of state-of-the-art, in-memory OLTP engines. We evaluate our system through novel use cases demonstrating that scale-up elasticity increases resource utilization, while allowing tenants to pay for actual use of resources and not just their reservation. |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|