Towards Dynamic Data Placement for Polystore Ingestion

Autor: Stan Zdonik, Nesime Tatbul, John Meehan, Jiang Du
Rok vydání: 2019
Předmět:
Zdroj: Real-Time Business Intelligence and Analytics ISBN: 9783030241230
BIRTE (Revised Selected Papers)
Popis: Integrating low-latency data streaming into data warehouse architectures has become an important enhancement to support modern data warehousing applications. In these architectures, heterogeneous workloads with data ingestion and analytical queries must be executed with strict performance guarantees. Furthermore, the data warehouse may consists of multiple different types of storage engines (a.k.a., polystores or multi-stores). A paramount problem is data placement; different workload scenarios call for different data placement designs. Moreover, workload conditions change frequently. In this paper, we provide evidence that a dynamic, workload-driven approach is needed for data placement in polystores with low-latency data ingestion support. We study the problem based on the characteristics of the TPC-DI benchmark in the context of an abbreviated polystore that consists of S-Store and Postgres.
Databáze: OpenAIRE