A Demand-Driven Bulk Loading Scheme for Large-Scale Social Graphs

Autor:	Weiping Qu, Stefan Dessloch
Rok vydání:	2014
Předmět:	Scheme (programming language) Task (computing) Computer science Distributed computing On demand Real-time computing Cluster (physics) Demand driven Scale (descriptive set theory) computer computer.programming_language
Zdroj:	Advances in Databases and Information Systems ISBN: 9783319109329 ADBIS
DOI:	10.1007/978-3-319-10933-6_11
Popis:	Migrating large-scale data sets (e.g. social graphs) from cluster to cluster and meanwhile providing high system uptime is a challenge task. It requires fast bulk import speed. We address this problem by introducing our “Demand-driven Bulk Loading” scheme based on the data/query distributions tracked from Facebook’s social graphs. A client-side coordinator and a hybrid store which consists of both MySQL and HBase engines work together to deliver fast availability to small, “hot” data in MySQL and incremental availability to massive, “cold” data in HBase on demand. The experimental results show that our approach enables the fastest system’s starting time while guaranteeing high query throughputs.
Databáze:	OpenAIRE
Externí odkaz:	https://explore.openaire.eu/search/publication?articleId=doi_________::c6494a3bbf81797f79731e895eb116c4 https://doi.org/10.1007/978-3-319-10933-6_11 Zobrazit plný text záznamu