Hash & Adjust: Competitive Demand-Aware Consistent Hashing

Autor:	Pourdamghani, Arash, Avin, Chen, Sama, Robert, Shiran, Maryam, Schmid, Stefan
Rok vydání:	2024
Předmět:	Computer Science - Distributed Parallel and Cluster Computing Computer Science - Data Structures and Algorithms
Druh dokumentu:	Working Paper
DOI:	10.4230/LIPIcs.OPODIS.2024.26
Popis:	Distributed systems often serve dynamic workloads and resource demands evolve over time. Such a temporal behavior stands in contrast to the static and demand-oblivious nature of most data structures used by these systems. In this paper, we are particularly interested in consistent hashing, a fundamental building block in many large distributed systems. Our work is motivated by the hypothesis that a more adaptive approach to consistent hashing can leverage structure in the demand, and hence improve storage utilization and reduce access time. We initiate the study of demand-aware consistent hashing. Our main contribution is H&A, a constant-competitive online algorithm (i.e., it comes with provable performance guarantees over time). H&A is demand-aware and optimizes its internal structure to enable faster access times, while offering a high utilization of storage. We further evaluate H&A empirically. Comment: This paper has been accepted to International Conference on Principles of Distributed Systems (OPODIS 2024)
Databáze:	arXiv
Externí odkaz:	http://arxiv.org/abs/2411.11665 Zobrazit plný text záznamu View this record from Arxiv