CARD: A Congestion-Aware Request Dispatching Scheme for Replicated Metadata Server Cluster
| Autor: | Dongsheng Wang, Wang Zhanye, Haixia Wang, Shangming Cai |
|---|---|
| Rok vydání: | 2020 |
| Předmět: |
Scheme (programming language)
020203 distributed computing business.industry Computer science Stability (learning theory) 020206 networking & telecommunications Context (language use) 02 engineering and technology Load balancing (computing) Cluster (spacecraft) Metadata server Server Scalability 0202 electrical engineering electronic engineering information engineering business computer Computer network computer.programming_language |
| Zdroj: | ICPP |
| DOI: | 10.1145/3404397.3404411 |
| Popis: | Replicated metadata server cluster (RMSC) is highly efficient to be used in distributed filesystems while facing data-driven scenarios (e.g., massive-scale distributed machine learning tasks). Yet, when considering cost-effectiveness and system utilization, the cluster scale is commonly restricted in practice. Within this context, servers in the cluster start to suffer from load-oscillations at higher system utilization due to clients’ congestion-unaware behaviors and unintelligent selection strategies (i.e., servers in the cluster are preferred then evaded intermittently). The consequences brought by load-oscillations degrade the overall performance of the whole system to some extent. One solution to tackle this problem is having clients share a part of the responsibility and behave more wisely for stability concerns. So in this paper, we present a Congestion-Aware Request Dispatching scheme, CARD, which is mainly conducted at clients and directed by a rate control mechanism. Through extensive experiments, we verify that CARD is highly efficient in resolving load-oscillations in RMSC. Apart from this, our results show that RMSC with our congestion-aware based optimization achieves better scalability compared to previous implementations under targeted workloads, especially in heterogeneous environments. |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|