Optimizing the Response Time of Memcached Systems via Model and Quantitative Analysis
| Autor: | Wenxue Cheng, Wanchun Jiang, Tong Zhang, Fengyuan Ren |
|---|---|
| Rok vydání: | 2021 |
| Předmět: | |
| Zdroj: | IEEE Transactions on Computers. 70:1458-1471 |
| ISSN: | 2326-3814 0018-9340 |
| DOI: | 10.1109/tc.2020.3011619 |
| Popis: | Memcached is a widely used in-memory caching solution in large-scale searching scenarios. The most crucial metric of Memcached systems is the response time, which is affected by various factors such as workload, service rate, unbalanced load distribution, and cache miss ratio. This article aims to quantify the influence of each factor on the response time of Memcached systems. First, we establish a theoretical model for Memcached systems that captures their main features, including burst and concurrent key arrival, unbalanced load distribution, and cache miss process. By solving this model using queuing and stochastic theories, we obtain an estimate of the response time in Memcached systems. Intensive experiments based on real-world components demonstrate that the estimate always matches perfectly with the actual value. Furthermore, we obtain a comprehensive and quantitative understanding of all factors. The main insights are threefold. 1) There exists an optimum range of utilization at Memcached servers in which the response time is kept at a low level with a small penalty. 2) The influence of the cache miss ratio on the response time is logarithmic rather than linear. 3) The number of keys generated from an end-user request has the greatest impact in Memcached systems. |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|