Full-Stack Architecting to Achieve a Billion-Requests-Per-Second Throughput on a Single Key-Value Store Server Platform
| Autor: | Sheng Li, Suk-Han Lee, David G. Andersen, Victor W. Lee, Michael Kaminsky, Hyeontaek Lim, Anuj Kalia, Pradeep Dubey, Seongil O, Jung Ho Ahn |
|---|---|
| Rok vydání: | 2016 |
| Předmět: |
010302 applied physics
General Computer Science Exploit business.industry Computer science Quality of service 02 engineering and technology computer.software_genre 01 natural sciences 020202 computer hardware & architecture Concurrency control Software Embedded system 0103 physical sciences 0202 electrical engineering electronic engineering information engineering Operating system Data center Web service business Throughput (business) computer Efficient energy use |
| Zdroj: | ACM Transactions on Computer Systems. 34:1-30 |
| ISSN: | 1557-7333 0734-2071 |
| DOI: | 10.1145/2897393 |
| Popis: | Distributed in-memory key-value stores (KVSs), such as memcached, have become a critical data serving layer in modern Internet-oriented data center infrastructure. Their performance and efficiency directly affect the QoS of web services and the efficiency of data centers. Traditionally, these systems have had significant overheads from inefficient network processing, OS kernel involvement, and concurrency control. Two recent research thrusts have focused on improving key-value performance. Hardware-centric research has started to explore specialized platforms including FPGAs for KVSs; results demonstrated an order of magnitude increase in throughput and energy efficiency over stock memcached. Software-centric research revisited the KVS application to address fundamental software bottlenecks and to exploit the full potential of modern commodity hardware; these efforts also showed orders of magnitude improvement over stock memcached. We aim at architecting high-performance and efficient KVS platforms, and start with a rigorous architectural characterization across system stacks over a collection of representative KVS implementations. Our detailed full-system characterization not only identifies the critical hardware/software ingredients for high-performance KVS systems but also leads to guided optimizations atop a recent design to achieve a record-setting throughput of 120 million requests per second (MRPS) (167MRPS with client-side batching) on a single commodity server. Our system delivers the best performance and energy efficiency (RPS/watt) demonstrated to date over existing KVSs including the best-published FPGA-based and GPU-based claims. We craft a set of design principles for future platform architectures, and via detailed simulations demonstrate the capability of achieving a billion RPS with a single server constructed following our principles. |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|