On the State of NoSQL Benchmarks
Autor: | Vincent Reniers, Ansar Rafique, Dimitri Van Landuyt, Wouter Joosen |
---|---|
Rok vydání: | 2017 |
Předmět: |
Database
Computer science business.industry Suite Big data Cloud computing 02 engineering and technology Benchmarking computer.software_genre NoSQL 020204 information systems 0202 electrical engineering electronic engineering information engineering Benchmark (computing) 020201 artificial intelligence & image processing State (computer science) business computer Strengths and weaknesses |
Zdroj: | ICPE Companion |
DOI: | 10.1145/3053600.3053622 |
Popis: | The proliferation of Big Data systems and namely NoSQL databases has resulted in a tremendous heterogeneity in its offerings. It has become increasingly difficult to compare and select the most optimal NoSQL storage technology. Current benchmark efforts, such as the Yahoo! Cloud Serving Benchmark (YCSB), evaluate simple read and write operations on a primary key. However, while YCSB has become the de-facto benchmark solution for practitioners and NoSQL vendors, it is lacking in capabilities to extensively evaluate specific NoSQL solutions.In this paper, we present a systematic survey of current NoSQL benchmarks, in which we identify a clear gap in benchmarking more advanced workloads (e.g. nested document search) for features specific to NoSQL database families (e.g. document stores). Secondly, based on our survey, we discuss the strengths and weaknesses of the different benchmark design approaches, and argue in favor of a benchmark suite that targets specific families of NoSQL databases yet still allows overall comparison of databases in terms of their commonalities. |
Databáze: | OpenAIRE |
Externí odkaz: |