Creating a Virtuous Cycle in Performance Testing at MongoDB
| Autor: | David M. Daly |
|---|---|
| Rok vydání: | 2021 |
| Předmět: |
FOS: Computer and information sciences
Computer Science - Performance Process (engineering) Computer science Software performance testing Databases (cs.DB) Investment (macroeconomics) Virtuous circle and vicious circle Reliability engineering Software Engineering (cs.SE) Performance (cs.PF) Computer Science - Software Engineering Computer Science - Databases Order (exchange) Component (UML) State (computer science) Set (psychology) |
| Zdroj: | ICPE |
| DOI: | 10.48550/arxiv.2101.10231 |
| Popis: | It is important to detect changes in software performance during development in order to avoid performance decreasing release to release or dealing with costly delays at release time. Performance testing is part of the development process at MongoDB, and integrated into our continuous integration system. We describe a set of changes to that performance testing environment designed to improve testing effectiveness. These changes help improve coverage, provide faster and more accurate signaling for performance changes, and help us better understand the state of performance. In addition to each component performing better, we believe that we have created and exploited a virtuous cycle: performance test improvements drive impact, which drives more use, which drives further impact and investment in improvements. Overall, MongoDB is getting faster and we avoid shipping major performance regressions to our customers because of this infrastructure. Comment: Author's copy and preprint. Accepted for publication at ICPE2021. 9 pages, 5 figures |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|