GitBug-Java: A Reproducible Benchmark of Recent Java Bugs

Autor: Silva, André, Saavedra, Nuno, Monperrus, Martin
Rok vydání: 2024
Předmět:
Zdroj: Proceedings of Mining Software Repositories Conference (MSR), 2024
Druh dokumentu: Working Paper
DOI: 10.1145/3643991.3644884
Popis: Bug-fix benchmarks are essential for evaluating methodologies in automatic program repair (APR) and fault localization (FL). However, existing benchmarks, exemplified by Defects4J, need to evolve to incorporate recent bug-fixes aligned with contemporary development practices. Moreover, reproducibility, a key scientific principle, has been lacking in bug-fix benchmarks. To address these gaps, we present GitBug-Java, a reproducible benchmark of recent Java bugs. GitBug-Java features 199 bugs extracted from the 2023 commit history of 55 notable open-source repositories. The methodology for building GitBug-Java ensures the preservation of bug-fixes in fully-reproducible environments. We publish GitBug-Java at https://github.com/gitbugactions/gitbug-java.
Comment: Accepted to MSR '24
Databáze: arXiv