Benchmarking Static Code Analyzers
| Autor: | Christoph Mallon, Reinhard Wilhelm, Daniel Kästner, Jörg Herter |
|---|---|
| Rok vydání: | 2017 |
| Předmět: |
021110 strategic
defence & security studies 021103 operations research Computer science business.industry Process (engineering) 0211 other engineering and technologies Static program analysis 02 engineering and technology Benchmarking Static analysis Machine learning computer.software_genre Set (abstract data type) Institution (computer science) Operating system Benchmark (computing) Code (cryptography) Artificial intelligence business computer |
| Zdroj: | Lecture Notes in Computer Science ISBN: 9783319662657 SAFECOMP |
| DOI: | 10.1007/978-3-319-66266-4_13 |
| Popis: | We show that a widely used benchmark set for the comparison of static analysis tools exhibits an impressive number of weaknesses, and that the internationally accepted quantitative evaluation metrics may lead to useless results. The weaknesses in the benchmark set were identified by applying a sound static analysis to the programs in this set and carefully interpreting the results. We propose how to deal with weaknesses of the quantitative metrics and how to improve such benchmarks and the evaluation process, in particular for external evaluations, in which an ideally neutral institution does the evaluation, whose results potential clients can trust. |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|