The 2013 Evaluation of SMT-COMP and SMT-LIB

Autor:	Tjark Weber, David R. Cok, Aaron Stump
Rok vydání:	2015
Předmět:	Model checking Computational Theory and Mathematics Artificial Intelligence Computer science business.industry Steering committee Key (cryptography) Parallel computing Software engineering business Software
Zdroj:	Journal of Automated Reasoning. 55:61-90
ISSN:	1573-0670 0168-7433
DOI:	10.1007/s10817-015-9328-2
Popis:	After 8 years of SMT Competitions, the SMT Steering Committee decided, for 2013, to sponsor an evaluation of the status of SMT benchmarks and solvers, rather than another competition. This report summarizes the results of the evaluation, conducted by the authors. The key observations are that (1) the competition results are quite sensitive to randomness and (2) the most significant need for the future is assessment and improvement of benchmarks in the light of SMT applications. The evaluation also measured competitiveness of solvers, general coverage of solvers, logics, and benchmarks, and degree of repeatability of measurements and competitions.
Databáze:	OpenAIRE
Externí odkaz:	https://explore.openaire.eu/search/publication?articleId=doi_________::57e12cad02e983a26f349d94ced38f07 https://doi.org/10.1007/s10817-015-9328-2 Zobrazit plný text záznamu Full text from SpringerLink