Performance Metamorphic Testing: A Proof of Concept
| Autor: | Segura Rueda, Sergio, Troya Castilla, Javier, Durán Toro, Amador, Ruiz Cortés, Antonio |
|---|---|
| Přispěvatelé: | Universidad de Sevilla. Departamento de Lenguajes y Sistemas Informáticos, Universidad de Sevilla. TIC205: Ingeniería del Software Aplicada |
| Rok vydání: | 2018 |
| Předmět: | |
| Zdroj: | idUS: Depósito de Investigación de la Universidad de Sevilla Universidad de Sevilla (US) idUS. Depósito de Investigación de la Universidad de Sevilla instname |
| Popis: | Context. Performance testing is a challenging task mainly due to the lack of test oracles, i.e. mechanisms to decide whether the performance of a program is acceptable or not because of a bug. Metamorphic testing enables the generation of test cases in the absence of an oracle by exploiting the so–called metamorphic relations between the inputs and outputs of multiple executions of the program under test. In the last two decades, metamorphic testing has been successfully used to detect functional faults in di erent domains. However, its applicability to performance testing remains unexplored. Objective. We propose the application of metamorphic testing to reveal performance failures. Method. We define Performance Metamorphic Relations (PMRs) as expected relations between performance measurements of multiple executions of the program under test. These relations can be turned into assertions for the automated detection of performance bugs, removing the need for complex benchmarks and domain experts guidance. As a further benefit, PMRs can be turned into fitness functions to guide search–based techniques on the generation of test data. Results. The feasibility of the approach is illustrated through an experimental proof of concept in the context of the automated analysis of feature models. Conclusion. The results confirm the potential of metamorphic testing, in combination with search-based techniques, to automate the detection of performance bugs. Comisión Interministerial de Ciencia y Tecnología TIN2015-70560-R Comisión Interministerial de Ciencia y Tecnología TIN2015-71841 Junta de Andalucía P12-TIC-1867 |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|