A systematic literature review of techniques and metrics to reduce the cost of mutation testing

Autor(es)

Pizzoleto, Alessandro Viola ^[1] ; Ferrari, Fabiano Cutigi ^{[2, 1, 3]} ; Offutt, Jeff ^[3] ; Fernandes, Leo ^[4] ; Ribeiro, Marcio ^[5]

Afiliação do(s) autor(es)

^[1] Univ Fed Sao Carlos, Comp Dept, Sao Carlos, SP - Brazil

^[2] George Mason Univ, Fairfax, VA 22030 - USA

^[3] George Mason Univ, Dept Comp Sci, Fairfax, VA 22030 - USA

^[4] Fed Inst Alagoas, Informat Coordinat, Maceio, AL - Brazil

^[5] Univ Fed Alagoas, Comp Inst, Maceio, AL - Brazil

• Tipo de documento: Artigo de Revisão
• Fonte: JOURNAL OF SYSTEMS AND SOFTWARE; v. 157, NOV 2019.
• Citações Web of Science: 1

Resumo

Historically, researchers have proposed and applied many techniques to reduce the cost of mutation testing. It has become difficult to find all techniques and to understand the cost-benefit tradeoffs among them, which is critical to transitioning this technology to practice. This paper extends a prior workshop paper to summarize and analyze the current knowledge about reducing the cost of mutation testing through a systematic literature review. We selected 175 peer-reviewed studies, from which 153 present either original or updated contributions. Our analysis resulted in six main goals for cost reduction and 21 techniques. In the last decade, a growing number of studies explored techniques such as selective mutation, evolutionary algorithms, control-flow analysis, and higher-order mutation. Furthermore, we characterized 18 metrics, with particular interest in the number of mutants to be executed, test cases required, equivalent mutants generated and detected, and mutant execution speedup. We found that cost reduction for mutation is increasingly becoming interdisciplinary, often combining multiple techniques. Additionally, measurements vary even for studies that use the same techniques. Researchers can use our results to find more detailed information about particular techniques, and to design comparable and reproducible experiments. (C) 2019 Elsevier Inc. All rights reserved. (AU)

• Processo FAPESP: 16/21251-0 - Investigação e Automatização de Técnicas de Redução de Custo do Teste de Mutação
• Beneficiário: Fabiano Cutigi Ferrari
• Modalidade de apoio: Bolsas no Exterior - Pesquisa