Advanced search
Start date
Betweenand
Related content
(Reference retrieved automatically from Web of Science through information on FAPESP grant and its corresponding number as mentioned in the publication by the authors.)

A systematic literature review of techniques and metrics to reduce the cost of mutation testing

Full text
Author(s):
Pizzoleto, Alessandro Viola [1] ; Ferrari, Fabiano Cutigi [2, 1, 3] ; Offutt, Jeff [3] ; Fernandes, Leo [4] ; Ribeiro, Marcio [5]
Total Authors: 5
Affiliation:
[1] Univ Fed Sao Carlos, Comp Dept, Sao Carlos, SP - Brazil
[2] George Mason Univ, Fairfax, VA 22030 - USA
[3] George Mason Univ, Dept Comp Sci, Fairfax, VA 22030 - USA
[4] Fed Inst Alagoas, Informat Coordinat, Maceio, AL - Brazil
[5] Univ Fed Alagoas, Comp Inst, Maceio, AL - Brazil
Total Affiliations: 5
Document type: Review article
Source: JOURNAL OF SYSTEMS AND SOFTWARE; v. 157, NOV 2019.
Web of Science Citations: 1
Abstract

Historically, researchers have proposed and applied many techniques to reduce the cost of mutation testing. It has become difficult to find all techniques and to understand the cost-benefit tradeoffs among them, which is critical to transitioning this technology to practice. This paper extends a prior workshop paper to summarize and analyze the current knowledge about reducing the cost of mutation testing through a systematic literature review. We selected 175 peer-reviewed studies, from which 153 present either original or updated contributions. Our analysis resulted in six main goals for cost reduction and 21 techniques. In the last decade, a growing number of studies explored techniques such as selective mutation, evolutionary algorithms, control-flow analysis, and higher-order mutation. Furthermore, we characterized 18 metrics, with particular interest in the number of mutants to be executed, test cases required, equivalent mutants generated and detected, and mutant execution speedup. We found that cost reduction for mutation is increasingly becoming interdisciplinary, often combining multiple techniques. Additionally, measurements vary even for studies that use the same techniques. Researchers can use our results to find more detailed information about particular techniques, and to design comparable and reproducible experiments. (C) 2019 Elsevier Inc. All rights reserved. (AU)

FAPESP's process: 16/21251-0 - Investigation and Automation of Cost Reduction Techniques for Mutation Testing
Grantee:Fabiano Cutigi Ferrari
Support Opportunities: Scholarships abroad - Research