Investigation and Automation of Cost Reduction Techniques for Mutation Testing

• Grant number: 16/21251-0
• Support Opportunities: Scholarships abroad - Research
• Start date: October 01, 2017
• End date: September 30, 2018
• Field of knowledge: Physical Sciences and Mathematics - Computer Science - Computing Methodologies and Techniques
• Principal Investigator: Fabiano Cutigi Ferrari
• Grantee: Fabiano Cutigi Ferrari
• Host Investigator: Andrew Jefferson Offutt
• Host Institution: Centro de Ciências Exatas e de Tecnologia (CCET). Universidade Federal de São Carlos (UFSCAR). São Carlos , SP, Brazil
• Institution abroad: George Mason University, United States

Abstract

Context: The Mutant Analysis test selection criterion, also known as mutation testing, is an important option for the evaluation of both software systems and test sets that are used to validate them. However, mutation testing imposes high application cost. Due to this, cost reduction techniques are on focus, aiming at reducing significantly the cost of this criterion, without compromising the quality of derived test sets.Problem Definition: Results yielded by such cost reduction techniques are valid only for restricted groups of programs, as highlighted in related research. The question that persists regards the usefulness of such results to be applied to untested programs.Goal: The general aim of this proposal is the definition of a strategy for the application of cost reduction techniques for mutation testing that reuses empirical knowledge gathered from previous studies.Method: Initially, we will characterise the state-of-the-art with respect to cost reduction techniques for mutation testing. We will rank the best techniques in order to define a strategy for their application. The intended strategy will tank into account the similarity between tested programs and programs to which cost reduction techniques will be applied. Results will be assessed with respect to the quality of the newly created tests.

Scientific publications

(7)

(References retrieved automatically from Web of Science and SciELO through information on FAPESP grants and their corresponding numbers as mentioned in the publications by the authors)

PIZZOLETO, ALESSANDRO, V; FERRARI, FABIANO C.; DALLILO, LUCAS D.; OFFUTT, JEFF; IEEE. SiMut: Exploring Program Similarity to Support the Cost Reduction of Mutation Testing. 2020 IEEE 13TH INTERNATIONAL CONFERENCE ON SOFTWARE TESTING, VERIFICATION AND VALIDATION WORKSHOPS (ICSTW), v. N/A, p. 10-pg., 2020-01-01. (16/21251-0)

DALLILO, LUCAS DINIZ; PIZZOLETO, ALESSANDRO VIOLA; FERRARI, FABIANO CUTIGI; ACM. An Evaluation of Internal Program Metrics as Predictors of Mutation Operator Score. SAST 2019: PROCEEDINGS OF THE IV BRAZILIAN SYMPOSIUM ON SYSTEMATIC AND AUTOMATED SOFTWARE TESTING, v. N/A, p. 10-pg., 2019-01-01. (16/21251-0)

GUARNIERI, GIOVANNI F.; PIZZOLETO, ALESSANDRO, V; FERRARI, FABIANO C.; IEEE COMP SOC. An Automated Framework for Cost Reduction of Mutation Testing Based on Program Similarity. 2022 IEEE 15TH INTERNATIONAL CONFERENCE ON SOFTWARE TESTING, VERIFICATION AND VALIDATION WORKSHOPS (ICSTW 2022), v. N/A, p. 10-pg., 2022-01-01. (16/21251-0)

FERRARI, FABIANO CUTIGI; PIZZOLETO, ALESSANDRO VIOLA; OFFUTT, JEFF; IEEE. A Systematic Review of Cost Reduction Techniques for Mutation Testing: Preliminary Results. 2018 IEEE 11TH INTERNATIONAL CONFERENCE ON SOFTWARE TESTING, VERIFICATION AND VALIDATION WORKSHOPS (ICSTW), v. N/A, p. 10-pg., 2018-01-01. (16/21251-0)

PIZZOLETO, ALESSANDRO VIOLA; FERRARI, FABIANO CUTIGI; OFFUTT, JEFF; FERNANDES, LEO; RIBEIRO, MARCIO. A systematic literature review of techniques and metrics to reduce the cost of mutation testing. JOURNAL OF SYSTEMS AND SOFTWARE, v. 157, NOV 2019. (16/21251-0)

PINHEIRO, PEDRO; VIANA, JOSE CARLOS; RIBEIRO, MARCIO; FERNANDES, LEO; FERRARI, FABIANO; GHEYI, ROHIT; FONSECA, BALDOINO. Mutating code annotations: An empirical evaluation on Java and C# programs. SCIENCE OF COMPUTER PROGRAMMING, v. 191, JUN 1 2020. (16/21251-0)

FERRARI, FABIANO C.; DURELLI, VINICIUS H. S.; ANDLER, STEN F.; OFFUTT, JEFF; SAADATMAND, MEHRDAD; MULLNER, NILS. On transforming model-based tests into code: A systematic literature review. SOFTWARE TESTING VERIFICATION & RELIABILITY, v. N/A, p. 32-pg., 2023-09-07. (16/21251-0)