Study and evaluation of mutation test parameterization alternatives aiming at its use in software systems production environments

• Grant number: 23/00001-9
• Support Opportunities: Scholarships abroad - Research
• Start date: August 15, 2023
• End date: August 14, 2024
• Field of knowledge: Physical Sciences and Mathematics - Computer Science - Computing Methodologies and Techniques
• Principal Investigator: Auri Marcelo Rizzo Vincenzi
• Grantee: Auri Marcelo Rizzo Vincenzi
• Host Investigator: Ana Cristina Ramada Paiva
• Host Institution: Centro de Ciências Exatas e de Tecnologia (CCET). Universidade Federal de São Carlos (UFSCAR). São Carlos , SP, Brazil
• Institution abroad: Universidade do Porto (UP), Portugal

Abstract

Considering the relevance of automating testing activities for the software production industry and the relevance of mutation-based testing based on scientific evidence, in the regular research project (FAPESP nº 2019/23160-0), entitled "Software Testing Based on Mutation with High Efficiency and Low Technical Debt: Automated Process and Prototype of Free Support Environment" seeks to develop a prototype environment to support mutation testing that is 100% automated, or that is, do not require human interaction or minimize the need for human intervention. Objective: This BPE project aims to carry out a series of experimental studies, considering real software products (proprietary or open source), which allows demonstrating the feasibility of conducting the mutation test in this context, what the results obtained, and how the prototype can support quality assurance in software systems production environments. These experimental studies are a subset of the activities under execution in the regular research project (FAPESP nº 2019/23160-0). Methods: Experimental studies allow thecollection of metrics about the product under test and data from the execution of the mutation test considering different alternatives to reduce the application cost, aiming to demonstrate which are the best alternatives for using this test criterion in real software products, considering time and cost constraints imposed on projects. Expected Results: With this, it is expected the definition of basic guidelines for the use of mutation testing in real software development environments in an automated way, considering the time and cost restrictions imposed on the project. Note that such guidelines should vary based on metrics collected for the software products under testing. Conclusions: The configuration of the prototype to support the application of the mutation test in a 100% automated way demands alternatives for parameterization of the mutation test in order to prioritize what to test of the product under test and which strategies to use for mutation testing should be used to obtain the best cost/benefit ratio. Due to the proven effectiveness of mutation testing in the detection of defects, the use of the technique in real software development environments is already a reality, but still little explored on a large scale, and, with these studies and prototypes, it is expected to provide subsidies for that more companies can use mutation testing in their quality assurance processes. Furthermore, as a result of the period abroad, linked to this BPE project, it is expected to intensificate the cooperation between the research group of Profa. Dr. Ana Paiva and the proponent's research group. (AU)

Scientific publications

(5)

(References retrieved automatically from Web of Science and SciELO through information on FAPESP grants and their corresponding numbers as mentioned in the publications by the authors)

KUROISHI, PEDRO HENRIQUE; MALDONADO, JOSE CARLOS; VINCENZI, AURI MARCELO RIZZO. Towards the definition of a research agenda on mobile application testing based on a tertiary study. INFORMATION AND SOFTWARE TECHNOLOGY, v. 167, p. 22-pg., 2023-12-06. (23/00001-9, 19/23160-0)

GUERINO, LUCCA RENATO; KUROISHI, PEDRO HENRIQUE; RAMADA PAIVA, ANA CRISTINA; RIZZO VINCENZI, AURI MARCELO. Static and Dynamic Comparison of Mutation Testing Tools for Python. 23TH BRAZILIAN SYMPOSIUM ON SOFTWARE QUALITY, SBQS 2024, v. N/A, p. 11-pg., 2024-01-01. (23/00001-9, 19/23160-0)

KUROISHI, PEDRO HENRIQUE; PAIVA, ANA CRISTINA RAMADA; MALDONADO, JOSE CARLOS; VINCENZI, AURI MARCELO RIZZO. Testing infrastructures to support mobile application testing: A systematic mapping study. INFORMATION AND SOFTWARE TECHNOLOGY, v. 177, p. 19-pg., 2024-09-13. (23/00001-9, 19/23160-0)

VINCENZI, AURI M. R.; KUROISHI, PEDRO H.; BISPO, JOAO; DA VEIGA, ANA R. C.; DA MATA, DAVID R. C.; AZEVEDO, FRANCISCO B.; PAIVA, ANA C. R.. METFORD - Mutation tEsTing Framework fOR anDroid. JOURNAL OF SYSTEMS AND SOFTWARE, v. 222, p. 17-pg., 2025-01-27. (19/23160-0, 23/00001-9)

RINCON, ANDRE MESQUITA; RIZZO VINCENZI, AURI MARCELO; FARIA, JOAO PASCOAL. LLM Prompt Engineering for Automated White-Box Integration Test Generation in REST APIs. 2025 IEEE INTERNATIONAL CONFERENCE ON SOFTWARE TESTING, VERIFICATION AND VALIDATION WORKSHOPS, ICSTW, v. N/A, p. 8-pg., 2025-01-01. (19/23160-0, 23/00001-9)