An extensible infrastructure for planning, running, analyzing and packaging experiments in software engineering

• Grant number: 18/22064-4
• Support Opportunities: Regular Research Grants
• Start date: July 01, 2019
• End date: September 30, 2021
• Field of knowledge: Physical Sciences and Mathematics - Computer Science - Computer Systems
• Principal Investigator: Fábio Fagundes Silveira
• Grantee: Fábio Fagundes Silveira
• Host Institution: Instituto de Ciência e Tecnologia (ICT). Universidade Federal de São Paulo (UNIFESP). Campus São José dos Campos. São José dos Campos , SP, Brazil
• Associated researchers: Alessandro Fabricio Garcia ; Eduardo Martins Guerra ; Otávio Augusto Lazzarini Lemos ; Tiago Silva da Silva

Abstract

One of the main objectives of Empirical Software Engineering is the improvement of methods, techniques, and tools for Software Engineering (SE) through the conduction and execution of experiments. Although research in empirical software engineering is well established in the literature, it is possible to verify that there are few supporting environments for conducting experiments, despite the increasing demand for this kind of study within the SE community. Moreover, existing approaches lack a number of important features. For instance, they do not offer extensible mechanisms for all required phases of experimentation in the different domains of SE, integration with existing software development environments, ways of how to define metrics to be collected, automatic organization mechanisms to analyze collected data using a specific statistical analyzes method, and remote execution of experiments. In this way, the primary objective of this research is to develop a computational infrastructure for the stages of the experimentation process, supporting extension and customization for the types of empirical SE studies, into the domain of Software Testing. Furthermore, such an infrastructure shall provide innovation and improvements concerning the proposed approaches in the literature. In order to show the feasibility of the proposed infrastructure, we plan to conduct several validation steps, including the application of User eXperience (UX) and Developer eXperience (DX). As part of the assessment of the approach, we will also reproduce previous experimental studies carried out by our research group to see whether reproductions of experiments is feasible through the proposed computational infrastructure. (AU)

Scientific publications

(References retrieved automatically from Web of Science and SciELO through information on FAPESP grants and their corresponding numbers as mentioned in the publications by the authors)

SILVEIRA, FABIO FAGUNDES; AVANCINI, RODRIGO; FRANCA, DAVID DE SOUZA; GUERRA, EDUARDO MARTINS; DA SILVA, TIAGO SILVA; GERVASI, O; MURGANTE, B; MISRA, S; GARAU, C; BLECIC, I; et al. Towards an Extensible Architecture for an Empirical Software Engineering Computational Platform. COMPUTATIONAL SCIENCE AND ITS APPLICATIONS, ICCSA 2021, PT IX, v. 12957, p. 16-pg., 2021-01-01. (18/22064-4)

DE OLIVEIRA JUNIOR, CLEVIO ORLANDO; CARVALHO, JONATHAN; SILVEIRA, ABIO FAGUNDES; DA SILVA, TIAGO SILVA; GUERRA, EDUARDO MARTINS; GERVASI, O; MURGANTE, B; MISRA, S; ROCHA, AMAC; GARAU, C. CALint: A Tool for Enforcing the Clean Architecture's Dependency Rule in Python. COMPUTATIONAL SCIENCE AND ITS APPLICATIONS - ICCSA 2022 WORKSHOPS, PART V, v. 13381, p. 16-pg., 2022-01-01. (18/22064-4)

AVANCINI, RODRIGO; SILVEIRA, FABIO FAGUNDES; GUERRA, EDUARDO MARTINS; ANDRADE, PEDRO R.; GERVASI, O; MURGANTE, B; MISRA, S; GARAU, C; BLECIC, I; TANIAR, D; et al. Software Visualization Tool for Evaluating API Usage in the Context of Software Ecosystems: A Proof of Concept. COMPUTATIONAL SCIENCE AND ITS APPLICATIONS - ICCSA 2020, PT VI, v. 12254, p. 16-pg., 2020-01-01. (18/22064-4)