Integration of Software Testing to Programming Assignments: An Experimental Study

Author(s)

Avellar, Gustavo M. N. ; da Silva, Rogerio F. ; Scalalon, Lilian P. ; Andrade, Stevao A. ; Delamaro, Marcio E. ; Barbosa, Ellen F. ; IEEE

• Document type: Journal article
• Source: 2019 IEEE FRONTIERS IN EDUCATION CONFERENCE (FIE 2019); v. N/A, p. 9-pg., 2019-01-01.

Abstract

This Research Full Paper reinforces that Software Testing can be a helpful practice to students while working on programming assignments. Considering Software Testing as a process, the testing activity is composed by a sequence of steps. When students write and submit their own test cases, they are responsible for the test design, automation, execution, and evaluation. Otherwise, instructors can provide ready-made test suites, needing only to execute it and evaluate it. In this scenario, we conducted an experimental study to investigate how the programming performance of students from the Computer Science area is affected when Software Testing is integrated with progranuning. We proposed three different approaches: (i) ad hoc programming; (ii) programming and testing by writing the test suite; and (iii) programming and testing with a readymade test suite. We assessed students' programs in terms of correctness, measured by the pass rate of the reference test suite. Results indicate that students had a lower performance with ad hoc programming in comparison with both approaches involving Software Testing. On the other hand, using ready-made test cases raised better results than when students had to write their own lest cases. We also assessed students' attitudes towards testing by means of a survey. (AU)

• FAPESP's process: 14/06656-8 - Subsidies to the Conduction of Experiments in the Teaching of Programming Foundations
• Grantee: Lilian Passos Scatalon
• Support Opportunities: Scholarships in Brazil - Doctorate