Sharma, Tushar;
Georgiou, Stefanos;
Kechagia, Maria;
Ghaleb, Taher A;
Sarro, Federica;
(2023)
Investigating developers' perception on software testability and its effects.
Empirical Software Engineering
, 28
, Article 120. 10.1007/s10664-023-10373-0.
Preview |
Text
Testability_EMSE.pdf - Accepted Version Download (1MB) | Preview |
Abstract
The opinions and perspectives of software developers are highly regarded in software engineering research. The experience and knowledge of software practitioners are frequently sought to validate assumptions and evaluate software engineering tools, techniques, and methods. However, experimental evidence may unveil further or different insights, and in some cases even contradict developers’ perspectives. In this work, we investigate the correlation between software developers’ perspectives and experimental evidence about testability smells (i.e., programming practices that may reduce the testability of a software system). Specifically, we first elicit opinions and perspectives of software developers through a questionnaire survey on a catalog of four testability smells, we curated for this work. We also extend our tool DESIGNITEJAVA to automatically detect these smells in order to gather empirical evidence on testability smells. To this end we conduct a large-scale empirical study on 1,115 Java repositories containing approximately 46 million lines of code to investigate the relationship of testability smells with test quality, number of tests, and reported bugs. Our results show that testability smells do not correlate with test smells at the class granularity or with test suit size. Furthermore, we do not find a causal relationship between testability smells and bugs. Moreover, our results highlight that the empirical evidence does not match developers’ perspective on testability smells. Thus, suggesting that despite developers’ invaluable experience, their opinions and perspectives might need to be complemented with empirical evidence before bringing it into practice. This further confirms the importance of data-driven software engineering, which advocates the need and value of ensuring that all design and development decisions are supported by data.
| Type: | Article |
|---|---|
| Title: | Investigating developers' perception on software testability and its effects |
| Open access status: | An open access version is available from UCL Discovery |
| DOI: | 10.1007/s10664-023-10373-0 |
| Publisher version: | https://doi.org/10.1007/s10664-023-10373-0 |
| Language: | English |
| Additional information: | This version is the author accepted manuscript. For information on re-use, please refer to the publisher’s terms and conditions. |
| Keywords: | Software testability, Software test quality, Testability smells, Developers’ opinions and perspectives, Software quality |
| UCL classification: | UCL UCL > Provost and Vice Provost Offices > UCL BEAMS UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science > Dept of Computer Science |
| URI: | https://discovery-pp.ucl.ac.uk/id/eprint/10176074 |
Archive Staff Only
 |
View Item |
