UCL Discovery Stage
UCL home » Library Services » Electronic resources » UCL Discovery Stage

Investigating developers' perception on software testability and its effects

Sharma, Tushar; Georgiou, Stefanos; Kechagia, Maria; Ghaleb, Taher A; Sarro, Federica; (2023) Investigating developers' perception on software testability and its effects. Empirical Software Engineering , 28 , Article 120. 10.1007/s10664-023-10373-0. Green open access

[thumbnail of Testability_EMSE.pdf]
Preview
Text
Testability_EMSE.pdf - Accepted Version

Download (1MB) | Preview

Abstract

The opinions and perspectives of software developers are highly regarded in software engineering research. The experience and knowledge of software practitioners are frequently sought to validate assumptions and evaluate software engineering tools, techniques, and methods. However, experimental evidence may unveil further or different insights, and in some cases even contradict developers’ perspectives. In this work, we investigate the correlation between software developers’ perspectives and experimental evidence about testability smells (i.e., programming practices that may reduce the testability of a software system). Specifically, we first elicit opinions and perspectives of software developers through a questionnaire survey on a catalog of four testability smells, we curated for this work. We also extend our tool DESIGNITEJAVA to automatically detect these smells in order to gather empirical evidence on testability smells. To this end we conduct a large-scale empirical study on 1,115 Java repositories containing approximately 46 million lines of code to investigate the relationship of testability smells with test quality, number of tests, and reported bugs. Our results show that testability smells do not correlate with test smells at the class granularity or with test suit size. Furthermore, we do not find a causal relationship between testability smells and bugs. Moreover, our results highlight that the empirical evidence does not match developers’ perspective on testability smells. Thus, suggesting that despite developers’ invaluable experience, their opinions and perspectives might need to be complemented with empirical evidence before bringing it into practice. This further confirms the importance of data-driven software engineering, which advocates the need and value of ensuring that all design and development decisions are supported by data.

Type: Article
Title: Investigating developers' perception on software testability and its effects
Open access status: An open access version is available from UCL Discovery
DOI: 10.1007/s10664-023-10373-0
Publisher version: https://doi.org/10.1007/s10664-023-10373-0
Language: English
Additional information: This version is the author accepted manuscript. For information on re-use, please refer to the publisher’s terms and conditions.
Keywords: Software testability, Software test quality, Testability smells, Developers’ opinions and perspectives, Software quality
UCL classification: UCL
UCL > Provost and Vice Provost Offices > UCL BEAMS
UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science
UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science > Dept of Computer Science
URI: https://discovery-pp.ucl.ac.uk/id/eprint/10176074
Downloads since deposit
288Downloads
Download activity - last month
Download activity - last 12 months
Downloads by country - last 12 months

Archive Staff Only

View Item View Item