Evaluating Software testability can assist software managers in optimizing testing budgets and identifying opportunities for refactoring. In this paper, we abandon the traditional approach of pursuing testability measurements based on the correlation between software metrics and test characteristics observed on past projects, e.g., the size, the organization or the code coverage of the test cases. We propose a radically new approach that exploits automatic test generation and mutation analysis to quantify the amount of evidence about the relative hardness of identifying effective test cases. We introduce two novel evidence-based testability metrics, describe a prototype to compute them, and discuss initial findings on whether our measurements can reflect actual testability issues.

Guglielmo, L., Riboni, A., Denaro, G. (2021). Towards Evidence-Based Testability Measurements. In 2021 IEEE/ACM 43rd International Conference on Software Engineering: New Ideas and Emerging Results (ICSE-NIER) (pp.76-80). IEEE Computer Society [10.1109/ICSE-NIER52604.2021.00024].

Towards Evidence-Based Testability Measurements

Guglielmo, Luca;Riboni, Andrea;Denaro, Giovanni
2021

Abstract

Evaluating Software testability can assist software managers in optimizing testing budgets and identifying opportunities for refactoring. In this paper, we abandon the traditional approach of pursuing testability measurements based on the correlation between software metrics and test characteristics observed on past projects, e.g., the size, the organization or the code coverage of the test cases. We propose a radically new approach that exploits automatic test generation and mutation analysis to quantify the amount of evidence about the relative hardness of identifying effective test cases. We introduce two novel evidence-based testability metrics, describe a prototype to compute them, and discuss initial findings on whether our measurements can reflect actual testability issues.
paper
mutation analysis; Software testability; test case generation;
English
43rd ACM/IEEE International Conference on Software Engineering: New Ideas and Emerging Results, ICSE-NIER 2021 - 25 May 2021 through 28 May 2021
2021
2021 IEEE/ACM 43rd International Conference on Software Engineering: New Ideas and Emerging Results (ICSE-NIER)
9780738133249
2021
76
80
https://arxiv.org/abs/2102.10877
open
Guglielmo, L., Riboni, A., Denaro, G. (2021). Towards Evidence-Based Testability Measurements. In 2021 IEEE/ACM 43rd International Conference on Software Engineering: New Ideas and Emerging Results (ICSE-NIER) (pp.76-80). IEEE Computer Society [10.1109/ICSE-NIER52604.2021.00024].
File in questo prodotto:
File Dimensione Formato  
2102.10877.pdf

accesso aperto

Tipologia di allegato: Submitted Version (Pre-print)
Dimensione 123.91 kB
Formato Adobe PDF
123.91 kB Adobe PDF Visualizza/Apri

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/10281/325021
Citazioni
  • Scopus 2
  • ???jsp.display-item.citation.isi??? 1
Social impact