Test suites should test exceptional behavior to detect faults in errorhandling code. However, manually-written test suites tend to neglect exceptional behavior. Automatically-generated test suites, on the other hand, lack test oracles that verify whether runtime exceptions are the expected behavior of the code under test. This paper proposes a technique that automatically creates test oracles for exceptional behaviors from Javadoc comments. The technique uses a combination of natural language processing and run-time instrumentation. Our implementation, Toradocu, can be combined with a test input generation tool. Our experimental evaluation shows that Toradocu improves the fault-finding effectiveness of EvoSuite and Randoop test suites by 8% and 16% respectively, and reduces EvoSuite's false positives by 33%.
Goffi, A., Gorla, A., Ernst, M., Pezze', M. (2016). Automatic generation of oracles for exceptional behaviors. In ISSTA 2016 - Proceedings of the 25th International Symposium on Software Testing and Analysis 18 July 2016 (pp.213-224). Association for Computing Machinery, Inc [10.1145/2931037.2931061].
Automatic generation of oracles for exceptional behaviors
PEZZE', MAURO
2016
Abstract
Test suites should test exceptional behavior to detect faults in errorhandling code. However, manually-written test suites tend to neglect exceptional behavior. Automatically-generated test suites, on the other hand, lack test oracles that verify whether runtime exceptions are the expected behavior of the code under test. This paper proposes a technique that automatically creates test oracles for exceptional behaviors from Javadoc comments. The technique uses a combination of natural language processing and run-time instrumentation. Our implementation, Toradocu, can be combined with a test input generation tool. Our experimental evaluation shows that Toradocu improves the fault-finding effectiveness of EvoSuite and Randoop test suites by 8% and 16% respectively, and reduces EvoSuite's false positives by 33%.File | Dimensione | Formato | |
---|---|---|---|
2931037.2931061.pdf
Solo gestori archivio
Tipologia di allegato:
Publisher’s Version (Version of Record, VoR)
Dimensione
330.83 kB
Formato
Adobe PDF
|
330.83 kB | Adobe PDF | Visualizza/Apri Richiedi una copia |
I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.