Test suite reduction for fault detection and localization: A combined approach

László Vidács, Árpád Beszédes, Dávid Tengeri, István Siket, Tibor Gyimóthy

Research output: Contribution to conferencePaper

15 Citations (Scopus)

Abstract

The relation of test suites and actual faults in a software is of critical importance for timely product release. There are two particularily critical properties of test suites to this end: fault localization capability, to characterize the effort of finding the actually defective program elements, and fault detection capability which measures how probable is their manifestation and detection in the first place. While there are well established methods to predict fault detection capability (by measuring code coverage, for instance), characterization of fault localization is an emerging research topic. In this work, we investigate the effect of different test reduction methods on the performance of fault localization and detection techniques. We also provide new combined methods that incorporate both localization and detection aspects. We empirically evaluate the methods first by measuring detection and localization metrics of test suites with various reduction sizes, followed by how reduced test suites perform with actual faults. We experiment with SIR programs traditionally used in fault localization research, and extend the case study with large industrial software systems including GCC and WebKit.

Original languageEnglish
Pages204-213
Number of pages10
DOIs
Publication statusPublished - Jan 1 2014
Event2014 1st Software Evolution Week - IEEE Conference on Software Maintenance, Reengineering, and Reverse Engineering, CSMR-WCRE 2014 - Antwerp, Belgium
Duration: Feb 3 2014Feb 6 2014

Other

Other2014 1st Software Evolution Week - IEEE Conference on Software Maintenance, Reengineering, and Reverse Engineering, CSMR-WCRE 2014
CountryBelgium
CityAntwerp
Period2/3/142/6/14

ASJC Scopus subject areas

  • Software

Fingerprint Dive into the research topics of 'Test suite reduction for fault detection and localization: A combined approach'. Together they form a unique fingerprint.

  • Cite this

    Vidács, L., Beszédes, Á., Tengeri, D., Siket, I., & Gyimóthy, T. (2014). Test suite reduction for fault detection and localization: A combined approach. 204-213. Paper presented at 2014 1st Software Evolution Week - IEEE Conference on Software Maintenance, Reengineering, and Reverse Engineering, CSMR-WCRE 2014, Antwerp, Belgium. https://doi.org/10.1109/CSMR-WCRE.2014.6747172