Test suite evaluation using code coverage based metrics

F. Horváth, Béla Vancsics, László Vidács, A. Beszédes, Dávid Tengeri, Tamás Gergely, T. Gyimóthy

Research output: Conference contribution

6 Citations (Scopus)

Abstract

Regression test suites of evolving software systems are often crucial to maintaining software quality in the long term. They have to be effective in terms of detecting faults and helping their localization. However, to gain knowledge of such capabilities of test suites is usually difficult. We propose a method for deeper understanding of a test suite and its relation to the program code it is intended to test. The basic idea is to decompose the test suite and the program code into coherent logical groups which are easier to analyze and understand. Coverage and partition metrics are then extracted directly from code coverage information to characterize a test suite and its constituents. We also use heat-map tables for test suite assessment both at the system level and at the level of logical groups. We employ these metrics to analyze and evaluate the regression test suite of the WebKit system, an industrial size browser engine with an extensive set of 27,000 tests.

Original languageEnglish
Title of host publicationCEUR Workshop Proceedings
PublisherCEUR-WS
Pages46-60
Number of pages15
Volume1525
Publication statusPublished - 2015
Event14th Symposium on Programming Languages and Software Tools, SPLST 2015 - Tampere, Finland
Duration: okt. 9 2015okt. 10 2015

Other

Other14th Symposium on Programming Languages and Software Tools, SPLST 2015
CountryFinland
CityTampere
Period10/9/1510/10/15

ASJC Scopus subject areas

  • Computer Science(all)

Fingerprint Dive into the research topics of 'Test suite evaluation using code coverage based metrics'. Together they form a unique fingerprint.

  • Cite this

    Horváth, F., Vancsics, B., Vidács, L., Beszédes, A., Tengeri, D., Gergely, T., & Gyimóthy, T. (2015). Test suite evaluation using code coverage based metrics. In CEUR Workshop Proceedings (Vol. 1525, pp. 46-60). CEUR-WS.