Beyond code coverage - An approach for test suite assessment and improvement

Dávid Tengeri, Árpád Beszédes, Tamás Gergely, László Vidács, David Hávas, Tibor Gyimóthy

Research output: Chapter in Book/Report/Conference proceedingConference contribution

10 Citations (Scopus)

Abstract

Code coverage is successfully used to guide white box test design and evaluate the respective test completeness. However, simple overall coverage ratios are often not precise enough to effectively help when a (regression) test suite needs to be reassessed and evolved after software change. We present an approach for test suite assessment and improvement that utilizes code coverage information, but on a more detailed level and adds further evaluation aspects derived from the coverage. The main use of the method is to aid various test suite evolution situations such as removal, refactoring and extension of test cases as a result of code change or test suite efficiency enhancement. We define various metrics to express different properties of test suites beyond simple code coverage ratios, and present the assessment and improvement process as an iterative application of different improvement goals and more specific sub-activities. The method is demonstrated by applying it to improve the tests of one of our experimental systems.

Original languageEnglish
Title of host publication2015 IEEE 8th International Conference on Software Testing, Verification and Validation Workshops, ICSTW 2015 - Proceedings
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9781479918850
DOIs
Publication statusPublished - May 13 2015
Event2015 8th IEEE International Conference on Software Testing, Verification and Validation Workshops, ICSTW 2015 - Graz, Austria
Duration: Apr 13 2015Apr 17 2015

Publication series

Name2015 IEEE 8th International Conference on Software Testing, Verification and Validation Workshops, ICSTW 2015 - Proceedings

Other

Other2015 8th IEEE International Conference on Software Testing, Verification and Validation Workshops, ICSTW 2015
CountryAustria
CityGraz
Period4/13/154/17/15

Keywords

  • code coverage
  • regression testing
  • test suite evolution
  • test suite quality
  • test suite refactoring
  • white box testing metrics

ASJC Scopus subject areas

  • Software

Cite this

Tengeri, D., Beszédes, Á., Gergely, T., Vidács, L., Hávas, D., & Gyimóthy, T. (2015). Beyond code coverage - An approach for test suite assessment and improvement. In 2015 IEEE 8th International Conference on Software Testing, Verification and Validation Workshops, ICSTW 2015 - Proceedings [7107476] (2015 IEEE 8th International Conference on Software Testing, Verification and Validation Workshops, ICSTW 2015 - Proceedings). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/ICSTW.2015.7107476