Code coverage-based regression test selection and prioritization in WebKit

Arpad Beszedes, Tamas Gergely, Lajos Schrettner, Judit Jasz, Laszlo Lango, Tibor Gyimothy

Research output: Conference contribution

24 Citations (Scopus)

Abstract

Automated regression testing is often crucial in order to maintain the quality of a continuously evolving software system. However, in many cases regression test suites tend to grow too large to be suitable for full re-execution at each change of the software. In this case selective retesting can be applied to reduce the testing cost while maintaining similar defect detection capability. One of the basic test selection methods is the one based on code coverage information, where only those tests are included that cover some parts of the changes. We experimentally applied this method to the open source web browser engine project WebKit to find out the technical difficulties and the expected benefits if this method is to be introduced into the actual build process. Although the principle is simple, we had to solve a number of technical issues, so we report how this method was adapted to be used in the official build environment. Second, we present results about the selection capabilities for a selected set of revisions of WebKit, which are promising. We also applied different test case prioritization strategies to further reduce the number of tests to execute. We explain these strategies and compare their usefulness in terms of defect detection and test suite reduction.

Original languageEnglish
Title of host publicationProceedings of the 28th IEEE International Conference on Software Maintenance, ICSM 2012
Pages46-55
Number of pages10
DOIs
Publication statusPublished - dec. 1 2012
Event28th IEEE International Conference on Software Maintenance, ICSM 2012 - Riva del Garda,Trento, Italy
Duration: szept. 23 2012szept. 28 2012

Publication series

NameIEEE International Conference on Software Maintenance, ICSM

Other

Other28th IEEE International Conference on Software Maintenance, ICSM 2012
CountryItaly
CityRiva del Garda,Trento
Period9/23/129/28/12

ASJC Scopus subject areas

  • Software

Fingerprint Dive into the research topics of 'Code coverage-based regression test selection and prioritization in WebKit'. Together they form a unique fingerprint.

  • Cite this

    Beszedes, A., Gergely, T., Schrettner, L., Jasz, J., Lango, L., & Gyimothy, T. (2012). Code coverage-based regression test selection and prioritization in WebKit. In Proceedings of the 28th IEEE International Conference on Software Maintenance, ICSM 2012 (pp. 46-55). [6405252] (IEEE International Conference on Software Maintenance, ICSM). https://doi.org/10.1109/ICSM.2012.6405252