A New Interactive Fault Localization Method with Context Aware User Feedback

F. Horváth, Victor Schnepper Lacerda, A. Beszédes, Laszlo Vidacs, T. Gyimóthy

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

State-of-the-art fault localization tools provide a ranked list of suspicious code elements to aid the user in this debugging activity. Statistical (or Spectrum-Based) Fault Localization (SFL/SBFL) uses code coverage information of test cases and their execution outcomes to calculate the ranks. We propose an approach (called iFL) in which the developer interacts with the fault localization algorithm by giving feedback on the elements of the prioritized list. Contextual knowledge of the user about the current item (e. g., a statement) is exploited in the ranked list, and with this feedback larger code entities (e. g., a whole function) can be repositioned in the list. In our initial set of experiments, we evaluated the approach on the SIR benchmark using simulated users. Results showed significant improvements in fault localization accuracy: the ranking position of the buggy element was reduced by 72% on average, and iFL was able to double the number of faults that were positioned between 1-5.

Original languageEnglish
Title of host publicationIBF 2019 - 2019 IEEE 1st International Workshop on Intelligent Bug Fixing
EditorsShing-Chi Cheung, Xiaobing Sun, Tao Zhang
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages23-28
Number of pages6
ISBN (Electronic)9781728118093
DOIs
Publication statusPublished - Mar 11 2019
Event1st IEEE International Workshop on Intelligent Bug Fixing, IBF 2019 - Hangzhou, China
Duration: Feb 24 2019 → …

Publication series

NameIBF 2019 - 2019 IEEE 1st International Workshop on Intelligent Bug Fixing

Conference

Conference1st IEEE International Workshop on Intelligent Bug Fixing, IBF 2019
CountryChina
CityHangzhou
Period2/24/19 → …

Fingerprint

Feedback
Experiments

Keywords

  • interactive debugging
  • spectrum based fault localization
  • Statistical fault localization
  • testing
  • user feedback

ASJC Scopus subject areas

  • Computer Science Applications
  • Software

Cite this

Horváth, F., Lacerda, V. S., Beszédes, A., Vidacs, L., & Gyimóthy, T. (2019). A New Interactive Fault Localization Method with Context Aware User Feedback. In S-C. Cheung, X. Sun, & T. Zhang (Eds.), IBF 2019 - 2019 IEEE 1st International Workshop on Intelligent Bug Fixing (pp. 23-28). [8665415] (IBF 2019 - 2019 IEEE 1st International Workshop on Intelligent Bug Fixing). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/IBF.2019.8665415

A New Interactive Fault Localization Method with Context Aware User Feedback. / Horváth, F.; Lacerda, Victor Schnepper; Beszédes, A.; Vidacs, Laszlo; Gyimóthy, T.

IBF 2019 - 2019 IEEE 1st International Workshop on Intelligent Bug Fixing. ed. / Shing-Chi Cheung; Xiaobing Sun; Tao Zhang. Institute of Electrical and Electronics Engineers Inc., 2019. p. 23-28 8665415 (IBF 2019 - 2019 IEEE 1st International Workshop on Intelligent Bug Fixing).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Horváth, F, Lacerda, VS, Beszédes, A, Vidacs, L & Gyimóthy, T 2019, A New Interactive Fault Localization Method with Context Aware User Feedback. in S-C Cheung, X Sun & T Zhang (eds), IBF 2019 - 2019 IEEE 1st International Workshop on Intelligent Bug Fixing., 8665415, IBF 2019 - 2019 IEEE 1st International Workshop on Intelligent Bug Fixing, Institute of Electrical and Electronics Engineers Inc., pp. 23-28, 1st IEEE International Workshop on Intelligent Bug Fixing, IBF 2019, Hangzhou, China, 2/24/19. https://doi.org/10.1109/IBF.2019.8665415
Horváth F, Lacerda VS, Beszédes A, Vidacs L, Gyimóthy T. A New Interactive Fault Localization Method with Context Aware User Feedback. In Cheung S-C, Sun X, Zhang T, editors, IBF 2019 - 2019 IEEE 1st International Workshop on Intelligent Bug Fixing. Institute of Electrical and Electronics Engineers Inc. 2019. p. 23-28. 8665415. (IBF 2019 - 2019 IEEE 1st International Workshop on Intelligent Bug Fixing). https://doi.org/10.1109/IBF.2019.8665415
Horváth, F. ; Lacerda, Victor Schnepper ; Beszédes, A. ; Vidacs, Laszlo ; Gyimóthy, T. / A New Interactive Fault Localization Method with Context Aware User Feedback. IBF 2019 - 2019 IEEE 1st International Workshop on Intelligent Bug Fixing. editor / Shing-Chi Cheung ; Xiaobing Sun ; Tao Zhang. Institute of Electrical and Electronics Engineers Inc., 2019. pp. 23-28 (IBF 2019 - 2019 IEEE 1st International Workshop on Intelligent Bug Fixing).
@inproceedings{50bec2dd2bc54e87b8e82560bc6146f6,
title = "A New Interactive Fault Localization Method with Context Aware User Feedback",
abstract = "State-of-the-art fault localization tools provide a ranked list of suspicious code elements to aid the user in this debugging activity. Statistical (or Spectrum-Based) Fault Localization (SFL/SBFL) uses code coverage information of test cases and their execution outcomes to calculate the ranks. We propose an approach (called iFL) in which the developer interacts with the fault localization algorithm by giving feedback on the elements of the prioritized list. Contextual knowledge of the user about the current item (e. g., a statement) is exploited in the ranked list, and with this feedback larger code entities (e. g., a whole function) can be repositioned in the list. In our initial set of experiments, we evaluated the approach on the SIR benchmark using simulated users. Results showed significant improvements in fault localization accuracy: the ranking position of the buggy element was reduced by 72{\%} on average, and iFL was able to double the number of faults that were positioned between 1-5.",
keywords = "interactive debugging, spectrum based fault localization, Statistical fault localization, testing, user feedback",
author = "F. Horv{\'a}th and Lacerda, {Victor Schnepper} and A. Besz{\'e}des and Laszlo Vidacs and T. Gyim{\'o}thy",
year = "2019",
month = "3",
day = "11",
doi = "10.1109/IBF.2019.8665415",
language = "English",
series = "IBF 2019 - 2019 IEEE 1st International Workshop on Intelligent Bug Fixing",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
pages = "23--28",
editor = "Shing-Chi Cheung and Xiaobing Sun and Tao Zhang",
booktitle = "IBF 2019 - 2019 IEEE 1st International Workshop on Intelligent Bug Fixing",
address = "United States",

}

TY - GEN

T1 - A New Interactive Fault Localization Method with Context Aware User Feedback

AU - Horváth, F.

AU - Lacerda, Victor Schnepper

AU - Beszédes, A.

AU - Vidacs, Laszlo

AU - Gyimóthy, T.

PY - 2019/3/11

Y1 - 2019/3/11

N2 - State-of-the-art fault localization tools provide a ranked list of suspicious code elements to aid the user in this debugging activity. Statistical (or Spectrum-Based) Fault Localization (SFL/SBFL) uses code coverage information of test cases and their execution outcomes to calculate the ranks. We propose an approach (called iFL) in which the developer interacts with the fault localization algorithm by giving feedback on the elements of the prioritized list. Contextual knowledge of the user about the current item (e. g., a statement) is exploited in the ranked list, and with this feedback larger code entities (e. g., a whole function) can be repositioned in the list. In our initial set of experiments, we evaluated the approach on the SIR benchmark using simulated users. Results showed significant improvements in fault localization accuracy: the ranking position of the buggy element was reduced by 72% on average, and iFL was able to double the number of faults that were positioned between 1-5.

AB - State-of-the-art fault localization tools provide a ranked list of suspicious code elements to aid the user in this debugging activity. Statistical (or Spectrum-Based) Fault Localization (SFL/SBFL) uses code coverage information of test cases and their execution outcomes to calculate the ranks. We propose an approach (called iFL) in which the developer interacts with the fault localization algorithm by giving feedback on the elements of the prioritized list. Contextual knowledge of the user about the current item (e. g., a statement) is exploited in the ranked list, and with this feedback larger code entities (e. g., a whole function) can be repositioned in the list. In our initial set of experiments, we evaluated the approach on the SIR benchmark using simulated users. Results showed significant improvements in fault localization accuracy: the ranking position of the buggy element was reduced by 72% on average, and iFL was able to double the number of faults that were positioned between 1-5.

KW - interactive debugging

KW - spectrum based fault localization

KW - Statistical fault localization

KW - testing

KW - user feedback

UR - http://www.scopus.com/inward/record.url?scp=85063932331&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85063932331&partnerID=8YFLogxK

U2 - 10.1109/IBF.2019.8665415

DO - 10.1109/IBF.2019.8665415

M3 - Conference contribution

AN - SCOPUS:85063932331

T3 - IBF 2019 - 2019 IEEE 1st International Workshop on Intelligent Bug Fixing

SP - 23

EP - 28

BT - IBF 2019 - 2019 IEEE 1st International Workshop on Intelligent Bug Fixing

A2 - Cheung, Shing-Chi

A2 - Sun, Xiaobing

A2 - Zhang, Tao

PB - Institute of Electrical and Electronics Engineers Inc.

ER -