Towards a benchmark for evaluating design pattern miner tools

Lajos Jeno Fülöp, Rudolf Ferenc, Tibor Gyimóthy

Research output: Chapter in Book/Report/Conference proceedingConference contribution

23 Citations (Scopus)

Abstract

Recovering design pattern usage in source code is a very difficult task. Several tools are described in the literature for this purpose, but there is little work invested in evaluating them. The main reason for this is the lack of an approved benchmark for these tools. In this paper we present work in progress towards creating a benchmark, called DEEBEE (DEsign pattern Evaluation BEnchmark Environment), for evaluating and comparing design pattern miner tools. It is programming language, tool, pattern and software independent, and it is open to the community and freely available. Currently, the benchmark database contains the results of three tools: Columbus (C++), Maisa (C++), and Design Pattern detection Tool (Java). The tools were evaluated on reference implementations of patterns and on open source software (Mozilla, NotePad++, JHotDraw, JRefactory and JUnit). Additionally, instances recovered by researchers are added from NotePad++ as well. Some recovered patterns are already verified by experienced developers. This work is the first step in building a large reference database of design pattern usage in open source software and we expect that researchers will join us in this effort.

Original languageEnglish
Title of host publicationCSMR 2008 - 12th European Conference on Software Maintenance and Reengineering
Pages143-152
Number of pages10
DOIs
Publication statusPublished - Sep 1 2008
EventCSMR 2008 - 12th European Conference on Software Maintenance and Reengineering - Athens, Greece
Duration: Apr 1 2008Apr 4 2008

Publication series

NameProceedings of the European Conference on Software Maintenance and Reengineering, CSMR
ISSN (Print)1534-5351

Other

OtherCSMR 2008 - 12th European Conference on Software Maintenance and Reengineering
CountryGreece
CityAthens
Period4/1/084/4/08

    Fingerprint

Keywords

  • Benchmark
  • Design pattern mining
  • Design patterns
  • Tool comparison
  • Tool evaluation

ASJC Scopus subject areas

  • Software

Cite this

Fülöp, L. J., Ferenc, R., & Gyimóthy, T. (2008). Towards a benchmark for evaluating design pattern miner tools. In CSMR 2008 - 12th European Conference on Software Maintenance and Reengineering (pp. 143-152). [4493309] (Proceedings of the European Conference on Software Maintenance and Reengineering, CSMR). https://doi.org/10.1109/CSMR.2008.4493309