Benchmarking: A methodology for ensuring the relative quality of recommendation systems in software engineering

Alan Said, D. Tikk, Paolo Cremonesi

Research output: Chapter in Book/Report/Conference proceedingChapter

3 Citations (Scopus)

Abstract

This chapter describes the concepts involved in the process of benchmarking of recommendation systems. Benchmarking of recommendation systems is used to ensure the quality of a research system or production system in comparison to other systems, whether algorithmically, infrastructurally, or according to any sought-after quality. Specifically, the chapter presents evaluation of recommendation systems according to recommendation accuracy, technical constraints, and business values in the context of a multi-dimensional benchmarking and evaluation model encompassing any number of qualities into a final comparable metric. The focus is put on quality measures related to recommendation accuracy, technical factors, and business values. The chapter first introduces concepts related to evaluation and benchmarking of recommendation systems, continues with an overview of the current state of the art, then presents the multi-dimensional approach in detail. The chapter concludes with a brief discussion of the introduced concepts and a summary.

Original languageEnglish
Title of host publicationRecommendation Systems in Software Engineering
PublisherSpringer Berlin Heidelberg
Pages275-300
Number of pages26
ISBN (Print)9783642451355, 9783642451348
DOIs
Publication statusPublished - Jan 1 2014

Fingerprint

Recommender systems
Benchmarking
Software engineering
Industry

ASJC Scopus subject areas

  • Computer Science(all)

Cite this

Said, A., Tikk, D., & Cremonesi, P. (2014). Benchmarking: A methodology for ensuring the relative quality of recommendation systems in software engineering. In Recommendation Systems in Software Engineering (pp. 275-300). Springer Berlin Heidelberg. https://doi.org/10.1007/978-3-642-45135-5_11

Benchmarking : A methodology for ensuring the relative quality of recommendation systems in software engineering. / Said, Alan; Tikk, D.; Cremonesi, Paolo.

Recommendation Systems in Software Engineering. Springer Berlin Heidelberg, 2014. p. 275-300.

Research output: Chapter in Book/Report/Conference proceedingChapter

Said, A, Tikk, D & Cremonesi, P 2014, Benchmarking: A methodology for ensuring the relative quality of recommendation systems in software engineering. in Recommendation Systems in Software Engineering. Springer Berlin Heidelberg, pp. 275-300. https://doi.org/10.1007/978-3-642-45135-5_11
Said A, Tikk D, Cremonesi P. Benchmarking: A methodology for ensuring the relative quality of recommendation systems in software engineering. In Recommendation Systems in Software Engineering. Springer Berlin Heidelberg. 2014. p. 275-300 https://doi.org/10.1007/978-3-642-45135-5_11
Said, Alan ; Tikk, D. ; Cremonesi, Paolo. / Benchmarking : A methodology for ensuring the relative quality of recommendation systems in software engineering. Recommendation Systems in Software Engineering. Springer Berlin Heidelberg, 2014. pp. 275-300
@inbook{7e958497620d4073aaca464d42854d91,
title = "Benchmarking: A methodology for ensuring the relative quality of recommendation systems in software engineering",
abstract = "This chapter describes the concepts involved in the process of benchmarking of recommendation systems. Benchmarking of recommendation systems is used to ensure the quality of a research system or production system in comparison to other systems, whether algorithmically, infrastructurally, or according to any sought-after quality. Specifically, the chapter presents evaluation of recommendation systems according to recommendation accuracy, technical constraints, and business values in the context of a multi-dimensional benchmarking and evaluation model encompassing any number of qualities into a final comparable metric. The focus is put on quality measures related to recommendation accuracy, technical factors, and business values. The chapter first introduces concepts related to evaluation and benchmarking of recommendation systems, continues with an overview of the current state of the art, then presents the multi-dimensional approach in detail. The chapter concludes with a brief discussion of the introduced concepts and a summary.",
author = "Alan Said and D. Tikk and Paolo Cremonesi",
year = "2014",
month = "1",
day = "1",
doi = "10.1007/978-3-642-45135-5_11",
language = "English",
isbn = "9783642451355",
pages = "275--300",
booktitle = "Recommendation Systems in Software Engineering",
publisher = "Springer Berlin Heidelberg",

}

TY - CHAP

T1 - Benchmarking

T2 - A methodology for ensuring the relative quality of recommendation systems in software engineering

AU - Said, Alan

AU - Tikk, D.

AU - Cremonesi, Paolo

PY - 2014/1/1

Y1 - 2014/1/1

N2 - This chapter describes the concepts involved in the process of benchmarking of recommendation systems. Benchmarking of recommendation systems is used to ensure the quality of a research system or production system in comparison to other systems, whether algorithmically, infrastructurally, or according to any sought-after quality. Specifically, the chapter presents evaluation of recommendation systems according to recommendation accuracy, technical constraints, and business values in the context of a multi-dimensional benchmarking and evaluation model encompassing any number of qualities into a final comparable metric. The focus is put on quality measures related to recommendation accuracy, technical factors, and business values. The chapter first introduces concepts related to evaluation and benchmarking of recommendation systems, continues with an overview of the current state of the art, then presents the multi-dimensional approach in detail. The chapter concludes with a brief discussion of the introduced concepts and a summary.

AB - This chapter describes the concepts involved in the process of benchmarking of recommendation systems. Benchmarking of recommendation systems is used to ensure the quality of a research system or production system in comparison to other systems, whether algorithmically, infrastructurally, or according to any sought-after quality. Specifically, the chapter presents evaluation of recommendation systems according to recommendation accuracy, technical constraints, and business values in the context of a multi-dimensional benchmarking and evaluation model encompassing any number of qualities into a final comparable metric. The focus is put on quality measures related to recommendation accuracy, technical factors, and business values. The chapter first introduces concepts related to evaluation and benchmarking of recommendation systems, continues with an overview of the current state of the art, then presents the multi-dimensional approach in detail. The chapter concludes with a brief discussion of the introduced concepts and a summary.

UR - http://www.scopus.com/inward/record.url?scp=84935136910&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84935136910&partnerID=8YFLogxK

U2 - 10.1007/978-3-642-45135-5_11

DO - 10.1007/978-3-642-45135-5_11

M3 - Chapter

AN - SCOPUS:84935136910

SN - 9783642451355

SN - 9783642451348

SP - 275

EP - 300

BT - Recommendation Systems in Software Engineering

PB - Springer Berlin Heidelberg

ER -