Overlay management for fully distributed user-based collaborative filtering

Róbert Ormándi, István Hegedus, Márk Jelasity

Research output: Chapter in Book/Report/Conference proceedingConference contribution

13 Citations (Scopus)

Abstract

Offering personalized recommendation as a service in fully distributed applications such as file-sharing, distributed search, social networking, P2P television, etc, is an increasingly important problem. In such networked environments recommender algorithms should meet the same performance and reliability requirements as in centralized services. To achieve this is a challenge because a large amount of distributed data needs to be managed, and at the same time additional constraints need to be taken into account such as balancing resource usage over the network. In this paper we focus on a common component of many fully distributed recommender systems, namely the overlay network. We point out that the overlay topologies that are typically defined by node similarity have highly unbalanced degree distributions in a wide range of available benchmark datasets: a fact that has important-but so far largely overlooked-consequences on the load balancing of overlay protocols. We propose algorithms with a favorable convergence speed and prediction accuracy that also take load balancing into account. We perform extensive simulation experiments with the proposed algorithms, and compare them with known algorithms from related work on well-known benchmark datasets.

Original languageEnglish
Title of host publicationEuro-Par 2010 Parallel Processing - 16th International Euro-Par Conference, Proceedings
Pages446-457
Number of pages12
EditionPART 1
DOIs
Publication statusPublished - Nov 22 2010
Event16th International Euro-Par Conference on Parallel Processing, Euro-Par 2010 - Ischia, Italy
Duration: Aug 31 2010Sep 3 2010

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
NumberPART 1
Volume6271 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Other

Other16th International Euro-Par Conference on Parallel Processing, Euro-Par 2010
CountryItaly
CityIschia
Period8/31/109/3/10

    Fingerprint

ASJC Scopus subject areas

  • Theoretical Computer Science
  • Computer Science(all)

Cite this

Ormándi, R., Hegedus, I., & Jelasity, M. (2010). Overlay management for fully distributed user-based collaborative filtering. In Euro-Par 2010 Parallel Processing - 16th International Euro-Par Conference, Proceedings (PART 1 ed., pp. 446-457). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 6271 LNCS, No. PART 1). https://doi.org/10.1007/978-3-642-15277-1_43