Decentralized Management of Random Walks over a Mobile Phone Network

Arpad Berta, M. Jelasity

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Citation (Scopus)

Abstract

Gossip learning is a form of decentralized stochastic gradient descent search that is implemented through randomized walks within a network. Our goal is to enable one to deploy gossip learning in open distributed systems, for example, in overlay networks formed by mobile devices, where different data mining tasks could be launched by many users. Among the many problems this long term goal raises, here we focus on the problem of running many random walks simultaneously. This is a challenging problem in itself in a decentralized setting because all the walks have to be persistent (they have to perform many hops) and agile (they need to move quickly). At the same time, the solution must take hard bandwidth constraints into account. Here, we propose a protocol to manage O(n) random walks in a network of n nodes. Although our motivation is gossip learning, this protocol may be viewed as a general middleware service for the management of walks over networks. A key element of our protocol is a multi-level restarting mechanism designed to prevent the failure of random walks due to node churn, while respecting a set of bandwidth constraints. Here, we simulate our solution using a trace collected from real smartphones. We demonstrate that the random walks are kept alive and are run at close to optimal speed under the given bandwidth constraints.

Original languageEnglish
Title of host publicationProceedings - 2017 25th Euromicro International Conference on Parallel, Distributed and Network-Based Processing, PDP 2017
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages100-107
Number of pages8
ISBN (Electronic)9781509060580
DOIs
Publication statusPublished - Apr 26 2017
Event25th Euromicro International Conference on Parallel, Distributed and Network-Based Processing, PDP 2017 - St. Petersburg, Russian Federation
Duration: Mar 6 2017Mar 8 2017

Other

Other25th Euromicro International Conference on Parallel, Distributed and Network-Based Processing, PDP 2017
CountryRussian Federation
CitySt. Petersburg
Period3/6/173/8/17

    Fingerprint

Keywords

  • churn
  • decentralized data mining
  • gossip
  • mobile phone networks
  • random walks

ASJC Scopus subject areas

  • Computer Networks and Communications
  • Hardware and Architecture
  • Information Systems and Management

Cite this

Berta, A., & Jelasity, M. (2017). Decentralized Management of Random Walks over a Mobile Phone Network. In Proceedings - 2017 25th Euromicro International Conference on Parallel, Distributed and Network-Based Processing, PDP 2017 (pp. 100-107). [7912631] Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/PDP.2017.73