Active and passive techniques for group size estimation in large-scale and dynamic distributed systems

Dionysios Kostoulas, Dimitrios Psaltoulis, Indranil Gupta, Kenneth P. Birman, Alan J. Demers

Research output: Contribution to journalArticlepeer-review

Abstract

This paper presents two solutions to a distributed statistic collection problem, called Group Size Estimation. These algorithms are intended for large-scale and dynamic distributed systems such as Grids, peer-to-peer overlays, etc. Each algorithm estimates (both in a one-shot and continuous manner) the number of non-faulty processes present in the global group. The first active scheme samples receipt times of gossip messages, while the second passive scheme calculates the density of process identifiers when hashed to a real interval. Our analysis, trace-driven simulation and deployment on a 33-node Linux cluster study and compare the latencies, scalability, and accuracy of these schemes.

Original languageEnglish (US)
Pages (from-to)1639-1658
Number of pages20
JournalJournal of Systems and Software
Volume80
Issue number10
DOIs
StatePublished - Oct 2007

Keywords

  • Algorithm design and analysis
  • Epidemics
  • Group size estimation
  • Large-scale distributed systems
  • Probabilistic protocols

ASJC Scopus subject areas

  • Software
  • Information Systems
  • Hardware and Architecture

Fingerprint

Dive into the research topics of 'Active and passive techniques for group size estimation in large-scale and dynamic distributed systems'. Together they form a unique fingerprint.

Cite this