Collaborative data distribution with BitTorrent for computational desktop grids

Baohua Wei, Gilles Fedak, Franck Cappello

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Data-centric applications are still a challenging issue for Large Scale Distributed Computing Systems. The emergence of new protocols and softwares for collaborative content distribution over Internet offers a new opportunity for efficient and fast delivery of high volume of data. This paper presents an evaluation of the BitTorrent protocol for Computational Desktop Grids. We first present a prototype of a generic subsystem dedicated to data management and designed to serve as a building block for any Desktop Grid System. Based on this prototype we conduct experimentations to evaluate the potential of BitTorrent compared to a classical approach based on FTP data server. The preliminary results obtained with a 65-nodes cluster measure the basic characteristics of BitTorrent in terms of latency and bandwidth and evaluate the scalability of BitTorrent for the delivery of large input files. Moreover, we show that BitTorrent has a considerable latency overhead compared to FTP but clearly outperforms FTP when distributing large files or files to a high number of nodes. Tests on a synthetic application show that BitTorrent significantly increases the communication/computation ratio of the applications eligible to run on a Desktop Grid System.

Original languageEnglish (US)
Title of host publicationISPDC 2005
Subtitle of host publication4th International Symposium on Parallel and Distributed Computing
Pages250-257
Number of pages8
DOIs
StatePublished - 2005
Externally publishedYes
EventISPDC 2005: 4th International Symposium on Parallel and Distributed Computing - Lille, France
Duration: Jul 4 2005Jul 6 2005

Publication series

NameISPDC 2005: 4th International Symposium on Parallel and Distributed Computing
Volume2005

Conference

ConferenceISPDC 2005: 4th International Symposium on Parallel and Distributed Computing
Country/TerritoryFrance
CityLille
Period7/4/057/6/05

ASJC Scopus subject areas

  • General Engineering

Fingerprint

Dive into the research topics of 'Collaborative data distribution with BitTorrent for computational desktop grids'. Together they form a unique fingerprint.

Cite this