The Kangaroo approach to data movement on the grid

D. Thain, J. Basney, S. C. Son, M. Livny

Research output: Contribution to journalConference articlepeer-review

Abstract

Access to remote data is one of the principal challenges of grid computing. While performing I/O, grid applications must be prepared for server crashes, performance variations, and exhausted resources. To achieve high throughput in such a hostile environment, applications need a resilient service that moves data while hiding errors and latencies. We illustrate this idea with Kangaroo, a simple data movement system that makes opportunistic use of disks and networks to keep applications running. We demonstrate that Kangaroo can achieve better end-to-end performance than traditional data movement techniques, even though its individual components do not achieve high performance.

Original languageEnglish (US)
Pages (from-to)325-333
Number of pages9
JournalIEEE International Symposium on High Performance Distributed Computing, Proceedings
StatePublished - 2001
Externally publishedYes
Event10th IEEE Interantionsl Symposium on High Performance Distributed Computing - San Francisco, CA, United States
Duration: Aug 7 2001Aug 9 2001

ASJC Scopus subject areas

  • Software
  • Computer Networks and Communications

Fingerprint

Dive into the research topics of 'The Kangaroo approach to data movement on the grid'. Together they form a unique fingerprint.

Cite this