Comparing archival policies for Blue Waters

Franck Cappello, Mathias Jacquelin, Loris Marchal, Yves Robert, Marc Snir

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

This paper introduces two new tape archival policies that can improve tape archive performance in certain regimes, compared to the classical RAIT (Redundant Array of Independent Tapes) policy. The first policy, PARALLEL, still requires as many parallel tape drives as RAIT but pre-computes large data stripes that are written contiguously on tapes to increase write/read performance. The second policy, VERTICAL, writes contiguous data into a single tape, while updating error correcting information on the fly and delaying its archival until enough data has been archived. This second approach reduces the number of tape drives used for every user request to one. The performance of the three RAIT, PARALLEL and VE RTICAL policies is assessed through extensive simulations, using a hardware configuration and a distribution of I/O requests similar to these expected on the Blue Waters system. These simulations show that VERTICAL is the most suitable policy for small files, whereas PARALLEL must be used for files larger than 1 GB. We also demonstrate that RAIT never outperforms both proposed policies, and that a heterogeneous policies mixing VERTICAL and PARALLEL performs 10 times better than any other policy.

Original languageEnglish (US)
Title of host publication18th International Conference on High Performance Computing, HiPC 2011
PublisherIEEE Computer Society
ISBN (Print)9781457719516
DOIs
StatePublished - 2011
Event18th International Conference on High Performance Computing, HiPC 2011 - Bangalore, India
Duration: Dec 18 2011Dec 21 2011

Publication series

Name18th International Conference on High Performance Computing, HiPC 2011

Other

Other18th International Conference on High Performance Computing, HiPC 2011
Country/TerritoryIndia
CityBangalore
Period12/18/1112/21/11

ASJC Scopus subject areas

  • Software

Fingerprint

Dive into the research topics of 'Comparing archival policies for Blue Waters'. Together they form a unique fingerprint.

Cite this