TY - GEN
T1 - Comparing archival policies for Blue Waters
AU - Cappello, Franck
AU - Jacquelin, Mathias
AU - Marchal, Loris
AU - Robert, Yves
AU - Snir, Marc
PY - 2011
Y1 - 2011
N2 - This paper introduces two new tape archival policies that can improve tape archive performance in certain regimes, compared to the classical RAIT (Redundant Array of Independent Tapes) policy. The first policy, PARALLEL, still requires as many parallel tape drives as RAIT but pre-computes large data stripes that are written contiguously on tapes to increase write/read performance. The second policy, VERTICAL, writes contiguous data into a single tape, while updating error correcting information on the fly and delaying its archival until enough data has been archived. This second approach reduces the number of tape drives used for every user request to one. The performance of the three RAIT, PARALLEL and VE RTICAL policies is assessed through extensive simulations, using a hardware configuration and a distribution of I/O requests similar to these expected on the Blue Waters system. These simulations show that VERTICAL is the most suitable policy for small files, whereas PARALLEL must be used for files larger than 1 GB. We also demonstrate that RAIT never outperforms both proposed policies, and that a heterogeneous policies mixing VERTICAL and PARALLEL performs 10 times better than any other policy.
AB - This paper introduces two new tape archival policies that can improve tape archive performance in certain regimes, compared to the classical RAIT (Redundant Array of Independent Tapes) policy. The first policy, PARALLEL, still requires as many parallel tape drives as RAIT but pre-computes large data stripes that are written contiguously on tapes to increase write/read performance. The second policy, VERTICAL, writes contiguous data into a single tape, while updating error correcting information on the fly and delaying its archival until enough data has been archived. This second approach reduces the number of tape drives used for every user request to one. The performance of the three RAIT, PARALLEL and VE RTICAL policies is assessed through extensive simulations, using a hardware configuration and a distribution of I/O requests similar to these expected on the Blue Waters system. These simulations show that VERTICAL is the most suitable policy for small files, whereas PARALLEL must be used for files larger than 1 GB. We also demonstrate that RAIT never outperforms both proposed policies, and that a heterogeneous policies mixing VERTICAL and PARALLEL performs 10 times better than any other policy.
UR - http://www.scopus.com/inward/record.url?scp=84858056591&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=84858056591&partnerID=8YFLogxK
U2 - 10.1109/HiPC.2011.6152428
DO - 10.1109/HiPC.2011.6152428
M3 - Conference contribution
AN - SCOPUS:84858056591
SN - 9781457719516
T3 - 18th International Conference on High Performance Computing, HiPC 2011
BT - 18th International Conference on High Performance Computing, HiPC 2011
PB - IEEE Computer Society
T2 - 18th International Conference on High Performance Computing, HiPC 2011
Y2 - 18 December 2011 through 21 December 2011
ER -