Fermilab's multi-Petabyte scalable mass storage system

Gene Oleynik; Bonnie Alcorn; Wayne Baisley; Jon Bakken; David Berg; Eileen Berman; Chih Hao Huang; Terry Jones; Robert D. Kennedy; Alexander Kulyavtsev; Alexander Moibenko; Timur Perelmutov; Don Petravick; Vladimir Podstavkov; George Szmuksta; Michael Zalokar

doi:10.1109/MSST.2005.16

Fermilab's multi-Petabyte scalable mass storage system

Gene Oleynik, Bonnie Alcorn, Wayne Baisley, Jon Bakken, David Berg, Eileen Berman, Chih Hao Huang, Terry Jones, Robert D. Kennedy, Alexander Kulyavtsev, Alexander Moibenko, Timur Perelmutov, Don Petravick, Vladimir Podstavkov, George Szmuksta, Michael Zalokar

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Abstract

Fermilab provides a multi-Petabyte scale mass storage system for High Energy Physics (HEP) Experiments and other scientific endeavors. We describe the scalability aspects of the hardware and software architecture that were designed into the Mass Storage System to permit us to scale to multiple petabytes of storage capacity, manage tens of terabytes per day in data transfers, support hundreds of users, and maintain data integrity. We discuss in detail how we scale the system over time to meet the ever-increasing needs of the scientific community, and relate our experiences with many of the technical and economic issues related to scaling the system. Since the 2003 MSST conference, the experiments at Fermilab have generated more than 1.9 PB of additional data. We present results on how this system has scaled and performed for the Fermilab CDF and DO Run II experiments as well as other HEP experiments and scientific endeavors.

Original language	English (US)
Title of host publication	Proceedings - Twenty-second IEEE/Thirteenth NASA Goddard Conference on Mass Storage Systems and Technologies
Pages	73-80
Number of pages	8
DOIs	https://doi.org/10.1109/MSST.2005.16
State	Published - 2005
Externally published	Yes
Event	Twenty-second IEEE/Thirteenth NASA Goddard Conference on Mass Storage Systems and Technologies, IEEE/NASA MSST2005 - Monterey, CA, United States Duration: Apr 11 2005 → Apr 14 2005

Publication series

Name	Proceedings - Twenty -second IEEE/Thirteenth NASA Goddard Conference on Mass Storage Systems and Technologies

Other

Other	Twenty-second IEEE/Thirteenth NASA Goddard Conference on Mass Storage Systems and Technologies, IEEE/NASA MSST2005
Country/Territory	United States
City	Monterey, CA
Period	4/11/05 → 4/14/05

ASJC Scopus subject areas

General Engineering

Online availability

10.1109/MSST.2005.16

Library availability

Discover UIUC Full Text

Cite this

Oleynik, G., Alcorn, B., Baisley, W., Bakken, J., Berg, D., Berman, E., Huang, C. H., Jones, T., Kennedy, R. D., Kulyavtsev, A., Moibenko, A., Perelmutov, T., Petravick, D., Podstavkov, V., Szmuksta, G., & Zalokar, M. (2005). Fermilab's multi-Petabyte scalable mass storage system. In Proceedings - Twenty-second IEEE/Thirteenth NASA Goddard Conference on Mass Storage Systems and Technologies (pp. 73-80). (Proceedings - Twenty -second IEEE/Thirteenth NASA Goddard Conference on Mass Storage Systems and Technologies). https://doi.org/10.1109/MSST.2005.16

Fermilab's multi-Petabyte scalable mass storage system. / Oleynik, Gene; Alcorn, Bonnie; Baisley, Wayne et al.
Proceedings - Twenty-second IEEE/Thirteenth NASA Goddard Conference on Mass Storage Systems and Technologies. 2005. p. 73-80 (Proceedings - Twenty -second IEEE/Thirteenth NASA Goddard Conference on Mass Storage Systems and Technologies).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Oleynik, G, Alcorn, B, Baisley, W, Bakken, J, Berg, D, Berman, E, Huang, CH, Jones, T, Kennedy, RD, Kulyavtsev, A, Moibenko, A, Perelmutov, T, Petravick, D, Podstavkov, V, Szmuksta, G & Zalokar, M 2005, Fermilab's multi-Petabyte scalable mass storage system. in Proceedings - Twenty-second IEEE/Thirteenth NASA Goddard Conference on Mass Storage Systems and Technologies. Proceedings - Twenty -second IEEE/Thirteenth NASA Goddard Conference on Mass Storage Systems and Technologies, pp. 73-80, Twenty-second IEEE/Thirteenth NASA Goddard Conference on Mass Storage Systems and Technologies, IEEE/NASA MSST2005, Monterey, CA, United States, 4/11/05. https://doi.org/10.1109/MSST.2005.16

Oleynik G, Alcorn B, Baisley W, Bakken J, Berg D, Berman E et al. Fermilab's multi-Petabyte scalable mass storage system. In Proceedings - Twenty-second IEEE/Thirteenth NASA Goddard Conference on Mass Storage Systems and Technologies. 2005. p. 73-80. (Proceedings - Twenty -second IEEE/Thirteenth NASA Goddard Conference on Mass Storage Systems and Technologies). doi: 10.1109/MSST.2005.16

@inproceedings{fcf2cf7b83c448f98b8d93fd8775bfe2,

title = "Fermilab's multi-Petabyte scalable mass storage system",

abstract = "Fermilab provides a multi-Petabyte scale mass storage system for High Energy Physics (HEP) Experiments and other scientific endeavors. We describe the scalability aspects of the hardware and software architecture that were designed into the Mass Storage System to permit us to scale to multiple petabytes of storage capacity, manage tens of terabytes per day in data transfers, support hundreds of users, and maintain data integrity. We discuss in detail how we scale the system over time to meet the ever-increasing needs of the scientific community, and relate our experiences with many of the technical and economic issues related to scaling the system. Since the 2003 MSST conference, the experiments at Fermilab have generated more than 1.9 PB of additional data. We present results on how this system has scaled and performed for the Fermilab CDF and DO Run II experiments as well as other HEP experiments and scientific endeavors.",

author = "Gene Oleynik and Bonnie Alcorn and Wayne Baisley and Jon Bakken and David Berg and Eileen Berman and Huang, {Chih Hao} and Terry Jones and Kennedy, {Robert D.} and Alexander Kulyavtsev and Alexander Moibenko and Timur Perelmutov and Don Petravick and Vladimir Podstavkov and George Szmuksta and Michael Zalokar",

year = "2005",

doi = "10.1109/MSST.2005.16",

language = "English (US)",

isbn = "0769523188",

series = "Proceedings - Twenty -second IEEE/Thirteenth NASA Goddard Conference on Mass Storage Systems and Technologies",

pages = "73--80",

booktitle = "Proceedings - Twenty-second IEEE/Thirteenth NASA Goddard Conference on Mass Storage Systems and Technologies",

note = "Twenty-second IEEE/Thirteenth NASA Goddard Conference on Mass Storage Systems and Technologies, IEEE/NASA MSST2005 ; Conference date: 11-04-2005 Through 14-04-2005",

}

TY - GEN

T1 - Fermilab's multi-Petabyte scalable mass storage system

AU - Oleynik, Gene

AU - Alcorn, Bonnie

AU - Baisley, Wayne

AU - Bakken, Jon

AU - Berg, David

AU - Berman, Eileen

AU - Huang, Chih Hao

AU - Jones, Terry

AU - Kennedy, Robert D.

AU - Kulyavtsev, Alexander

AU - Moibenko, Alexander

AU - Perelmutov, Timur

AU - Petravick, Don

AU - Podstavkov, Vladimir

AU - Szmuksta, George

AU - Zalokar, Michael

PY - 2005

Y1 - 2005

N2 - Fermilab provides a multi-Petabyte scale mass storage system for High Energy Physics (HEP) Experiments and other scientific endeavors. We describe the scalability aspects of the hardware and software architecture that were designed into the Mass Storage System to permit us to scale to multiple petabytes of storage capacity, manage tens of terabytes per day in data transfers, support hundreds of users, and maintain data integrity. We discuss in detail how we scale the system over time to meet the ever-increasing needs of the scientific community, and relate our experiences with many of the technical and economic issues related to scaling the system. Since the 2003 MSST conference, the experiments at Fermilab have generated more than 1.9 PB of additional data. We present results on how this system has scaled and performed for the Fermilab CDF and DO Run II experiments as well as other HEP experiments and scientific endeavors.

AB - Fermilab provides a multi-Petabyte scale mass storage system for High Energy Physics (HEP) Experiments and other scientific endeavors. We describe the scalability aspects of the hardware and software architecture that were designed into the Mass Storage System to permit us to scale to multiple petabytes of storage capacity, manage tens of terabytes per day in data transfers, support hundreds of users, and maintain data integrity. We discuss in detail how we scale the system over time to meet the ever-increasing needs of the scientific community, and relate our experiences with many of the technical and economic issues related to scaling the system. Since the 2003 MSST conference, the experiments at Fermilab have generated more than 1.9 PB of additional data. We present results on how this system has scaled and performed for the Fermilab CDF and DO Run II experiments as well as other HEP experiments and scientific endeavors.

UR - http://www.scopus.com/inward/record.url?scp=27144540107&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=27144540107&partnerID=8YFLogxK

U2 - 10.1109/MSST.2005.16

DO - 10.1109/MSST.2005.16

M3 - Conference contribution

AN - SCOPUS:27144540107

SN - 0769523188

SN - 9780769523187

T3 - Proceedings - Twenty -second IEEE/Thirteenth NASA Goddard Conference on Mass Storage Systems and Technologies

SP - 73

EP - 80

BT - Proceedings - Twenty-second IEEE/Thirteenth NASA Goddard Conference on Mass Storage Systems and Technologies

T2 - Twenty-second IEEE/Thirteenth NASA Goddard Conference on Mass Storage Systems and Technologies, IEEE/NASA MSST2005

Y2 - 11 April 2005 through 14 April 2005

ER -

Fermilab's multi-Petabyte scalable mass storage system

Abstract

Publication series

Other

ASJC Scopus subject areas

Online availability

Library availability

Related links

Fingerprint

Cite this