TY - GEN
T1 - NSDF-Services
T2 - 16th IEEE/ACM International Conference on Utility and Cloud Computing, UCC 2023
AU - Luettgau, Jakob
AU - Martinez, Heberth
AU - Olaya, Paula
AU - Scorzelli, Giorgio
AU - Tarcea, Glenn
AU - Lofstead, Jay
AU - Kirkpatrick, Christine
AU - Pascucci, Valerio
AU - Taufer, Michela
N1 - Publisher Copyright:
© 2023 Copyright is held by the owner/author(s). Publication rights licensed to ACM.
PY - 2023/12/4
Y1 - 2023/12/4
N2 - The lack of a readily accessible, tightly integrated data fabric connecting high-speed networking, storage, and computing services remains a critical barrier to the democratization of scientific discovery. To address this challenge, we are building National Science Data Fabric (NSDF), a holistic ecosystem to facilitate domain scientists in their daily research. NSDF comprises networking, storage, and computing services, as well as outreach initiatives. In this paper, we present a testbed integrating three services (i.e., networking, storage, and computing). We evaluate their performance. Specifically, we study the networking services and their throughput and latency with a focus on academic cloud providers; the storage services and their performance with a focus on data movement using file system mappers for both academic and commercial clouds; and computing orchestration services focusing on commercial cloud providers. We discuss NSDF's potential to increase scalability and usability as it decreases time-to-discovery across scientific domains.
AB - The lack of a readily accessible, tightly integrated data fabric connecting high-speed networking, storage, and computing services remains a critical barrier to the democratization of scientific discovery. To address this challenge, we are building National Science Data Fabric (NSDF), a holistic ecosystem to facilitate domain scientists in their daily research. NSDF comprises networking, storage, and computing services, as well as outreach initiatives. In this paper, we present a testbed integrating three services (i.e., networking, storage, and computing). We evaluate their performance. Specifically, we study the networking services and their throughput and latency with a focus on academic cloud providers; the storage services and their performance with a focus on data movement using file system mappers for both academic and commercial clouds; and computing orchestration services focusing on commercial cloud providers. We discuss NSDF's potential to increase scalability and usability as it decreases time-to-discovery across scientific domains.
KW - cloud computing
KW - data democratization
KW - high-performance computing
KW - perfsonar
KW - XRootD
UR - http://www.scopus.com/inward/record.url?scp=85191543331&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85191543331&partnerID=8YFLogxK
U2 - 10.1145/3603166.3632136
DO - 10.1145/3603166.3632136
M3 - Conference contribution
AN - SCOPUS:85191543331
T3 - 16th IEEE/ACM International Conference on Utility and Cloud Computing, UCC 2023
BT - 16th IEEE/ACM International Conference on Utility and Cloud Computing, UCC 2023
PB - Association for Computing Machinery
Y2 - 4 December 2023 through 7 December 2023
ER -