NSDF-Services: Integrating Networking, Storage, and Computing Services into a Testbed for Democratization of Data Delivery

Jakob Luettgau, Heberth Martinez, Paula Olaya, Giorgio Scorzelli, Glenn Tarcea, Jay Lofstead, Christine Kirkpatrick, Valerio Pascucci, Michela Taufer

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

The lack of a readily accessible, tightly integrated data fabric connecting high-speed networking, storage, and computing services remains a critical barrier to the democratization of scientific discovery. To address this challenge, we are building National Science Data Fabric (NSDF), a holistic ecosystem to facilitate domain scientists in their daily research. NSDF comprises networking, storage, and computing services, as well as outreach initiatives. In this paper, we present a testbed integrating three services (i.e., networking, storage, and computing). We evaluate their performance. Specifically, we study the networking services and their throughput and latency with a focus on academic cloud providers; the storage services and their performance with a focus on data movement using file system mappers for both academic and commercial clouds; and computing orchestration services focusing on commercial cloud providers. We discuss NSDF's potential to increase scalability and usability as it decreases time-to-discovery across scientific domains.

Original languageEnglish (US)
Title of host publication16th IEEE/ACM International Conference on Utility and Cloud Computing, UCC 2023
PublisherAssociation for Computing Machinery
ISBN (Electronic)9798400702341
DOIs
StatePublished - Dec 4 2023
Externally publishedYes
Event16th IEEE/ACM International Conference on Utility and Cloud Computing, UCC 2023 - Taormina, Italy
Duration: Dec 4 2023Dec 7 2023

Publication series

Name16th IEEE/ACM International Conference on Utility and Cloud Computing, UCC 2023

Conference

Conference16th IEEE/ACM International Conference on Utility and Cloud Computing, UCC 2023
Country/TerritoryItaly
CityTaormina
Period12/4/2312/7/23

Keywords

  • cloud computing
  • data democratization
  • high-performance computing
  • perfsonar
  • XRootD

ASJC Scopus subject areas

  • Computer Networks and Communications
  • Hardware and Architecture

Fingerprint

Dive into the research topics of 'NSDF-Services: Integrating Networking, Storage, and Computing Services into a Testbed for Democratization of Data Delivery'. Together they form a unique fingerprint.

Cite this