Providing Accessible Software Environments Across Science Gateways and HPC

Alexander Michels, Mit Kotak, Anand Padmanabhan, John Speaks, Shaowen Wang

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

While High-Performance Computing (HPC) resources are powerful for tackling complex, computationally intensive analysis and modeling problems, access to these resources varies across disciplines. Domain scientists in a variety of fields such as social and environmental sciences often lack in-depth technical skills (e.g., familiarity with terminal, knowledge of job schedulers) to effectively utilize HPC resources, hindering desired research. In this context, CyberGIS-Compute is a middleware toolkit designed to democratize HPC access with the main goal of enabling domain scientists in diverse fields to solve computationally intensive problems. A key challenge facing model developers on CyberGIS-Compute is to create a containerized software environment for their models. Domain experts unfamiliar with HPC are generally unfamiliar with containerization technologies (e.g., Docker, Singularity) and thus unable to create/test containers to execute their models. But if they have access to science gateways, they would want to use these familiar software environments on HPC resources. This paper describes a novel approach to integrating the Cern Virtual Machine File System (CVMFS) into CyberGIS-Compute to provide consistent software environments across science gateways and HPC resources.

Original languageEnglish (US)
Title of host publicationPEARC 2024 - Practice and Experience in Advanced Research Computing 2024
Subtitle of host publicationHuman Powered Computing
PublisherAssociation for Computing Machinery
ISBN (Electronic)9798400704192
DOIs
StatePublished - Jul 17 2024
Event2024 Practice and Experience in Advanced Research Computing, PEARC 2024 - Providence, United States
Duration: Jul 21 2024Jul 25 2024

Publication series

NamePEARC 2024 - Practice and Experience in Advanced Research Computing 2024: Human Powered Computing

Conference

Conference2024 Practice and Experience in Advanced Research Computing, PEARC 2024
Country/TerritoryUnited States
CityProvidence
Period7/21/247/25/24

Keywords

  • CVMFS
  • cyberGIS
  • HPC
  • Jupyter
  • middleware
  • Python

ASJC Scopus subject areas

  • Computational Theory and Mathematics
  • Computer Networks and Communications
  • Computer Science Applications
  • Software
  • Theoretical Computer Science

Fingerprint

Dive into the research topics of 'Providing Accessible Software Environments Across Science Gateways and HPC'. Together they form a unique fingerprint.

Cite this