Container-based analysis environments for low-barrier access to research data

Craig Willis, Mike Lambert, Kenton Guadron McHenry, Christine Kirkpatrick

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

The growing size of high-value sensor-born or computation-Ally derived scientific datasets are pushing the boundaries of traditional models of data access and discovery. Due to their size, these datasets are often accessible only through the systems on which they were created. Access for scientific exploration and reproducibility is limited to file transfer or by applying for access to the systems used to store or gen-erate the original data, which is often infeasible. There is a growing trend toward providing access to large-scale re-search datasets in-place via container-based analysis envi-ronments. This paper describes the National Data Service (NDS) Labs Workbench platform and DataDNS initiative. The Labs Workbench platform is designed to provide scal-Able and low-barrier access to research data via container-based services. The DataDNS effort is a new initiative de-signed to enable discovery, access, and in-place analysis for large-scale data, providing a suite of interoperable services to enable researchers, as well as the tools they are most fa-miliar with, to access and analyze these datasets where they reside.

Original languageEnglish (US)
Title of host publicationPEARC 2017 - Practice and Experience in Advanced Research Computing 2017
Subtitle of host publicationSustainability, Success and Impact
PublisherAssociation for Computing Machinery
ISBN (Electronic)9781450352727
DOIs
StatePublished - Jul 9 2017
Event2017 Practice and Experience in Advanced Research Computing, PEARC 2017 - New Orleans, United States
Duration: Jul 9 2017Jul 13 2017

Publication series

NameACM International Conference Proceeding Series
VolumePart F128771

Other

Other2017 Practice and Experience in Advanced Research Computing, PEARC 2017
CountryUnited States
CityNew Orleans
Period7/9/177/13/17

Fingerprint

Containers
Sensors

Keywords

  • Container-based analysis environments
  • Research data

ASJC Scopus subject areas

  • Software
  • Human-Computer Interaction
  • Computer Vision and Pattern Recognition
  • Computer Networks and Communications

Cite this

Willis, C., Lambert, M., McHenry, K. G., & Kirkpatrick, C. (2017). Container-based analysis environments for low-barrier access to research data. In PEARC 2017 - Practice and Experience in Advanced Research Computing 2017: Sustainability, Success and Impact [a58] (ACM International Conference Proceeding Series; Vol. Part F128771). Association for Computing Machinery. https://doi.org/10.1145/3093338.3104164

Container-based analysis environments for low-barrier access to research data. / Willis, Craig; Lambert, Mike; McHenry, Kenton Guadron; Kirkpatrick, Christine.

PEARC 2017 - Practice and Experience in Advanced Research Computing 2017: Sustainability, Success and Impact. Association for Computing Machinery, 2017. a58 (ACM International Conference Proceeding Series; Vol. Part F128771).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Willis, C, Lambert, M, McHenry, KG & Kirkpatrick, C 2017, Container-based analysis environments for low-barrier access to research data. in PEARC 2017 - Practice and Experience in Advanced Research Computing 2017: Sustainability, Success and Impact., a58, ACM International Conference Proceeding Series, vol. Part F128771, Association for Computing Machinery, 2017 Practice and Experience in Advanced Research Computing, PEARC 2017, New Orleans, United States, 7/9/17. https://doi.org/10.1145/3093338.3104164
Willis C, Lambert M, McHenry KG, Kirkpatrick C. Container-based analysis environments for low-barrier access to research data. In PEARC 2017 - Practice and Experience in Advanced Research Computing 2017: Sustainability, Success and Impact. Association for Computing Machinery. 2017. a58. (ACM International Conference Proceeding Series). https://doi.org/10.1145/3093338.3104164
Willis, Craig ; Lambert, Mike ; McHenry, Kenton Guadron ; Kirkpatrick, Christine. / Container-based analysis environments for low-barrier access to research data. PEARC 2017 - Practice and Experience in Advanced Research Computing 2017: Sustainability, Success and Impact. Association for Computing Machinery, 2017. (ACM International Conference Proceeding Series).
@inproceedings{def84084ae3b4540893839a3e118b2ef,
title = "Container-based analysis environments for low-barrier access to research data",
abstract = "The growing size of high-value sensor-born or computation-Ally derived scientific datasets are pushing the boundaries of traditional models of data access and discovery. Due to their size, these datasets are often accessible only through the systems on which they were created. Access for scientific exploration and reproducibility is limited to file transfer or by applying for access to the systems used to store or gen-erate the original data, which is often infeasible. There is a growing trend toward providing access to large-scale re-search datasets in-place via container-based analysis envi-ronments. This paper describes the National Data Service (NDS) Labs Workbench platform and DataDNS initiative. The Labs Workbench platform is designed to provide scal-Able and low-barrier access to research data via container-based services. The DataDNS effort is a new initiative de-signed to enable discovery, access, and in-place analysis for large-scale data, providing a suite of interoperable services to enable researchers, as well as the tools they are most fa-miliar with, to access and analyze these datasets where they reside.",
keywords = "Container-based analysis environments, Research data",
author = "Craig Willis and Mike Lambert and McHenry, {Kenton Guadron} and Christine Kirkpatrick",
year = "2017",
month = "7",
day = "9",
doi = "10.1145/3093338.3104164",
language = "English (US)",
series = "ACM International Conference Proceeding Series",
publisher = "Association for Computing Machinery",
booktitle = "PEARC 2017 - Practice and Experience in Advanced Research Computing 2017",

}

TY - GEN

T1 - Container-based analysis environments for low-barrier access to research data

AU - Willis, Craig

AU - Lambert, Mike

AU - McHenry, Kenton Guadron

AU - Kirkpatrick, Christine

PY - 2017/7/9

Y1 - 2017/7/9

N2 - The growing size of high-value sensor-born or computation-Ally derived scientific datasets are pushing the boundaries of traditional models of data access and discovery. Due to their size, these datasets are often accessible only through the systems on which they were created. Access for scientific exploration and reproducibility is limited to file transfer or by applying for access to the systems used to store or gen-erate the original data, which is often infeasible. There is a growing trend toward providing access to large-scale re-search datasets in-place via container-based analysis envi-ronments. This paper describes the National Data Service (NDS) Labs Workbench platform and DataDNS initiative. The Labs Workbench platform is designed to provide scal-Able and low-barrier access to research data via container-based services. The DataDNS effort is a new initiative de-signed to enable discovery, access, and in-place analysis for large-scale data, providing a suite of interoperable services to enable researchers, as well as the tools they are most fa-miliar with, to access and analyze these datasets where they reside.

AB - The growing size of high-value sensor-born or computation-Ally derived scientific datasets are pushing the boundaries of traditional models of data access and discovery. Due to their size, these datasets are often accessible only through the systems on which they were created. Access for scientific exploration and reproducibility is limited to file transfer or by applying for access to the systems used to store or gen-erate the original data, which is often infeasible. There is a growing trend toward providing access to large-scale re-search datasets in-place via container-based analysis envi-ronments. This paper describes the National Data Service (NDS) Labs Workbench platform and DataDNS initiative. The Labs Workbench platform is designed to provide scal-Able and low-barrier access to research data via container-based services. The DataDNS effort is a new initiative de-signed to enable discovery, access, and in-place analysis for large-scale data, providing a suite of interoperable services to enable researchers, as well as the tools they are most fa-miliar with, to access and analyze these datasets where they reside.

KW - Container-based analysis environments

KW - Research data

UR - http://www.scopus.com/inward/record.url?scp=85025808885&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85025808885&partnerID=8YFLogxK

U2 - 10.1145/3093338.3104164

DO - 10.1145/3093338.3104164

M3 - Conference contribution

AN - SCOPUS:85025808885

T3 - ACM International Conference Proceeding Series

BT - PEARC 2017 - Practice and Experience in Advanced Research Computing 2017

PB - Association for Computing Machinery

ER -