Implementing computational reproducibility in the Whole Tale environment

Kyle Chard, Niall Gaffney, Matthew B. Jones, Kacper Kowalik, Bertram Ludaescher, Jarek Nabrzyski, Victoria Stodden, Ian Taylor, Matthew J Turk, Craig Willis

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

We present and define a structured digital object, called a "Tale," for the dissemination and publication of computational scientific findings in the scholarly record. The Tale emerges from the NSF funded Whole Tale project (wholetale.org) which is developing a computational environment designed to capture the entire computational pipeline associated with a scientific experiment and thereby enable computational reproducibility. A Tale allows researchers to create and package code, data and information about the workflow and computational environment necessary to support, review, and recreate the computational results reported in published research. The Tale then captures the artifacts and information needed to facilitate understanding, transparency, and execution of the Tale for review and reproducibility at the time of publication.

Original languageEnglish (US)
Title of host publicationP-RECS 2019 - Proceedings of the 2nd International Workshop on Practical Reproducible Evaluation of Computer Systems, co-located with HPDC 2019
PublisherAssociation for Computing Machinery, Inc
Pages17-22
Number of pages6
ISBN (Electronic)9781450367561
DOIs
StatePublished - Jun 17 2019
Event2nd International Workshop on Practical Reproducible Evaluation of Computer Systems, P-RECS 2019, co-located with HPDC 2019 - Phoenix, United States
Duration: Jun 24 2019 → …

Publication series

NameP-RECS 2019 - Proceedings of the 2nd International Workshop on Practical Reproducible Evaluation of Computer Systems, co-located with HPDC 2019

Conference

Conference2nd International Workshop on Practical Reproducible Evaluation of Computer Systems, P-RECS 2019, co-located with HPDC 2019
CountryUnited States
CityPhoenix
Period6/24/19 → …

Fingerprint

Transparency
Pipelines
Experiments

Keywords

  • Computing environments
  • Cyberinfrastructure
  • Open code
  • Open data
  • Publishing standards
  • Reproducibility

ASJC Scopus subject areas

  • Computational Theory and Mathematics
  • Computer Science Applications
  • Software

Cite this

Chard, K., Gaffney, N., Jones, M. B., Kowalik, K., Ludaescher, B., Nabrzyski, J., ... Willis, C. (2019). Implementing computational reproducibility in the Whole Tale environment. In P-RECS 2019 - Proceedings of the 2nd International Workshop on Practical Reproducible Evaluation of Computer Systems, co-located with HPDC 2019 (pp. 17-22). (P-RECS 2019 - Proceedings of the 2nd International Workshop on Practical Reproducible Evaluation of Computer Systems, co-located with HPDC 2019). Association for Computing Machinery, Inc. https://doi.org/10.1145/3322790.3330594

Implementing computational reproducibility in the Whole Tale environment. / Chard, Kyle; Gaffney, Niall; Jones, Matthew B.; Kowalik, Kacper; Ludaescher, Bertram; Nabrzyski, Jarek; Stodden, Victoria; Taylor, Ian; Turk, Matthew J; Willis, Craig.

P-RECS 2019 - Proceedings of the 2nd International Workshop on Practical Reproducible Evaluation of Computer Systems, co-located with HPDC 2019. Association for Computing Machinery, Inc, 2019. p. 17-22 (P-RECS 2019 - Proceedings of the 2nd International Workshop on Practical Reproducible Evaluation of Computer Systems, co-located with HPDC 2019).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Chard, K, Gaffney, N, Jones, MB, Kowalik, K, Ludaescher, B, Nabrzyski, J, Stodden, V, Taylor, I, Turk, MJ & Willis, C 2019, Implementing computational reproducibility in the Whole Tale environment. in P-RECS 2019 - Proceedings of the 2nd International Workshop on Practical Reproducible Evaluation of Computer Systems, co-located with HPDC 2019. P-RECS 2019 - Proceedings of the 2nd International Workshop on Practical Reproducible Evaluation of Computer Systems, co-located with HPDC 2019, Association for Computing Machinery, Inc, pp. 17-22, 2nd International Workshop on Practical Reproducible Evaluation of Computer Systems, P-RECS 2019, co-located with HPDC 2019, Phoenix, United States, 6/24/19. https://doi.org/10.1145/3322790.3330594
Chard K, Gaffney N, Jones MB, Kowalik K, Ludaescher B, Nabrzyski J et al. Implementing computational reproducibility in the Whole Tale environment. In P-RECS 2019 - Proceedings of the 2nd International Workshop on Practical Reproducible Evaluation of Computer Systems, co-located with HPDC 2019. Association for Computing Machinery, Inc. 2019. p. 17-22. (P-RECS 2019 - Proceedings of the 2nd International Workshop on Practical Reproducible Evaluation of Computer Systems, co-located with HPDC 2019). https://doi.org/10.1145/3322790.3330594
Chard, Kyle ; Gaffney, Niall ; Jones, Matthew B. ; Kowalik, Kacper ; Ludaescher, Bertram ; Nabrzyski, Jarek ; Stodden, Victoria ; Taylor, Ian ; Turk, Matthew J ; Willis, Craig. / Implementing computational reproducibility in the Whole Tale environment. P-RECS 2019 - Proceedings of the 2nd International Workshop on Practical Reproducible Evaluation of Computer Systems, co-located with HPDC 2019. Association for Computing Machinery, Inc, 2019. pp. 17-22 (P-RECS 2019 - Proceedings of the 2nd International Workshop on Practical Reproducible Evaluation of Computer Systems, co-located with HPDC 2019).
@inproceedings{a240240f29244806b8df2cc363da093e,
title = "Implementing computational reproducibility in the Whole Tale environment",
abstract = "We present and define a structured digital object, called a {"}Tale,{"} for the dissemination and publication of computational scientific findings in the scholarly record. The Tale emerges from the NSF funded Whole Tale project (wholetale.org) which is developing a computational environment designed to capture the entire computational pipeline associated with a scientific experiment and thereby enable computational reproducibility. A Tale allows researchers to create and package code, data and information about the workflow and computational environment necessary to support, review, and recreate the computational results reported in published research. The Tale then captures the artifacts and information needed to facilitate understanding, transparency, and execution of the Tale for review and reproducibility at the time of publication.",
keywords = "Computing environments, Cyberinfrastructure, Open code, Open data, Publishing standards, Reproducibility",
author = "Kyle Chard and Niall Gaffney and Jones, {Matthew B.} and Kacper Kowalik and Bertram Ludaescher and Jarek Nabrzyski and Victoria Stodden and Ian Taylor and Turk, {Matthew J} and Craig Willis",
year = "2019",
month = "6",
day = "17",
doi = "10.1145/3322790.3330594",
language = "English (US)",
series = "P-RECS 2019 - Proceedings of the 2nd International Workshop on Practical Reproducible Evaluation of Computer Systems, co-located with HPDC 2019",
publisher = "Association for Computing Machinery, Inc",
pages = "17--22",
booktitle = "P-RECS 2019 - Proceedings of the 2nd International Workshop on Practical Reproducible Evaluation of Computer Systems, co-located with HPDC 2019",

}

TY - GEN

T1 - Implementing computational reproducibility in the Whole Tale environment

AU - Chard, Kyle

AU - Gaffney, Niall

AU - Jones, Matthew B.

AU - Kowalik, Kacper

AU - Ludaescher, Bertram

AU - Nabrzyski, Jarek

AU - Stodden, Victoria

AU - Taylor, Ian

AU - Turk, Matthew J

AU - Willis, Craig

PY - 2019/6/17

Y1 - 2019/6/17

N2 - We present and define a structured digital object, called a "Tale," for the dissemination and publication of computational scientific findings in the scholarly record. The Tale emerges from the NSF funded Whole Tale project (wholetale.org) which is developing a computational environment designed to capture the entire computational pipeline associated with a scientific experiment and thereby enable computational reproducibility. A Tale allows researchers to create and package code, data and information about the workflow and computational environment necessary to support, review, and recreate the computational results reported in published research. The Tale then captures the artifacts and information needed to facilitate understanding, transparency, and execution of the Tale for review and reproducibility at the time of publication.

AB - We present and define a structured digital object, called a "Tale," for the dissemination and publication of computational scientific findings in the scholarly record. The Tale emerges from the NSF funded Whole Tale project (wholetale.org) which is developing a computational environment designed to capture the entire computational pipeline associated with a scientific experiment and thereby enable computational reproducibility. A Tale allows researchers to create and package code, data and information about the workflow and computational environment necessary to support, review, and recreate the computational results reported in published research. The Tale then captures the artifacts and information needed to facilitate understanding, transparency, and execution of the Tale for review and reproducibility at the time of publication.

KW - Computing environments

KW - Cyberinfrastructure

KW - Open code

KW - Open data

KW - Publishing standards

KW - Reproducibility

UR - http://www.scopus.com/inward/record.url?scp=85069169849&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85069169849&partnerID=8YFLogxK

U2 - 10.1145/3322790.3330594

DO - 10.1145/3322790.3330594

M3 - Conference contribution

T3 - P-RECS 2019 - Proceedings of the 2nd International Workshop on Practical Reproducible Evaluation of Computer Systems, co-located with HPDC 2019

SP - 17

EP - 22

BT - P-RECS 2019 - Proceedings of the 2nd International Workshop on Practical Reproducible Evaluation of Computer Systems, co-located with HPDC 2019

PB - Association for Computing Machinery, Inc

ER -