Toward enabling reproducibility for data-intensive research sing the whole tale platform

Kyle Chard; Niall Gaffney; Mihael Hategan; Kacper Kowalik; Bertram Ludäscher; Timothy McPhillips; Jarek Nabrzyski; Victoria Stodden; Ian Taylor; Thomas Thelen; Matthew J. Turk; Craig Willis

doi:10.3233/APC200107

Toward enabling reproducibility for data-intensive research sing the whole tale platform

Kyle Chard, Niall Gaffney, Mihael Hategan, Kacper Kowalik, Bertram Ludäscher, Timothy McPhillips, Jarek Nabrzyski, Victoria Stodden, Ian Taylor, Thomas Thelen, Matthew J. Turk, Craig Willis

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Abstract

Whole Tale http://wholetale.org is a web-based, open-source platform for reproducible research supporting the creation, sharing, execution, and verification of 'Tales' for the scientific research community. Tales are executable research objects that capture the code, data, and environment along with narrative and workflow information needed to re-create computational results from scientific studies. Creating reproducible research objects that enable reproducibility, transparency, and re-execution for computational experiments requiring significant compute resources or utilizing massive data is an especially challenging open problem. We describe opportunities, challenges, and solutions to facilitating reproducibility for data-and compute-intensive research, that we call 'Tales at Scale,' using the Whole Tale computing platform.We highlight challenges and solutions in frontend responsiveness needs, gaps in current middleware design and implementation, network restrictions, containerization, and data access. Finally, we discuss challenges in packaging computational experiment implementations for portable data-intensive Tales and outline future work.

Original language	English (US)
Title of host publication	Parallel Computing
Subtitle of host publication	Technology Trends
Editors	Ian Foster, Gerhard R. Joubert, Ludek Kucera, Wolfgang E. Nagel, Frans Peters
Publisher	IOS Press BV
Pages	766-778
Number of pages	13
ISBN (Electronic)	9781643680705
DOIs	https://doi.org/10.3233/APC200107
State	Published - 2020

Publication series

Name	Advances in Parallel Computing
Volume	36
ISSN (Print)	0927-5452
ISSN (Electronic)	1879-808X

Keywords

Big data
Computational science
Cyberinfrastructure
Data provenance
Platform as a service
Replicability
Reproducibility
Reproducible research
Scalability
Science as a service
Scientific computing
Scientific workflows
Transparency

ASJC Scopus subject areas

General Computer Science

Online availability

10.3233/APC200107

Library availability

Discover UIUC Full Text

Cite this

Chard, K., Gaffney, N., Hategan, M., Kowalik, K., Ludäscher, B., McPhillips, T., Nabrzyski, J., Stodden, V., Taylor, I., Thelen, T., Turk, M. J., & Willis, C. (2020). Toward enabling reproducibility for data-intensive research sing the whole tale platform. In I. Foster, G. R. Joubert, L. Kucera, W. E. Nagel, & F. Peters (Eds.), Parallel Computing: Technology Trends (pp. 766-778). (Advances in Parallel Computing; Vol. 36). IOS Press BV. https://doi.org/10.3233/APC200107

Toward enabling reproducibility for data-intensive research sing the whole tale platform. / Chard, Kyle; Gaffney, Niall; Hategan, Mihael et al.
Parallel Computing: Technology Trends. ed. / Ian Foster; Gerhard R. Joubert; Ludek Kucera; Wolfgang E. Nagel; Frans Peters. IOS Press BV, 2020. p. 766-778 (Advances in Parallel Computing; Vol. 36).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Chard, K, Gaffney, N, Hategan, M, Kowalik, K, Ludäscher, B, McPhillips, T, Nabrzyski, J, Stodden, V, Taylor, I, Thelen, T, Turk, MJ & Willis, C 2020, Toward enabling reproducibility for data-intensive research sing the whole tale platform. in I Foster, GR Joubert, L Kucera, WE Nagel & F Peters (eds), Parallel Computing: Technology Trends. Advances in Parallel Computing, vol. 36, IOS Press BV, pp. 766-778. https://doi.org/10.3233/APC200107

@inproceedings{5b6ac49ad463417ba76eb7c028634b21,

title = "Toward enabling reproducibility for data-intensive research sing the whole tale platform",

abstract = "Whole Tale http://wholetale.org is a web-based, open-source platform for reproducible research supporting the creation, sharing, execution, and verification of 'Tales' for the scientific research community. Tales are executable research objects that capture the code, data, and environment along with narrative and workflow information needed to re-create computational results from scientific studies. Creating reproducible research objects that enable reproducibility, transparency, and re-execution for computational experiments requiring significant compute resources or utilizing massive data is an especially challenging open problem. We describe opportunities, challenges, and solutions to facilitating reproducibility for data-and compute-intensive research, that we call 'Tales at Scale,' using the Whole Tale computing platform.We highlight challenges and solutions in frontend responsiveness needs, gaps in current middleware design and implementation, network restrictions, containerization, and data access. Finally, we discuss challenges in packaging computational experiment implementations for portable data-intensive Tales and outline future work.",

keywords = "Big data, Computational science, Cyberinfrastructure, Data provenance, Platform as a service, Replicability, Reproducibility, Reproducible research, Scalability, Science as a service, Scientific computing, Scientific workflows, Transparency",

author = "Kyle Chard and Niall Gaffney and Mihael Hategan and Kacper Kowalik and Bertram Lud{\"a}scher and Timothy McPhillips and Jarek Nabrzyski and Victoria Stodden and Ian Taylor and Thomas Thelen and Turk, {Matthew J.} and Craig Willis",

note = "Publisher Copyright: {\textcopyright} 2020 The authors and IOS Press.",

year = "2020",

doi = "10.3233/APC200107",

language = "English (US)",

series = "Advances in Parallel Computing",

publisher = "IOS Press BV",

pages = "766--778",

editor = "Ian Foster and Joubert, {Gerhard R.} and Ludek Kucera and Nagel, {Wolfgang E.} and Frans Peters",

booktitle = "Parallel Computing",

}

TY - GEN

T1 - Toward enabling reproducibility for data-intensive research sing the whole tale platform

AU - Chard, Kyle

AU - Gaffney, Niall

AU - Hategan, Mihael

AU - Kowalik, Kacper

AU - Ludäscher, Bertram

AU - McPhillips, Timothy

AU - Nabrzyski, Jarek

AU - Stodden, Victoria

AU - Taylor, Ian

AU - Thelen, Thomas

AU - Turk, Matthew J.

AU - Willis, Craig

PY - 2020

Y1 - 2020

N2 - Whole Tale http://wholetale.org is a web-based, open-source platform for reproducible research supporting the creation, sharing, execution, and verification of 'Tales' for the scientific research community. Tales are executable research objects that capture the code, data, and environment along with narrative and workflow information needed to re-create computational results from scientific studies. Creating reproducible research objects that enable reproducibility, transparency, and re-execution for computational experiments requiring significant compute resources or utilizing massive data is an especially challenging open problem. We describe opportunities, challenges, and solutions to facilitating reproducibility for data-and compute-intensive research, that we call 'Tales at Scale,' using the Whole Tale computing platform.We highlight challenges and solutions in frontend responsiveness needs, gaps in current middleware design and implementation, network restrictions, containerization, and data access. Finally, we discuss challenges in packaging computational experiment implementations for portable data-intensive Tales and outline future work.

AB - Whole Tale http://wholetale.org is a web-based, open-source platform for reproducible research supporting the creation, sharing, execution, and verification of 'Tales' for the scientific research community. Tales are executable research objects that capture the code, data, and environment along with narrative and workflow information needed to re-create computational results from scientific studies. Creating reproducible research objects that enable reproducibility, transparency, and re-execution for computational experiments requiring significant compute resources or utilizing massive data is an especially challenging open problem. We describe opportunities, challenges, and solutions to facilitating reproducibility for data-and compute-intensive research, that we call 'Tales at Scale,' using the Whole Tale computing platform.We highlight challenges and solutions in frontend responsiveness needs, gaps in current middleware design and implementation, network restrictions, containerization, and data access. Finally, we discuss challenges in packaging computational experiment implementations for portable data-intensive Tales and outline future work.

KW - Big data

KW - Computational science

KW - Cyberinfrastructure

KW - Data provenance

KW - Platform as a service

KW - Replicability

KW - Reproducibility

KW - Reproducible research

KW - Scalability

KW - Science as a service

KW - Scientific computing

KW - Scientific workflows

KW - Transparency

UR - http://www.scopus.com/inward/record.url?scp=85083046383&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85083046383&partnerID=8YFLogxK

U2 - 10.3233/APC200107

DO - 10.3233/APC200107

M3 - Conference contribution

AN - SCOPUS:85083046383

T3 - Advances in Parallel Computing

SP - 766

EP - 778

BT - Parallel Computing

A2 - Foster, Ian

A2 - Joubert, Gerhard R.

A2 - Kucera, Ludek

A2 - Nagel, Wolfgang E.

A2 - Peters, Frans

PB - IOS Press BV

ER -

Toward enabling reproducibility for data-intensive research sing the whole tale platform

Abstract

Publication series

Keywords

ASJC Scopus subject areas

Online availability

Library availability

Related links

Fingerprint

Cite this