Yin & Yang: Demonstrating complementary provenance from noWorkflow & yesWorkflow

João Felipe Pimentel; Saumen Dey; Timothy McPhillips; Khalid Belhajjame; David Koop; Leonardo Murta; Vanessa Braganholo; Bertram Ludäscher

doi:10.1007/978-3-319-40593-3_13

Yin & Yang: Demonstrating complementary provenance from noWorkflow & yesWorkflow

João Felipe Pimentel, Saumen Dey, Timothy McPhillips, Khalid Belhajjame, David Koop, Leonardo Murta, Vanessa Braganholo, Bertram Ludäscher

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Abstract

The noWorkflow and YesWorkflow toolkits both enable researchers to capture, store, query, and visualize the provenance of results produced by scripts that process scientific data. noWorkflow captures prospective provenance representing the program structure of Python scripts, and retrospective provenance representing key events observed during script execution. YesWorkflow captures prospective provenance declared through annotations in the comments of scripts, and supports key retrospective provenance queries by observing what files were used or produced by the script. We demonstrate how combining complementary information gathered by noWorkflow and YesWorkflow enables provenance queries and data lineage visualizations neither tool can provide on its own.

Original language	English (US)
Title of host publication	Provenance and Annotation of Data and Processes - 6th International Provenance and Annotation Workshop, IPAW 2016, Proceedings
Editors	Boris Glavic, Marta Mattoso
Publisher	Springer
Pages	161-165
Number of pages	5
ISBN (Print)	9783319405926
DOIs	https://doi.org/10.1007/978-3-319-40593-3_13
State	Published - 2016
Event	6th International Provenance and Annotation Workshop, IPAW 2016 - McLean, United States Duration: Jun 7 2016 → Jun 8 2016

Publication series

Name	Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume	9672
ISSN (Print)	0302-9743
ISSN (Electronic)	1611-3349

Other

Other	6th International Provenance and Annotation Workshop, IPAW 2016
Country/Territory	United States
City	McLean
Period	6/7/16 → 6/8/16

ASJC Scopus subject areas

Theoretical Computer Science
Computer Science(all)

Online availability

10.1007/978-3-319-40593-3_13

Library availability

Discover UIUC Full Text

Cite this

Pimentel, J. F., Dey, S., McPhillips, T., Belhajjame, K., Koop, D., Murta, L., Braganholo, V., & Ludäscher, B. (2016). Yin & Yang: Demonstrating complementary provenance from noWorkflow & yesWorkflow. In B. Glavic, & M. Mattoso (Eds.), Provenance and Annotation of Data and Processes - 6th International Provenance and Annotation Workshop, IPAW 2016, Proceedings (pp. 161-165). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 9672). Springer. https://doi.org/10.1007/978-3-319-40593-3_13

Yin & Yang : Demonstrating complementary provenance from noWorkflow & yesWorkflow. / Pimentel, João Felipe; Dey, Saumen; McPhillips, Timothy; Belhajjame, Khalid; Koop, David; Murta, Leonardo; Braganholo, Vanessa; Ludäscher, Bertram.

Provenance and Annotation of Data and Processes - 6th International Provenance and Annotation Workshop, IPAW 2016, Proceedings. ed. / Boris Glavic; Marta Mattoso. Springer, 2016. p. 161-165 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 9672).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Pimentel, JF, Dey, S, McPhillips, T, Belhajjame, K, Koop, D, Murta, L, Braganholo, V & Ludäscher, B 2016, Yin & Yang: Demonstrating complementary provenance from noWorkflow & yesWorkflow. in B Glavic & M Mattoso (eds), Provenance and Annotation of Data and Processes - 6th International Provenance and Annotation Workshop, IPAW 2016, Proceedings. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 9672, Springer, pp. 161-165, 6th International Provenance and Annotation Workshop, IPAW 2016, McLean, United States, 6/7/16. https://doi.org/10.1007/978-3-319-40593-3_13

Pimentel JF, Dey S, McPhillips T, Belhajjame K, Koop D, Murta L et al. Yin & Yang: Demonstrating complementary provenance from noWorkflow & yesWorkflow. In Glavic B, Mattoso M, editors, Provenance and Annotation of Data and Processes - 6th International Provenance and Annotation Workshop, IPAW 2016, Proceedings. Springer. 2016. p. 161-165. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). https://doi.org/10.1007/978-3-319-40593-3_13

Pimentel, João Felipe ; Dey, Saumen ; McPhillips, Timothy ; Belhajjame, Khalid ; Koop, David ; Murta, Leonardo ; Braganholo, Vanessa ; Ludäscher, Bertram. / Yin & Yang : Demonstrating complementary provenance from noWorkflow & yesWorkflow. Provenance and Annotation of Data and Processes - 6th International Provenance and Annotation Workshop, IPAW 2016, Proceedings. editor / Boris Glavic ; Marta Mattoso. Springer, 2016. pp. 161-165 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).

@inproceedings{69bac1252a684629baa43b48e350068d,

title = "Yin & Yang: Demonstrating complementary provenance from noWorkflow & yesWorkflow",

abstract = "The noWorkflow and YesWorkflow toolkits both enable researchers to capture, store, query, and visualize the provenance of results produced by scripts that process scientific data. noWorkflow captures prospective provenance representing the program structure of Python scripts, and retrospective provenance representing key events observed during script execution. YesWorkflow captures prospective provenance declared through annotations in the comments of scripts, and supports key retrospective provenance queries by observing what files were used or produced by the script. We demonstrate how combining complementary information gathered by noWorkflow and YesWorkflow enables provenance queries and data lineage visualizations neither tool can provide on its own.",

author = "Pimentel, {Jo{\~a}o Felipe} and Saumen Dey and Timothy McPhillips and Khalid Belhajjame and David Koop and Leonardo Murta and Vanessa Braganholo and Bertram Lud{\"a}scher",

note = "Publisher Copyright: {\textcopyright} Springer International Publishing Switzerland 2016. Copyright: Copyright 2017 Elsevier B.V., All rights reserved.; 6th International Provenance and Annotation Workshop, IPAW 2016 ; Conference date: 07-06-2016 Through 08-06-2016",

year = "2016",

doi = "10.1007/978-3-319-40593-3_13",

language = "English (US)",

isbn = "9783319405926",

series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",

publisher = "Springer",

pages = "161--165",

editor = "Boris Glavic and Marta Mattoso",

booktitle = "Provenance and Annotation of Data and Processes - 6th International Provenance and Annotation Workshop, IPAW 2016, Proceedings",

address = "Germany",

}

TY - GEN

T1 - Yin & Yang

T2 - 6th International Provenance and Annotation Workshop, IPAW 2016

AU - Pimentel, João Felipe

AU - Dey, Saumen

AU - McPhillips, Timothy

AU - Belhajjame, Khalid

AU - Koop, David

AU - Murta, Leonardo

AU - Braganholo, Vanessa

AU - Ludäscher, Bertram

PY - 2016

Y1 - 2016

N2 - The noWorkflow and YesWorkflow toolkits both enable researchers to capture, store, query, and visualize the provenance of results produced by scripts that process scientific data. noWorkflow captures prospective provenance representing the program structure of Python scripts, and retrospective provenance representing key events observed during script execution. YesWorkflow captures prospective provenance declared through annotations in the comments of scripts, and supports key retrospective provenance queries by observing what files were used or produced by the script. We demonstrate how combining complementary information gathered by noWorkflow and YesWorkflow enables provenance queries and data lineage visualizations neither tool can provide on its own.

AB - The noWorkflow and YesWorkflow toolkits both enable researchers to capture, store, query, and visualize the provenance of results produced by scripts that process scientific data. noWorkflow captures prospective provenance representing the program structure of Python scripts, and retrospective provenance representing key events observed during script execution. YesWorkflow captures prospective provenance declared through annotations in the comments of scripts, and supports key retrospective provenance queries by observing what files were used or produced by the script. We demonstrate how combining complementary information gathered by noWorkflow and YesWorkflow enables provenance queries and data lineage visualizations neither tool can provide on its own.

UR - http://www.scopus.com/inward/record.url?scp=84976628767&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84976628767&partnerID=8YFLogxK

U2 - 10.1007/978-3-319-40593-3_13

DO - 10.1007/978-3-319-40593-3_13

M3 - Conference contribution

AN - SCOPUS:84976628767

SN - 9783319405926

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 161

EP - 165

BT - Provenance and Annotation of Data and Processes - 6th International Provenance and Annotation Workshop, IPAW 2016, Proceedings

A2 - Glavic, Boris

A2 - Mattoso, Marta

PB - Springer

Y2 - 7 June 2016 through 8 June 2016

ER -

Yin & Yang: Demonstrating complementary provenance from noWorkflow & yesWorkflow

Abstract

Publication series

Other

ASJC Scopus subject areas

Online availability

Library availability

Related links

Fingerprint

Cite this