TY - GEN
T1 - A Community Roadmap for Scientific Workflows Research and Development
AU - Da Silva, Rafael Ferreira
AU - Casanova, Henri
AU - Chard, Kyle
AU - Altintas, Ilkay
AU - Badia, Rosa M.
AU - Balis, Bartosz
AU - Coleman, Taina
AU - Coppens, Frederik
AU - Di Natale, Frank
AU - Enders, Bjoern
AU - Fahringer, Thomas
AU - Filgueira, Rosa
AU - Fursin, Grigori
AU - Garijo, Daniel
AU - Goble, Carole
AU - Howell, Dorran
AU - Jha, Shantenu
AU - Katz, Daniel S.
AU - Laney, Daniel
AU - Leser, Ulf
AU - Malawski, MacIej
AU - Mehta, Kshitij
AU - Pottier, Loic
AU - Ozik, Jonathan
AU - Luc Peterson, J.
AU - Ramakrishnan, Lavanya
AU - Soiland-Reyes, Stian
AU - Thain, Douglas
AU - Wolf, Matthew
N1 - Funding Information:
This work was funded by NSF awards #2016610, #2016682, and #2016619, and by the Exascale Computing Project (17-SC-20-SC), a collaborative effort of the U.S. Department of Energy (DOE) Office of Science and the National Nuclear Security Administration (NNSA). This research used resources of the Oak Ridge Leadership Computing Facility at the Oak Ridge National Laboratory, which is supported by the Office of Science of the U.S. DOE under Contract #DE-AC05-00OR22725.
Publisher Copyright:
© 2021 IEEE.
PY - 2021
Y1 - 2021
N2 - The landscape of workflow systems for scientific applications is notoriously convoluted with hundreds of seemingly equivalent workflow systems, many isolated research claims, and a steep learning curve. To address some of these challenges and lay the groundwork for transforming workflows research and development, the WorkflowsRI and ExaWorks projects partnered to bring the international workflows community together. This paper reports on discussions and findings from two virtual 'Workflows Community Summits' (January and April, 2021). The overarching goals of these workshops were to develop a view of the state of the art, identify crucial research challenges in the workflows community, articulate a vision for potential community efforts, and discuss technical approaches for realizing this vision. To this end, participants identified six broad themes: FAIR computational workflows; AI workflows; exascale challenges; APIs, interoperability, reuse, and standards; training and education; and building a workflows community. We summarize discussions and recommendations for each of these themes.
AB - The landscape of workflow systems for scientific applications is notoriously convoluted with hundreds of seemingly equivalent workflow systems, many isolated research claims, and a steep learning curve. To address some of these challenges and lay the groundwork for transforming workflows research and development, the WorkflowsRI and ExaWorks projects partnered to bring the international workflows community together. This paper reports on discussions and findings from two virtual 'Workflows Community Summits' (January and April, 2021). The overarching goals of these workshops were to develop a view of the state of the art, identify crucial research challenges in the workflows community, articulate a vision for potential community efforts, and discuss technical approaches for realizing this vision. To this end, participants identified six broad themes: FAIR computational workflows; AI workflows; exascale challenges; APIs, interoperability, reuse, and standards; training and education; and building a workflows community. We summarize discussions and recommendations for each of these themes.
KW - AI workflows
KW - Community roadmap
KW - Data management
KW - Exascale computing
KW - Interoperability
KW - Scientific workflows
UR - http://www.scopus.com/inward/record.url?scp=85123475930&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85123475930&partnerID=8YFLogxK
U2 - 10.1109/WORKS54523.2021.00016
DO - 10.1109/WORKS54523.2021.00016
M3 - Conference contribution
AN - SCOPUS:85123475930
T3 - Proceedings of WORKS 2021: 16th Workshop on Workflows in Support of Large-Scale Science, Held in conjunction with SC 2021: The International Conference for High Performance Computing, Networking, Storage and Analysis
SP - 81
EP - 90
BT - Proceedings of WORKS 2021
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 16th IEEE Workshop on Workflows in Support of Large-Scale Science, WORKS 2021
Y2 - 15 November 2021
ER -