TY - GEN
T1 - XML-based computation for scientific workflows
AU - Zinn, Daniel
AU - Bowers, Shawn
AU - Ludaescher, Bertram
PY - 2010
Y1 - 2010
N2 - Scientific workflows are increasingly used to rapidly integrate existing algorithms to create larger and more complex programs. However, designing workflows using purely dataflow-oriented computation models introduces a number of challenges, including the need to use low-level components to mediate and transform data (so-called shims) and large numbers of additional "wires" for routing data to components within a workflow. To address these problems, we employ Virtual Data Assembly Lines (VDAL), a modeling paradigm that can eliminate most shims and reduce wiring complexity. We show how a VDAL design can be implemented using existing XML technologies and how static analysis can provide significant help to scientists during workflow design and evolution, e.g., by displaying actor dependencies or by detecting so-called unproductive actors.
AB - Scientific workflows are increasingly used to rapidly integrate existing algorithms to create larger and more complex programs. However, designing workflows using purely dataflow-oriented computation models introduces a number of challenges, including the need to use low-level components to mediate and transform data (so-called shims) and large numbers of additional "wires" for routing data to components within a workflow. To address these problems, we employ Virtual Data Assembly Lines (VDAL), a modeling paradigm that can eliminate most shims and reduce wiring complexity. We show how a VDAL design can be implemented using existing XML technologies and how static analysis can provide significant help to scientists during workflow design and evolution, e.g., by displaying actor dependencies or by detecting so-called unproductive actors.
UR - http://www.scopus.com/inward/record.url?scp=77952775025&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=77952775025&partnerID=8YFLogxK
U2 - 10.1109/ICDE.2010.5447884
DO - 10.1109/ICDE.2010.5447884
M3 - Conference contribution
AN - SCOPUS:77952775025
SN - 9781424454440
T3 - Proceedings - International Conference on Data Engineering
SP - 812
EP - 815
BT - 26th IEEE International Conference on Data Engineering, ICDE 2010 - Conference Proceedings
T2 - 26th IEEE International Conference on Data Engineering, ICDE 2010
Y2 - 1 March 2010 through 6 March 2010
ER -