On the use of services to support numerical weather prediction

Jay Alameda, Albert L. Rossi, Shawn Hampton

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

The challenges of building an effective grid-based problem solving environment that truly extends and embraces a computational scientist's traditional tools are multifold. It is far too easy to build simple stovepipes that allow fixed use patterns, that don't extend a scientist's desktop, and fail to encompass the full range of patterns that a scientist needs to find such a problem-solving environment as a liberating and enabling tool. In the LEAD project, we have focused on the most challenging users of numerical weather prediction, namely, the atmospheric science researchers, who are prone to use their own tools, their own modified versions of community codes such as the Weather Research and Forecasting (WRF) model, and are typically comfortable with elaborate shell scripts to perform the work they find to be necessary to succeed, to drive our development efforts. Our response to these challenges includes a multi-level workflow engine, to handle both the challenges of ensemble description and execution, as well as the detailed patterns of workflow on each computational resource; services to support the peculiarities of each platform being used to do the modeling (such as on TeraGrid), and the use of an RDF triple store and message bus together as the backbone of our notification, logging, and metadata infrastructure. The design of our problem-solving environment elements attempts to come to grips with lack of control of elements surrounding and supporting the environment; we achieve this through multiple mechanisms including using the OSGI plug-in architecture, as well as the use of RDF triples as our finest-grain descriptive element. This combination, we believe, is an important stepping stone to building a cyber environment, which aims to provide flexibility and ease of use far beyond the current range of typical problem solving environments.

Original languageEnglish (US)
Title of host publicationGrid-Based Problem Solving Environments
Subtitle of host publicationIFIP TC2/ WG 2.5 Working Conference on Grid-Based Problem Solving Environments: Implications for Development and Deployment of Numerical Software
EditorsPatrick W. Gaffney, James C.T. Pool
Pages339-348
Number of pages10
DOIs
StatePublished - Dec 3 2007

Publication series

NameIFIP International Federation for Information Processing
Volume239
ISSN (Print)1571-5736

Fingerprint

Weather
Prediction
Problem solving
Metadata
Shell
Grid
Modeling
Bus
Logging
Resources
Ease of use

ASJC Scopus subject areas

  • Information Systems and Management

Cite this

Alameda, J., Rossi, A. L., & Hampton, S. (2007). On the use of services to support numerical weather prediction. In P. W. Gaffney, & J. C. T. Pool (Eds.), Grid-Based Problem Solving Environments: IFIP TC2/ WG 2.5 Working Conference on Grid-Based Problem Solving Environments: Implications for Development and Deployment of Numerical Software (pp. 339-348). (IFIP International Federation for Information Processing; Vol. 239). https://doi.org/10.1007/978-0-387-73659-4_19

On the use of services to support numerical weather prediction. / Alameda, Jay; Rossi, Albert L.; Hampton, Shawn.

Grid-Based Problem Solving Environments: IFIP TC2/ WG 2.5 Working Conference on Grid-Based Problem Solving Environments: Implications for Development and Deployment of Numerical Software. ed. / Patrick W. Gaffney; James C.T. Pool. 2007. p. 339-348 (IFIP International Federation for Information Processing; Vol. 239).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Alameda, J, Rossi, AL & Hampton, S 2007, On the use of services to support numerical weather prediction. in PW Gaffney & JCT Pool (eds), Grid-Based Problem Solving Environments: IFIP TC2/ WG 2.5 Working Conference on Grid-Based Problem Solving Environments: Implications for Development and Deployment of Numerical Software. IFIP International Federation for Information Processing, vol. 239, pp. 339-348. https://doi.org/10.1007/978-0-387-73659-4_19
Alameda J, Rossi AL, Hampton S. On the use of services to support numerical weather prediction. In Gaffney PW, Pool JCT, editors, Grid-Based Problem Solving Environments: IFIP TC2/ WG 2.5 Working Conference on Grid-Based Problem Solving Environments: Implications for Development and Deployment of Numerical Software. 2007. p. 339-348. (IFIP International Federation for Information Processing). https://doi.org/10.1007/978-0-387-73659-4_19
Alameda, Jay ; Rossi, Albert L. ; Hampton, Shawn. / On the use of services to support numerical weather prediction. Grid-Based Problem Solving Environments: IFIP TC2/ WG 2.5 Working Conference on Grid-Based Problem Solving Environments: Implications for Development and Deployment of Numerical Software. editor / Patrick W. Gaffney ; James C.T. Pool. 2007. pp. 339-348 (IFIP International Federation for Information Processing).
@inproceedings{5c6837f06d494b079b50657a57dcd4c4,
title = "On the use of services to support numerical weather prediction",
abstract = "The challenges of building an effective grid-based problem solving environment that truly extends and embraces a computational scientist's traditional tools are multifold. It is far too easy to build simple stovepipes that allow fixed use patterns, that don't extend a scientist's desktop, and fail to encompass the full range of patterns that a scientist needs to find such a problem-solving environment as a liberating and enabling tool. In the LEAD project, we have focused on the most challenging users of numerical weather prediction, namely, the atmospheric science researchers, who are prone to use their own tools, their own modified versions of community codes such as the Weather Research and Forecasting (WRF) model, and are typically comfortable with elaborate shell scripts to perform the work they find to be necessary to succeed, to drive our development efforts. Our response to these challenges includes a multi-level workflow engine, to handle both the challenges of ensemble description and execution, as well as the detailed patterns of workflow on each computational resource; services to support the peculiarities of each platform being used to do the modeling (such as on TeraGrid), and the use of an RDF triple store and message bus together as the backbone of our notification, logging, and metadata infrastructure. The design of our problem-solving environment elements attempts to come to grips with lack of control of elements surrounding and supporting the environment; we achieve this through multiple mechanisms including using the OSGI plug-in architecture, as well as the use of RDF triples as our finest-grain descriptive element. This combination, we believe, is an important stepping stone to building a cyber environment, which aims to provide flexibility and ease of use far beyond the current range of typical problem solving environments.",
author = "Jay Alameda and Rossi, {Albert L.} and Shawn Hampton",
year = "2007",
month = "12",
day = "3",
doi = "10.1007/978-0-387-73659-4_19",
language = "English (US)",
isbn = "9780387736587",
series = "IFIP International Federation for Information Processing",
pages = "339--348",
editor = "Gaffney, {Patrick W.} and Pool, {James C.T.}",
booktitle = "Grid-Based Problem Solving Environments",

}

TY - GEN

T1 - On the use of services to support numerical weather prediction

AU - Alameda, Jay

AU - Rossi, Albert L.

AU - Hampton, Shawn

PY - 2007/12/3

Y1 - 2007/12/3

N2 - The challenges of building an effective grid-based problem solving environment that truly extends and embraces a computational scientist's traditional tools are multifold. It is far too easy to build simple stovepipes that allow fixed use patterns, that don't extend a scientist's desktop, and fail to encompass the full range of patterns that a scientist needs to find such a problem-solving environment as a liberating and enabling tool. In the LEAD project, we have focused on the most challenging users of numerical weather prediction, namely, the atmospheric science researchers, who are prone to use their own tools, their own modified versions of community codes such as the Weather Research and Forecasting (WRF) model, and are typically comfortable with elaborate shell scripts to perform the work they find to be necessary to succeed, to drive our development efforts. Our response to these challenges includes a multi-level workflow engine, to handle both the challenges of ensemble description and execution, as well as the detailed patterns of workflow on each computational resource; services to support the peculiarities of each platform being used to do the modeling (such as on TeraGrid), and the use of an RDF triple store and message bus together as the backbone of our notification, logging, and metadata infrastructure. The design of our problem-solving environment elements attempts to come to grips with lack of control of elements surrounding and supporting the environment; we achieve this through multiple mechanisms including using the OSGI plug-in architecture, as well as the use of RDF triples as our finest-grain descriptive element. This combination, we believe, is an important stepping stone to building a cyber environment, which aims to provide flexibility and ease of use far beyond the current range of typical problem solving environments.

AB - The challenges of building an effective grid-based problem solving environment that truly extends and embraces a computational scientist's traditional tools are multifold. It is far too easy to build simple stovepipes that allow fixed use patterns, that don't extend a scientist's desktop, and fail to encompass the full range of patterns that a scientist needs to find such a problem-solving environment as a liberating and enabling tool. In the LEAD project, we have focused on the most challenging users of numerical weather prediction, namely, the atmospheric science researchers, who are prone to use their own tools, their own modified versions of community codes such as the Weather Research and Forecasting (WRF) model, and are typically comfortable with elaborate shell scripts to perform the work they find to be necessary to succeed, to drive our development efforts. Our response to these challenges includes a multi-level workflow engine, to handle both the challenges of ensemble description and execution, as well as the detailed patterns of workflow on each computational resource; services to support the peculiarities of each platform being used to do the modeling (such as on TeraGrid), and the use of an RDF triple store and message bus together as the backbone of our notification, logging, and metadata infrastructure. The design of our problem-solving environment elements attempts to come to grips with lack of control of elements surrounding and supporting the environment; we achieve this through multiple mechanisms including using the OSGI plug-in architecture, as well as the use of RDF triples as our finest-grain descriptive element. This combination, we believe, is an important stepping stone to building a cyber environment, which aims to provide flexibility and ease of use far beyond the current range of typical problem solving environments.

UR - http://www.scopus.com/inward/record.url?scp=36448995409&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=36448995409&partnerID=8YFLogxK

U2 - 10.1007/978-0-387-73659-4_19

DO - 10.1007/978-0-387-73659-4_19

M3 - Conference contribution

AN - SCOPUS:36448995409

SN - 9780387736587

T3 - IFIP International Federation for Information Processing

SP - 339

EP - 348

BT - Grid-Based Problem Solving Environments

A2 - Gaffney, Patrick W.

A2 - Pool, James C.T.

ER -