Ensemble broker service oriented architecture for LEAD

Jay Alameda, Shawn Hampton, Brian Jewett, Albert Rossi, Bob Wilhelmson

Research output: Contribution to conferencePaper

Abstract

We will be demonstrating a set of services designed to broker large number of computational jobs, as described in requirements for the Linked Environments for Atmospheric Discovery (LEAD) ITR project. This broker system, in particular, will have the ability to broker on-demand jobs of various urgency levels, through an on-demand service being developed in collaboration with Cluster Resources, Inc. The broker is designed to support the launching of a multiplicity of ensembles of workflows. An ensemble, for our purpose, is a collection of workflows; each workflow is comprised of nodes of a variety of flavors. These flavors could include remote invocations of our compute-node-local workflow engine, the Open Grid computing environments Runtime Engine (OGRE), a service invocation, or even a plain script. Within a workflow description, we can describe properties and constraints - for example, we may want to place groups of nodes on the same computational resource, or a group of nodes (or workflows, or an ensemble) may need to be run in some on-demand fashion. We will be demonstrating early capabilities of the broker system by executing a subset of the full LEAD capabilities, as motivated by ensemble requirements from the atmospheric science community, on production NCSA and TeraGrid resources.

Original languageEnglish (US)
StatePublished - Dec 1 2006
Event86th AMS Annual Meeting - Atlanta, GA, United States
Duration: Jan 29 2006Feb 2 2006

Other

Other86th AMS Annual Meeting
CountryUnited States
CityAtlanta, GA
Period1/29/062/2/06

    Fingerprint

ASJC Scopus subject areas

  • Environmental Engineering
  • Global and Planetary Change
  • Management, Monitoring, Policy and Law

Cite this

Alameda, J., Hampton, S., Jewett, B., Rossi, A., & Wilhelmson, B. (2006). Ensemble broker service oriented architecture for LEAD. Paper presented at 86th AMS Annual Meeting, Atlanta, GA, United States.