Ensemble broker service oriented architecture for LEAD

Jay Alameda, Shawn Hampton, Brian Jewett, Albert Rossi, Bob Wilhelmson

Research output: Contribution to conferencePaper

Abstract

We will be demonstrating a set of services designed to broker large number of computational jobs, as described in requirements for the Linked Environments for Atmospheric Discovery (LEAD) ITR project. This broker system, in particular, will have the ability to broker on-demand jobs of various urgency levels, through an on-demand service being developed in collaboration with Cluster Resources, Inc. The broker is designed to support the launching of a multiplicity of ensembles of workflows. An ensemble, for our purpose, is a collection of workflows; each workflow is comprised of nodes of a variety of flavors. These flavors could include remote invocations of our compute-node-local workflow engine, the Open Grid computing environments Runtime Engine (OGRE), a service invocation, or even a plain script. Within a workflow description, we can describe properties and constraints - for example, we may want to place groups of nodes on the same computational resource, or a group of nodes (or workflows, or an ensemble) may need to be run in some on-demand fashion. We will be demonstrating early capabilities of the broker system by executing a subset of the full LEAD capabilities, as motivated by ensemble requirements from the atmospheric science community, on production NCSA and TeraGrid resources.

Original languageEnglish (US)
StatePublished - Dec 1 2006
Event86th AMS Annual Meeting - Atlanta, GA, United States
Duration: Jan 29 2006Feb 2 2006

Other

Other86th AMS Annual Meeting
CountryUnited States
CityAtlanta, GA
Period1/29/062/2/06

Fingerprint

Flavors
Service oriented architecture (SOA)
Engines
Grid computing
engine
Launching
resource
services
demand

ASJC Scopus subject areas

  • Environmental Engineering
  • Global and Planetary Change
  • Management, Monitoring, Policy and Law

Cite this

Alameda, J., Hampton, S., Jewett, B., Rossi, A., & Wilhelmson, B. (2006). Ensemble broker service oriented architecture for LEAD. Paper presented at 86th AMS Annual Meeting, Atlanta, GA, United States.

Ensemble broker service oriented architecture for LEAD. / Alameda, Jay; Hampton, Shawn; Jewett, Brian; Rossi, Albert; Wilhelmson, Bob.

2006. Paper presented at 86th AMS Annual Meeting, Atlanta, GA, United States.

Research output: Contribution to conferencePaper

Alameda, J, Hampton, S, Jewett, B, Rossi, A & Wilhelmson, B 2006, 'Ensemble broker service oriented architecture for LEAD' Paper presented at 86th AMS Annual Meeting, Atlanta, GA, United States, 1/29/06 - 2/2/06, .
Alameda J, Hampton S, Jewett B, Rossi A, Wilhelmson B. Ensemble broker service oriented architecture for LEAD. 2006. Paper presented at 86th AMS Annual Meeting, Atlanta, GA, United States.
Alameda, Jay ; Hampton, Shawn ; Jewett, Brian ; Rossi, Albert ; Wilhelmson, Bob. / Ensemble broker service oriented architecture for LEAD. Paper presented at 86th AMS Annual Meeting, Atlanta, GA, United States.
@conference{6b022ea397184de9952e10fd3399a017,
title = "Ensemble broker service oriented architecture for LEAD",
abstract = "We will be demonstrating a set of services designed to broker large number of computational jobs, as described in requirements for the Linked Environments for Atmospheric Discovery (LEAD) ITR project. This broker system, in particular, will have the ability to broker on-demand jobs of various urgency levels, through an on-demand service being developed in collaboration with Cluster Resources, Inc. The broker is designed to support the launching of a multiplicity of ensembles of workflows. An ensemble, for our purpose, is a collection of workflows; each workflow is comprised of nodes of a variety of flavors. These flavors could include remote invocations of our compute-node-local workflow engine, the Open Grid computing environments Runtime Engine (OGRE), a service invocation, or even a plain script. Within a workflow description, we can describe properties and constraints - for example, we may want to place groups of nodes on the same computational resource, or a group of nodes (or workflows, or an ensemble) may need to be run in some on-demand fashion. We will be demonstrating early capabilities of the broker system by executing a subset of the full LEAD capabilities, as motivated by ensemble requirements from the atmospheric science community, on production NCSA and TeraGrid resources.",
author = "Jay Alameda and Shawn Hampton and Brian Jewett and Albert Rossi and Bob Wilhelmson",
year = "2006",
month = "12",
day = "1",
language = "English (US)",
note = "86th AMS Annual Meeting ; Conference date: 29-01-2006 Through 02-02-2006",

}

TY - CONF

T1 - Ensemble broker service oriented architecture for LEAD

AU - Alameda, Jay

AU - Hampton, Shawn

AU - Jewett, Brian

AU - Rossi, Albert

AU - Wilhelmson, Bob

PY - 2006/12/1

Y1 - 2006/12/1

N2 - We will be demonstrating a set of services designed to broker large number of computational jobs, as described in requirements for the Linked Environments for Atmospheric Discovery (LEAD) ITR project. This broker system, in particular, will have the ability to broker on-demand jobs of various urgency levels, through an on-demand service being developed in collaboration with Cluster Resources, Inc. The broker is designed to support the launching of a multiplicity of ensembles of workflows. An ensemble, for our purpose, is a collection of workflows; each workflow is comprised of nodes of a variety of flavors. These flavors could include remote invocations of our compute-node-local workflow engine, the Open Grid computing environments Runtime Engine (OGRE), a service invocation, or even a plain script. Within a workflow description, we can describe properties and constraints - for example, we may want to place groups of nodes on the same computational resource, or a group of nodes (or workflows, or an ensemble) may need to be run in some on-demand fashion. We will be demonstrating early capabilities of the broker system by executing a subset of the full LEAD capabilities, as motivated by ensemble requirements from the atmospheric science community, on production NCSA and TeraGrid resources.

AB - We will be demonstrating a set of services designed to broker large number of computational jobs, as described in requirements for the Linked Environments for Atmospheric Discovery (LEAD) ITR project. This broker system, in particular, will have the ability to broker on-demand jobs of various urgency levels, through an on-demand service being developed in collaboration with Cluster Resources, Inc. The broker is designed to support the launching of a multiplicity of ensembles of workflows. An ensemble, for our purpose, is a collection of workflows; each workflow is comprised of nodes of a variety of flavors. These flavors could include remote invocations of our compute-node-local workflow engine, the Open Grid computing environments Runtime Engine (OGRE), a service invocation, or even a plain script. Within a workflow description, we can describe properties and constraints - for example, we may want to place groups of nodes on the same computational resource, or a group of nodes (or workflows, or an ensemble) may need to be run in some on-demand fashion. We will be demonstrating early capabilities of the broker system by executing a subset of the full LEAD capabilities, as motivated by ensemble requirements from the atmospheric science community, on production NCSA and TeraGrid resources.

UR - http://www.scopus.com/inward/record.url?scp=77949309478&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=77949309478&partnerID=8YFLogxK

M3 - Paper

AN - SCOPUS:77949309478

ER -