Integrating Abstractions to Enhance the Execution of Distributed Applications

Matteo Turilli; Feng Liu; Zhao Zhang; Andre Merzky; Michael Wilde; Jon Weissman; Daniel S. Katz; Shantenu Jha

doi:10.1109/IPDPS.2016.64

Integrating Abstractions to Enhance the Execution of Distributed Applications

Matteo Turilli, Feng Liu, Zhao Zhang, Andre Merzky, Michael Wilde, Jon Weissman, Daniel S. Katz, Shantenu Jha

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Abstract

One of the factors that limits the scale, performance, and sophistication of distributed applications is the difficulty of concurrently executing them on multiple distributed computing resources. In part, this is due to a poor understanding of the general properties and performance of the coupling between applications and dynamic resources. This paper addresses this issue by integrating abstractions representing distributed applications, resources, and execution processes into a pilot-based middleware. The middleware provides a platform that can specify distributed applications, execute them on multiple resource and for different configurations, and is instrumented to support investigative analysis. We analyzed the execution of distributed applications using experiments that measure the benefits of using multiple resources, the late-binding of scheduling decisions, and the use of backfill scheduling.

Original language	English (US)
Title of host publication	Proceedings - 2016 IEEE 30th International Parallel and Distributed Processing Symposium, IPDPS 2016
Publisher	Institute of Electrical and Electronics Engineers Inc.
Pages	953-962
Number of pages	10
ISBN (Electronic)	9781509021406
DOIs	https://doi.org/10.1109/IPDPS.2016.64
State	Published - Jul 18 2016
Externally published	Yes
Event	30th IEEE International Parallel and Distributed Processing Symposium, IPDPS 2016 - Chicago, United States Duration: May 23 2016 → May 27 2016

Publication series

Name	Proceedings - 2016 IEEE 30th International Parallel and Distributed Processing Symposium, IPDPS 2016

Other

Other	30th IEEE International Parallel and Distributed Processing Symposium, IPDPS 2016
Country/Territory	United States
City	Chicago
Period	5/23/16 → 5/27/16

Keywords

Abstractions
Distributed systems
Execution strategies
Middleware

ASJC Scopus subject areas

Computer Networks and Communications

Online availability

10.1109/IPDPS.2016.64

Library availability

Discover UIUC Full Text

Cite this

Turilli, M., Liu, F., Zhang, Z., Merzky, A., Wilde, M., Weissman, J., Katz, D. S., & Jha, S. (2016). Integrating Abstractions to Enhance the Execution of Distributed Applications. In Proceedings - 2016 IEEE 30th International Parallel and Distributed Processing Symposium, IPDPS 2016 (pp. 953-962). Article 7516092 (Proceedings - 2016 IEEE 30th International Parallel and Distributed Processing Symposium, IPDPS 2016). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/IPDPS.2016.64

Integrating Abstractions to Enhance the Execution of Distributed Applications. / Turilli, Matteo; Liu, Feng; Zhang, Zhao et al.
Proceedings - 2016 IEEE 30th International Parallel and Distributed Processing Symposium, IPDPS 2016. Institute of Electrical and Electronics Engineers Inc., 2016. p. 953-962 7516092 (Proceedings - 2016 IEEE 30th International Parallel and Distributed Processing Symposium, IPDPS 2016).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Turilli, M, Liu, F, Zhang, Z, Merzky, A, Wilde, M, Weissman, J, Katz, DS & Jha, S 2016, Integrating Abstractions to Enhance the Execution of Distributed Applications. in Proceedings - 2016 IEEE 30th International Parallel and Distributed Processing Symposium, IPDPS 2016., 7516092, Proceedings - 2016 IEEE 30th International Parallel and Distributed Processing Symposium, IPDPS 2016, Institute of Electrical and Electronics Engineers Inc., pp. 953-962, 30th IEEE International Parallel and Distributed Processing Symposium, IPDPS 2016, Chicago, United States, 5/23/16. https://doi.org/10.1109/IPDPS.2016.64

Turilli M, Liu F, Zhang Z, Merzky A, Wilde M, Weissman J et al. Integrating Abstractions to Enhance the Execution of Distributed Applications. In Proceedings - 2016 IEEE 30th International Parallel and Distributed Processing Symposium, IPDPS 2016. Institute of Electrical and Electronics Engineers Inc. 2016. p. 953-962. 7516092. (Proceedings - 2016 IEEE 30th International Parallel and Distributed Processing Symposium, IPDPS 2016). doi: 10.1109/IPDPS.2016.64

Turilli, Matteo ; Liu, Feng ; Zhang, Zhao et al. / Integrating Abstractions to Enhance the Execution of Distributed Applications. Proceedings - 2016 IEEE 30th International Parallel and Distributed Processing Symposium, IPDPS 2016. Institute of Electrical and Electronics Engineers Inc., 2016. pp. 953-962 (Proceedings - 2016 IEEE 30th International Parallel and Distributed Processing Symposium, IPDPS 2016).

@inproceedings{c28c7d8dbb5243bcb2137ad511d7d706,

title = "Integrating Abstractions to Enhance the Execution of Distributed Applications",

abstract = "One of the factors that limits the scale, performance, and sophistication of distributed applications is the difficulty of concurrently executing them on multiple distributed computing resources. In part, this is due to a poor understanding of the general properties and performance of the coupling between applications and dynamic resources. This paper addresses this issue by integrating abstractions representing distributed applications, resources, and execution processes into a pilot-based middleware. The middleware provides a platform that can specify distributed applications, execute them on multiple resource and for different configurations, and is instrumented to support investigative analysis. We analyzed the execution of distributed applications using experiments that measure the benefits of using multiple resources, the late-binding of scheduling decisions, and the use of backfill scheduling.",

keywords = "Abstractions, Distributed systems, Execution strategies, Middleware",

author = "Matteo Turilli and Feng Liu and Zhao Zhang and Andre Merzky and Michael Wilde and Jon Weissman and Katz, {Daniel S.} and Shantenu Jha",

note = "Publisher Copyright: {\textcopyright} 2016 IEEE.; 30th IEEE International Parallel and Distributed Processing Symposium, IPDPS 2016 ; Conference date: 23-05-2016 Through 27-05-2016",

year = "2016",

month = jul,

day = "18",

doi = "10.1109/IPDPS.2016.64",

language = "English (US)",

series = "Proceedings - 2016 IEEE 30th International Parallel and Distributed Processing Symposium, IPDPS 2016",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

pages = "953--962",

booktitle = "Proceedings - 2016 IEEE 30th International Parallel and Distributed Processing Symposium, IPDPS 2016",

address = "United States",

}

TY - GEN

T1 - Integrating Abstractions to Enhance the Execution of Distributed Applications

AU - Turilli, Matteo

AU - Liu, Feng

AU - Zhang, Zhao

AU - Merzky, Andre

AU - Wilde, Michael

AU - Weissman, Jon

AU - Katz, Daniel S.

AU - Jha, Shantenu

PY - 2016/7/18

Y1 - 2016/7/18

N2 - One of the factors that limits the scale, performance, and sophistication of distributed applications is the difficulty of concurrently executing them on multiple distributed computing resources. In part, this is due to a poor understanding of the general properties and performance of the coupling between applications and dynamic resources. This paper addresses this issue by integrating abstractions representing distributed applications, resources, and execution processes into a pilot-based middleware. The middleware provides a platform that can specify distributed applications, execute them on multiple resource and for different configurations, and is instrumented to support investigative analysis. We analyzed the execution of distributed applications using experiments that measure the benefits of using multiple resources, the late-binding of scheduling decisions, and the use of backfill scheduling.

AB - One of the factors that limits the scale, performance, and sophistication of distributed applications is the difficulty of concurrently executing them on multiple distributed computing resources. In part, this is due to a poor understanding of the general properties and performance of the coupling between applications and dynamic resources. This paper addresses this issue by integrating abstractions representing distributed applications, resources, and execution processes into a pilot-based middleware. The middleware provides a platform that can specify distributed applications, execute them on multiple resource and for different configurations, and is instrumented to support investigative analysis. We analyzed the execution of distributed applications using experiments that measure the benefits of using multiple resources, the late-binding of scheduling decisions, and the use of backfill scheduling.

KW - Abstractions

KW - Distributed systems

KW - Execution strategies

KW - Middleware

UR - http://www.scopus.com/inward/record.url?scp=84983343673&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84983343673&partnerID=8YFLogxK

U2 - 10.1109/IPDPS.2016.64

DO - 10.1109/IPDPS.2016.64

M3 - Conference contribution

AN - SCOPUS:84983343673

T3 - Proceedings - 2016 IEEE 30th International Parallel and Distributed Processing Symposium, IPDPS 2016

SP - 953

EP - 962

BT - Proceedings - 2016 IEEE 30th International Parallel and Distributed Processing Symposium, IPDPS 2016

PB - Institute of Electrical and Electronics Engineers Inc.

T2 - 30th IEEE International Parallel and Distributed Processing Symposium, IPDPS 2016

Y2 - 23 May 2016 through 27 May 2016

ER -

Integrating Abstractions to Enhance the Execution of Distributed Applications

Abstract

Publication series

Other

Keywords

ASJC Scopus subject areas

Online availability

Library availability

Related links

Fingerprint

Cite this