DA-TC: A novel application execution model in multicluster systems

Zhifeng Yun, Zhou Lei, Gabrielle Dawn Allen, Daniel S Katz, J. Ramanujam

Research output: Contribution to journalArticlepeer-review

Abstract

The availability of a large number of separate clusters has given rise to the field of multicluster systems in which these resources are coupled to obtain their combined benefits to solve large-scale compute-intensive applications. However, it is challenging to achieve automatic load balancing of the jobs across these participating autonomic systems. We developed a novel user space execution model named DA-TC to address the workload allocation techniques for the applications with large number of sequential jobs in multicluster systems. Through this model, we can achieve dynamic load balancing for task assignment, and slower resources become beneficial factors rather than bottlenecks for application execution. The effectiveness of this strategy is demonstrated through theoretical analysis. This model is also evaluated through extensive experimental studies and the results show that when compared with the traditional method, the proposed DA-TC model can significantly improve the performance of application execution in terms of application turnaround time and system reliability in multicluster circumstances.

Original languageEnglish (US)
Pages (from-to)371-387
Number of pages17
JournalCluster Computing
Volume17
Issue number2
DOIs
StatePublished - Jan 2014
Externally publishedYes

Keywords

  • Cluster computing
  • Distributed systems
  • Execution management
  • Load balancing
  • Multi-clusters
  • Scheduling

ASJC Scopus subject areas

  • Software
  • Computer Networks and Communications

Fingerprint Dive into the research topics of 'DA-TC: A novel application execution model in multicluster systems'. Together they form a unique fingerprint.

Cite this