HPC-aware VM placement in infrastructure clouds

Abhishek Gupta, Laxmikant V. Kalé, Dejan Milojicic, Paolo Faraboschi, Susanne M. Balle

Research output: Chapter in Book/Report/Conference proceedingConference contribution


Cloud offerings are increasingly serving workloads with a large variability in terms of compute, storage and networking resources. Computing requirements (all the way to High Performance Computing or HPC), criticality, communication intensity, memory requirements, and scale can vary widely. Virtual Machine (VM) placement and consolidation for effective utilization of a common pool of resources for efficient execution of such diverse class of applications in the cloud is challenging, resulting in higher cost and missed Service Level Agreements (SLAs). For HPC, current cloud providers either offer dedicated cloud with dedicated nodes, losing out on consolidation benefitsof virtualization, or use HPC-agnostic cloud scheduling resulting in poor HPC performance. In this work, we address application-aware allocation of n VM instances (comprising a single job request) to physical hosts from a single pool. We design and implement an HPC-aware scheduler on top of OpenStack Compute (Nova) and also incorporate it in a simulator (CloudSim). Through various optimizations, specifically topology- and hardware-awareness, cross-VM interference accounting and application-aware consolidation, we demonstrate enhanced VM placements which achieve up to 45% improvement in HPC performance and/or 32% increase in job throughput while limiting the effect of jitter (or noise) to 8%.

Original languageEnglish (US)
Title of host publicationProceedings of the IEEE International Conference on Cloud Engineering, IC2E 2013
Number of pages10
StatePublished - 2013
Event1st IEEE International Conference on Cloud Engineering, IC2E 2013 - San Francisco, CA, United States
Duration: Mar 25 2013Mar 28 2013

Publication series

NameProceedings of the IEEE International Conference on Cloud Engineering, IC2E 2013


Other1st IEEE International Conference on Cloud Engineering, IC2E 2013
Country/TerritoryUnited States
CitySan Francisco, CA


  • Cloud
  • High Performance Computing
  • Placement
  • Scheduling

ASJC Scopus subject areas

  • Software


Dive into the research topics of 'HPC-aware VM placement in infrastructure clouds'. Together they form a unique fingerprint.

Cite this