Towards efficient mapping, scheduling, and execution of HPC applications on platforms in cloud

Abhishek Gupta, Laxmikant V. Kale

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

The advantages of pay-As-you-go model, elasticity, and the flexibility and customization offered by virtualization make cloud computing an attractive option for meeting the needs of some High Performance Computing (HPC) users. However, there is a mismatch between cloud environments and HPC requirements. The poor interconnect and I/O performance in cloud, HPC-Agnostic cloud schedulers, and the inherent heterogeneity and multi-tenancy in cloud are some bottlenecks for effective HPC in cloud. Our primary thesis is that cloud is suitable for some HPC applications not all applications, and for those applications, cloud can be more cost-effective compared to typical dedicated HPC platforms using intelligent application-to-platform mapping, HPC-Aware cloud schedulers, and cloud-Aware HPC execution and parallel runtime system. To address the challenges, and to exploit the opportunities offered by HPC-clouds, we make Open-Stack Nova scheduler HPC-Aware and Charm++ parallel runtime system cloud-Aware. We demonstrate that our techniques resulting significant improvement in cost (up to 60%), performance (up to 45%), and throughput (up to 32%) for HPC in cloud; helping cloud users gain confidence in the capabilities of cloud for HPC, and cloud providers run a more profitable business.

Original languageEnglish (US)
Title of host publicationProceedings - IEEE 27th International Parallel and Distributed Processing Symposium Workshops and PhD Forum, IPDPSW 2013
PublisherIEEE Computer Society
Pages2294-2297
Number of pages4
ISBN (Print)9780769549798
DOIs
StatePublished - Jan 1 2013
Event2013 IEEE 37th Annual Computer Software and Applications Conference, COMPSAC 2013 - Boston, MA, Japan
Duration: Jul 22 2013Jul 26 2013

Publication series

NameProceedings - IEEE 27th International Parallel and Distributed Processing Symposium Workshops and PhD Forum, IPDPSW 2013

Other

Other2013 IEEE 37th Annual Computer Software and Applications Conference, COMPSAC 2013
CountryJapan
CityBoston, MA
Period7/22/137/26/13

Keywords

  • Cloud
  • High Performance Computing
  • Placement
  • Runtime system
  • Scheduling
  • Virtual machines

ASJC Scopus subject areas

  • Computational Theory and Mathematics
  • Software
  • Theoretical Computer Science

Fingerprint Dive into the research topics of 'Towards efficient mapping, scheduling, and execution of HPC applications on platforms in cloud'. Together they form a unique fingerprint.

Cite this