Multi-phased Task Placement of HPC Applications in the Cloud

Emmanuell D. Carreno, Marco A.Z. Alves, Matthias Diener, Eduardo Roloff, Philippe A.O. Navaux

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Many high-performance computing applications present different phases during their execution. Nevertheless, thread and process placement techniques usually provide static-only methods to improve the data and thread locality. Similarly, cloud computing datacenters may present variations in terms of latency over the execution time of applications. To overcome these two problems, in this paper we analyze scientific applications that have different communication patterns along with its execution. For such applications, we evaluate the performance variation of traditional static placement techniques to our new approach that uses code annotations to perform the new placement of tasks, matching also the variations on network performance of Virtual Machines (VMs) during the run time. For our experiments, we use applications from the NAS parallel benchmark suite, running them on two VM sizes with 32 and 64 cores respectively, from the same family of instance types at the West US datacenter from Azure. Results show that compared to traditional static process mapping, our multi-phased placement mechanism achieves average performance gains of 13.57% up to 28.32% on the evaluated scenarios. These results show that there is an opportunity to improve performance by correctly identifying the network variations and reacting by generating a new task-to-instance mapping.

Original languageEnglish (US)
Title of host publicationProceedings - 2019 18th International Symposium on Parallel and Distributed Computing, ISPDC 2019
EditorsAlexandru Iosup, Radu Prodan, Alexandru Uta, Florin Pop
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages103-111
Number of pages9
ISBN (Electronic)9781728138008
DOIs
StatePublished - Jun 2019
Event18th International Symposium on Parallel and Distributed Computing, ISPDC 2019 - Amsterdam, Netherlands
Duration: Jun 5 2019Jun 7 2019

Publication series

NameProceedings - 2019 18th International Symposium on Parallel and Distributed Computing, ISPDC 2019

Conference

Conference18th International Symposium on Parallel and Distributed Computing, ISPDC 2019
Country/TerritoryNetherlands
CityAmsterdam
Period6/5/196/7/19

Keywords

  • Cloud Computing, HPC, Task Mapping, MPI, NAS, Network Variability

ASJC Scopus subject areas

  • Computer Networks and Communications
  • Computer Science Applications
  • Hardware and Architecture
  • Information Systems and Management

Fingerprint

Dive into the research topics of 'Multi-phased Task Placement of HPC Applications in the Cloud'. Together they form a unique fingerprint.

Cite this