HPVM: Heterogeneous Parallel Virtual Machine

Maria Kotsifakou, Prakalp Srivastava, Matthew D. Sinclair, Rakesh Komuravelli, Vikram Adve, Sarita Adve

Research output: Chapter in Book/Report/Conference proceedingChapter

Abstract

We propose a parallel program representation for heterogeneous systems, designed to enable performance portability across a wide range of popular parallel hardware, including GPUs, vector instruction sets, multicore CPUs and potentially FPGAs. Our representation, which we call HPVM, is a hierarchical dataflow graph with shared memory and vector instructions. HPVM supports three important capabilities for programming heterogeneous systems: a compiler intermediate representation (IR), a virtual instruction set (ISA), and a basis for runtime scheduling; previous systems focus on only one of these capabilities. As a compiler IR, HPVM aims to enable effective code generation and optimization for heterogeneous systems. As a virtual ISA, it can be used to ship executable programs, in order to achieve both functional portability and performance portability across such systems. At runtime, HPVM enables flexible scheduling policies, both through the graph structure and the ability to compile individual nodes in a program to any of the target devices on a system. We have implemented a prototype HPVM system, defining the HPVM IR as an extension of the LLVM compiler IR, compiler optimizations that operate directly on HPVM graphs, and code generators that translate the virtual ISA to NVIDIA GPUs, Intel's AVX vector units, and to multicore X86-64 processors. Experimental results show that HPVM optimizations achieve significant performance improvements, HPVM translators achieve performance competitive with manually developed OpenCL code for both GPUs and vector hardware, and that runtime scheduling policies can make use of both program and runtime information to exploit the flexible compilation capabilities. Overall, we conclude that the HPVM representation is a promising basis for achieving performance portability and for implementing parallelizing compilers for heterogeneous parallel systems.

Original languageEnglish (US)
Title of host publicationACM SIGPLAN Notices
PublisherAssociation for Computing Machinery
Pages68-80
Number of pages13
Volume53
Edition1
ISBN (Electronic)9781450349116
DOIs
StatePublished - Feb 10 2018

Keywords

  • compiler
  • GPU
  • heterogeneous systems
  • parallel IR
  • vector SIMD
  • virtual ISA

ASJC Scopus subject areas

  • Computer Science(all)

Fingerprint Dive into the research topics of 'HPVM: Heterogeneous Parallel Virtual Machine'. Together they form a unique fingerprint.

  • Cite this

    Kotsifakou, M., Srivastava, P., Sinclair, M. D., Komuravelli, R., Adve, V., & Adve, S. (2018). HPVM: Heterogeneous Parallel Virtual Machine. In ACM SIGPLAN Notices (1 ed., Vol. 53, pp. 68-80). Association for Computing Machinery. https://doi.org/10.1145/3178487.3178493