The LRPD test: Speculative run-time parallelization of loops with privatization and reduction parallelization

Research output: Contribution to journalArticlepeer-review

Abstract

Current parallelizing compilers cannot identify a significant fraction of parallelizable loops because they have complex or statically insufficiently defined access patterns. As parallelizable loops arise frequently in practice, we advocate a novel framework for their identification: speculatively execute the loop as a doall and apply a fully parallel data dependence test to determine if it had any cross-iteration dependences; if the test fails, then the loop is reexecuted serially. Since, from our experience, a significant amount of the available parallelism in Fortran programs can be exploited by loops transformed through privatization and reduction parallelization, our methods can speculatively apply these transformations and then check their validity at run-time. Another important contribution of this paper is a novel method for reduction recognition which goes beyond syntactic pattern matching: It detects at run-time if the values stored in an array participate in a reduction operation, even if they are transferred through private variables and/or are affected by statically unpredictable control flow. We present experimental results on loops from the PERFECT Benchmarks, which substantiate our claim that these techniques can yield significant speedups which are often superior to those obtainable by inspector/executor methods.

Original languageEnglish (US)
Pages (from-to)160-180
Number of pages21
JournalIEEE Transactions on Parallel and Distributed Systems
Volume10
Issue number2
DOIs
StatePublished - Dec 1 1999

Keywords

  • Compilers
  • DOALL
  • Parallel processing
  • Privatization
  • Reduction
  • Run-time
  • Speculative

ASJC Scopus subject areas

  • Signal Processing
  • Hardware and Architecture
  • Computational Theory and Mathematics

Fingerprint Dive into the research topics of 'The LRPD test: Speculative run-time parallelization of loops with privatization and reduction parallelization'. Together they form a unique fingerprint.

Cite this