Comparing data forwarding and prefetching for communication-induced misses in shared-memory MPs

David Koufaty, Josep Torrellas

Research output: Contribution to conferencePaper

Abstract

As the difference in speed between processor and memory system continues to increase, it is becoming crucial to develop and refine techniques that enhance the effectiveness of cache hierarchies. Two such techniques are data prefetching and data forwarding. With prefetching, a processor hides the latency of cache misses by requesting the data before it actually needs it. With forwarding, a producer processor hides the latency of communication-induced cache misses in the consumer processors by sending the data to the caches of the latter. These two techniques are complementary approaches to hiding the latency of communication-induced misses. This paper compares the effectiveness of data forwarding and data prefetching to hide communication-induced misses. Although both techniques require comparable hardware support, forwarding usually has a lower instruction overhead. We evaluate prefetching and forwarding algorithms in a parallelizing compiler using execution-driven simulations of a shared-memory multiprocessor. Both data forwarding and prefetching reduce the execution time of applications significantly (30-40% on average). Forwarding performs better on average, while prefetching is more robust to changes in cache and memory parameters. Finally, we propose two ways of integrating the two techniques. The integration of the two techniques reduces the execution time even more (43-48% on average) and is very robust.

Original languageEnglish (US)
Pages53-60
Number of pages8
DOIs
StatePublished - 1998
EventProceedings of the 1998 International Conference on Supercomputing - Melbourne, Aust
Duration: Jul 13 1998Jul 17 1998

Other

OtherProceedings of the 1998 International Conference on Supercomputing
CityMelbourne, Aust
Period7/13/987/17/98

ASJC Scopus subject areas

  • Computer Science(all)

Fingerprint Dive into the research topics of 'Comparing data forwarding and prefetching for communication-induced misses in shared-memory MPs'. Together they form a unique fingerprint.

  • Cite this

    Koufaty, D., & Torrellas, J. (1998). Comparing data forwarding and prefetching for communication-induced misses in shared-memory MPs. 53-60. Paper presented at Proceedings of the 1998 International Conference on Supercomputing, Melbourne, Aust, . https://doi.org/10.1145/277830.277847