Understanding and Optimizing Power Consumption in Memory Networks

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

As the amount of digital data the world generates explodes, data centers and HPC systems that process this big data will require high bandwidth and high capacity main memory. Unfortunately, conventional memory technologies either provide high memory capacity (e.g., DDRx memory) or high bandwidth (GDDRx memory), but not both. Memory networks, which provide both high bandwidth and high capacity memory by connecting memory modules together via a network of point-to-point links, are promising future memory candidates for data centers and HPCs. In this paper, we perform the first exploration to understand the power characteristics of memory networks. We find idle I/O links to be the biggest power contributor in memory networks. Subsequently, we study idle I/O power in more detail. We evaluate well-known circuit-level I/O power control mechanisms such as rapid on off, variable link width, and DVFS. We also adapt prior works on memory power management to memory networks. The adapted schemes together reduce I/O power by 32% and 21%, on average, for big and small networks, respectively. We also explore novel power management schemes specifically targeting memory networks, which yield another 29% and 17% average I/O power reduction for big and small networks, respectively.

Original languageEnglish (US)
Title of host publicationProceedings - 2017 IEEE 23rd Symposium on High Performance Computer Architecture, HPCA 2017
PublisherIEEE Computer Society
Pages229-240
Number of pages12
ISBN (Electronic)9781509049851
DOIs
StatePublished - May 5 2017
Event23rd IEEE Symposium on High Performance Computer Architecture, HPCA 2017 - Austin, United States
Duration: Feb 4 2017Feb 8 2017

Other

Other23rd IEEE Symposium on High Performance Computer Architecture, HPCA 2017
CountryUnited States
CityAustin
Period2/4/172/8/17

Keywords

  • High-speed Memory I/O
  • Hybrid Memory Cube
  • Memory Power Management
  • Point-to-point Network

ASJC Scopus subject areas

  • Hardware and Architecture

Fingerprint Dive into the research topics of 'Understanding and Optimizing Power Consumption in Memory Networks'. Together they form a unique fingerprint.

  • Cite this

    Jian, X., Hanumolu, P. K., & Kumar, R. (2017). Understanding and Optimizing Power Consumption in Memory Networks. In Proceedings - 2017 IEEE 23rd Symposium on High Performance Computer Architecture, HPCA 2017 (pp. 229-240). [7920828] IEEE Computer Society. https://doi.org/10.1109/HPCA.2017.60