Fundamental Limits on Energy-Delay-Accuracy of In-Memory Architectures in Inference Applications

Sujan K. Gonugondla, Charbel Sakr, Hassan Dbouk, Naresh R. Shanbhag

Research output: Contribution to journalArticlepeer-review

Abstract

This article obtains fundamental limits on the computational precision of in-memory computing architectures (IMCs). An IMC noise model and associated signal-to-noise ratio (SNR) metrics are defined and their interrelationships analyzed to show that the accuracy of IMCs is fundamentally limited by the compute SNR (SNRa) of its analog core, and that activation, weight, and output (ADC) precision needs to be assigned appropriately for the final output SNR (SNRT) to approach SNRa. The minimum precision criterion (MPC) is proposed to minimize the analog-to-digital converter (ADC) precision and hence its overhead. Three in-memory compute models - charge summing (QS), current summing (IS), and charge redistribution (QR) - are shown to underlie most known IMCs. Noise, energy, and delay expressions for the compute models are developed and employed to derive expressions for the SNR, ADC precision, energy, and latency of IMCs. The compute SNR expressions are validated via Monte Carlo simulations in a 65 nm CMOS process. For a 512 row SRAM array, it is shown that: 1) IMCs have an upper bound on their maximum achievable SNRa due to constraints on energy, area and voltage swing, and this upper bound reduces with technology scaling for QS-based architectures; 2) MPC enables SNRT to approach SNRa to be realized with minimal ADC precision; and 3) QS-based (QR-based) architectures are preferred for low (high) compute SNR scenarios.

Original languageEnglish (US)
Pages (from-to)3188-3201
Number of pages14
JournalIEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems
Volume41
Issue number10
DOIs
StatePublished - Oct 1 2022

Keywords

  • Computational modeling
  • Computer architecture
  • Delays
  • Peak to average power ratio
  • Quantization (signal)
  • Signal to noise ratio
  • Topology
  • signal-to-noise ratio (SNR)
  • in-memory
  • Analog-to-digital converter (ADC)
  • fundamental limits
  • SRAM
  • machine-learning
  • computein-memory
  • precision limits
  • quantization

ASJC Scopus subject areas

  • Software
  • Electrical and Electronic Engineering
  • Computer Graphics and Computer-Aided Design

Fingerprint

Dive into the research topics of 'Fundamental Limits on Energy-Delay-Accuracy of In-Memory Architectures in Inference Applications'. Together they form a unique fingerprint.

Cite this