The CEO Problem with rth Power of Difference and Logarithmic Distortions

Daewon Seo, Lav R. Varshney

Research output: Contribution to journalArticlepeer-review

Abstract

The CEO problem has received much attention since first introduced by Berger et al., but there are limited results on non-Gaussian models with non-quadratic distortion measures. In this work, we extend the quadratic Gaussian CEO problem to two non-Gaussian settings with general r th power of difference distortion. Assuming an identical observation channel across agents, we study the asymptotics of distortion decay as the number of agents and sum-rate, Rsum , grow without bound, while individual rates vanish. The first setting is a regular source-observation model with r th power of difference distortion, which subsumes the quadratic Gaussian CEO problem, and we establish that the distortion decays at O(Rsum-r/2) when r ≥ 2. We use sample median estimation after the Berger-Tung scheme for achievability. The other setting is a non-regular source-observation model, including uniform additive noise models, with r th power of difference distortion for which estimation-theoretic regularity conditions do not hold. The distortion decay O(Rsum-r) when r ≥ 1 is obtained for the non-regular model by midrange estimator following the Berger-Tung scheme. We also provide converses based on the Shannon lower bound for the regular model and the Chazan-Zakai-Ziv bound for the non-regular model, respectively. Lastly, we provide a sufficient condition for the regular model, under which quadratic and logarithmic distortions are asymptotically equivalent by an entropy power relationship as the number of agents grows. This proof relies on the Bernstein-von Mises theorem.

Original languageEnglish (US)
Article number9405612
Pages (from-to)3873-3891
Number of pages19
JournalIEEE Transactions on Information Theory
Volume67
Issue number6
DOIs
StatePublished - Jun 2021
Externally publishedYes

Keywords

  • CEO problem
  • Chazan-Zakai-Ziv bound
  • Shannon lower bound
  • median estimator
  • midrange estimator
  • multiterminal source coding

ASJC Scopus subject areas

  • Information Systems
  • Computer Science Applications
  • Library and Information Sciences

Fingerprint

Dive into the research topics of 'The CEO Problem with rth Power of Difference and Logarithmic Distortions'. Together they form a unique fingerprint.

Cite this