Compressed counting meets compressed sensing

Ping Li, Cun Hui Zhang, Tong Zhang

Research output: Contribution to journalConference articlepeer-review

Abstract

Compressed sensing (sparse signal recovery) has been a popular and important research topic in recent years. By observing that natural signals (e.g., images or network data) are often nonnegative, we propose a framework for nonnegative signal recovery using Compressed Counting (CC). CC is a technique built on maximally-skewed α-stable random projections originally developed for data stream computations (e.g., entropy estimations). Our recovery procedure is computationally efficient in that it requires only one linear scan of the coordinates. In our settings, the signal × ∈ ℝN is assumed to be nonnegative, i.e., xi ≥ 0, ∀ i. We prove that,whenα ∈ (0, 0.5], it suffices to use M = (Cα+o(1))εNi=1xαi log N/δ measurements so that, with probability 1 - δ, all coordinates will be recovered within ε additive precision, in one scan of the coordinates. The constant Cα = 1 when α→0 and Cα = π/2 when α = 0.5. In particular, when α→0, the required number of measurements is essentially M = KlogN/δ, where K = ΣNi=11{xi ≠ 0} is the number of nonzero coordinates of the signal.

Original languageEnglish (US)
Pages (from-to)1058-1077
Number of pages20
JournalJournal of Machine Learning Research
Volume35
StatePublished - 2014
Externally publishedYes
Event27th Conference on Learning Theory, COLT 2014 - Barcelona, Spain
Duration: Jun 13 2014Jun 15 2014

ASJC Scopus subject areas

  • Software
  • Control and Systems Engineering
  • Statistics and Probability
  • Artificial Intelligence

Fingerprint

Dive into the research topics of 'Compressed counting meets compressed sensing'. Together they form a unique fingerprint.

Cite this