Abstract
Compressed sensing (sparse signal recovery) has been a popular and important research topic in recent years. By observing that natural signals (e.g., images or network data) are often nonnegative, we propose a framework for nonnegative signal recovery using Compressed Counting (CC). CC is a technique built on maximally-skewed α-stable random projections originally developed for data stream computations (e.g., entropy estimations). Our recovery procedure is computationally efficient in that it requires only one linear scan of the coordinates. In our settings, the signal × ∈ ℝN is assumed to be nonnegative, i.e., xi ≥ 0, ∀ i. We prove that,whenα ∈ (0, 0.5], it suffices to use M = (Cα+o(1))ε-α (ΣNi=1xαi log N/δ measurements so that, with probability 1 - δ, all coordinates will be recovered within ε additive precision, in one scan of the coordinates. The constant Cα = 1 when α→0 and Cα = π/2 when α = 0.5. In particular, when α→0, the required number of measurements is essentially M = KlogN/δ, where K = ΣNi=11{xi ≠ 0} is the number of nonzero coordinates of the signal.
Original language | English (US) |
---|---|
Pages (from-to) | 1058-1077 |
Number of pages | 20 |
Journal | Journal of Machine Learning Research |
Volume | 35 |
State | Published - 2014 |
Externally published | Yes |
Event | 27th Conference on Learning Theory, COLT 2014 - Barcelona, Spain Duration: Jun 13 2014 → Jun 15 2014 |
ASJC Scopus subject areas
- Software
- Control and Systems Engineering
- Statistics and Probability
- Artificial Intelligence