Online sparsifying transform learning -Part i: Algorithms

Saiprasad Ravishankar, Bihan Wen, Yoram Bresler

Research output: Contribution to journalArticlepeer-review

Abstract

Techniques exploiting the sparsity of signals in a transform domain or dictionary have been popular in signal processing. Adaptive synthesis dictionaries have been shown to be useful in applications such as signal denoising, and medical image reconstruction. More recently, the learning of sparsifying transforms for data has received interest. The sparsifying transform model allows for cheap and exact computations. In this paper, we develop a methodology for online learning of square sparsifying transforms. Such online learning can be particularly useful when dealing with big data, and for signal processing applications such as real-time sparse representation and denoising. The proposed transform learning algorithms are shown to have a much lower computational cost than online synthesis dictionary learning. In practice, the sequential learning of a sparsifying transform typically converges faster than batch mode transform learning. Preliminary experiments show the usefulness of the proposed schemes for sparse representation, and denoising.

Original languageEnglish (US)
Article number7069264
Pages (from-to)625-636
Number of pages12
JournalIEEE Journal on Selected Topics in Signal Processing
Volume9
Issue number4
DOIs
StatePublished - Jun 1 2015

Keywords

  • Sparse representations
  • big data
  • denoising
  • dictionary learning
  • image representation
  • machine learning
  • online learning
  • sparsifying transforms

ASJC Scopus subject areas

  • Signal Processing
  • Electrical and Electronic Engineering

Fingerprint

Dive into the research topics of 'Online sparsifying transform learning -Part i: Algorithms'. Together they form a unique fingerprint.

Cite this