Bayesian function estimation using continuous wavelet dictionaries

Jen Hwa Chu, Merlise A. Clyde, Feng Liang

Research output: Contribution to journalArticlepeer-review


We present a Bayesian approach for nonparametric function estimation based on a continuous wavelet dictionary, where the unknown function is modeled by a random sum of wavelet functions at arbitrary locations and scales. By avoiding the dyadic constraints for orthonormal wavelet bases, the continuous over- complete wavelet dictionary has greater flexibility to adapt to the structure of the data, and may lead to sparser representations. The price for this flexibility is the computational challenge of searching over an infinite number of potential dictionary elements. We develop a novel reversible jump Markov chain Monte Carlo algorithm which utilizes local features in the proposal distributions to improve computational efficiency, and which leads to better mixing of the Markov chain. Performance comparison in terms of sparsity and mean squared error is carried out on standard wavelet test functions. Results on a non-equally spaced example show that our method compares favorably to methods using interpolation or imputation.

Original languageEnglish (US)
Pages (from-to)1419-1438
Number of pages20
JournalStatistica Sinica
Issue number4
StatePublished - Oct 2009


  • Bayesian inference
  • Nonparametric regression
  • Overcomplete dictionaries
  • Reversible jump markov chain monte carlo
  • Stochastic expansions
  • Wavelets

ASJC Scopus subject areas

  • Statistics and Probability
  • Statistics, Probability and Uncertainty


Dive into the research topics of 'Bayesian function estimation using continuous wavelet dictionaries'. Together they form a unique fingerprint.

Cite this