On the equivalence of set-theoretic and maxent MAP estimation

Prakash Ishwar, Pierre Moulin

Research output: Contribution to journalArticlepeer-review


In this paper, we establish an equivalence, between two conceptually different methods of signal estimation under modeling uncertainty viz. set-theoretic (ST) estimation and maximum entropy (maxent) MAP estimation. The first method assumes constraints on the signal to be estimated, and the second assumes constraints on a probability distribution for the signal. We provide broad conditions under which the two aforementioned estimation paradigms produce the same signal estimate. We also show how the maxent formalism can be used to provide solutions to three important problems: How to select sizes of constraint sets in ST estimation (the analysis highlights the role of shrinkage); how to choose the values of parameters in regularized restoration when using multiple regularization functionals; and how to trade off model complexity and goodness of fit in a model selection problem.

Original languageEnglish (US)
Pages (from-to)698-713
Number of pages16
JournalIEEE Transactions on Signal Processing
Issue number3
StatePublished - Mar 2003


  • Estimation theory
  • Incomplete statistics
  • Inverse problems
  • Maximum entropy methods
  • Modeling
  • Set theory
  • Signal restoration

ASJC Scopus subject areas

  • Signal Processing
  • Electrical and Electronic Engineering


Dive into the research topics of 'On the equivalence of set-theoretic and maxent MAP estimation'. Together they form a unique fingerprint.

Cite this