Exact minimax strategies for predictive density estimation, data compression, and model selection

Feng Liang, Andrew Barron

Research output: Contribution to journalArticlepeer-review

Abstract

For location and scale families of distributions and related settings of linear regression, we determine minimax procedures for predictive density estimation, for universal data compression, and for the minimum description length (MDL) criterion for model selection. The analysis gives the best invariant and indeed minimax procedure for predictive density estimation by directly verifying extended Bayes properties or, alternatively, by general aspects of decision theory on groups which are shown to simplify in the case of Kullback-Leibler loss. An exact minimax rule is generalized Bayes using a uniform (Lebesgue measure) prior on the location and log-scale parameters, which is made proper by conditioning on an initial set of observations.

Original languageEnglish (US)
Pages (from-to)2708-2726
Number of pages19
JournalIEEE Transactions on Information Theory
Volume50
Issue number11
DOIs
StatePublished - Nov 2004
Externally publishedYes

ASJC Scopus subject areas

  • Information Systems
  • Computer Science Applications
  • Library and Information Sciences

Fingerprint

Dive into the research topics of 'Exact minimax strategies for predictive density estimation, data compression, and model selection'. Together they form a unique fingerprint.

Cite this