TY - JOUR
T1 - Generative Bayesian image super resolution with natural image prior
AU - Zhang, Haichao
AU - Zhang, Yanning
AU - Li, Haisen
AU - Huang, Thomas S.
N1 - Funding Information:
Manuscript received December 23, 2011; revised March 21, 2012; accepted May 1, 2012. Date of publication May 15, 2012; date of current version August 22, 2012. This work was supported in part by the National Natural Science Foundation of China, under Grant 60872145 and Grant 60903126, the National High Technology Research and Development Program of China, under Grant 2009AA01Z315, and the U.S. Army Research Laboratory and Army Research Office, under Grant W911NF-09-1-0383. The associate editor coordinating the review of this manuscript and approving it for publication was Prof. Pascal Frossard.
PY - 2012
Y1 - 2012
N2 - We propose a new single image super resolution (SR) algorithm via Bayesian modeling with a natural image prior modeled by a high-order Markov random field (MRF). SR is one of the long-standing and active topics in image processing community. It is of great use in many practical applications, such as astronomical observation, medical imaging, and the adaptation of low-resolution contents onto high-resolution displays. One category of the conventional approaches for image SR is formulating the problem with Bayesian modeling techniques and then obtaining its maximum-a-posteriori solution, which actually boils down to a regularized regression task. Although straightforward, this approach cannot exploit the full potential offered by the probabilistic modeling, as only the posterior mode is sought. On the other hand, current Bayesian SR approaches using the posterior mean estimation typically use very simple prior models for natural images to ensure the computational tractability. In this paper, we present a Bayesian image SR approach with a flexible high-order MRF model as the prior for natural images. The minimum mean square error (MMSE) criteria are used for estimating the HR image. A Markov chain Monte Carlo-based sampling algorithm is presented for obtaining the MMSE solution. The proposed method cannot only enjoy the benefits offered by the flexible prior, but also has the advantage of making use of the probabilistic modeling to perform a posterior mean estimation, thus is less sensitive to the local minima problem as the MAP solution. Experimental results indicate that the proposed method can generate competitive or better results than state-of-the-art SR algorithms.
AB - We propose a new single image super resolution (SR) algorithm via Bayesian modeling with a natural image prior modeled by a high-order Markov random field (MRF). SR is one of the long-standing and active topics in image processing community. It is of great use in many practical applications, such as astronomical observation, medical imaging, and the adaptation of low-resolution contents onto high-resolution displays. One category of the conventional approaches for image SR is formulating the problem with Bayesian modeling techniques and then obtaining its maximum-a-posteriori solution, which actually boils down to a regularized regression task. Although straightforward, this approach cannot exploit the full potential offered by the probabilistic modeling, as only the posterior mode is sought. On the other hand, current Bayesian SR approaches using the posterior mean estimation typically use very simple prior models for natural images to ensure the computational tractability. In this paper, we present a Bayesian image SR approach with a flexible high-order MRF model as the prior for natural images. The minimum mean square error (MMSE) criteria are used for estimating the HR image. A Markov chain Monte Carlo-based sampling algorithm is presented for obtaining the MMSE solution. The proposed method cannot only enjoy the benefits offered by the flexible prior, but also has the advantage of making use of the probabilistic modeling to perform a posterior mean estimation, thus is less sensitive to the local minima problem as the MAP solution. Experimental results indicate that the proposed method can generate competitive or better results than state-of-the-art SR algorithms.
KW - Bayesian minimum mean square error estimation
KW - Markov chain Monte Carlo (MCMC)
KW - Markov random field
KW - field-of-experts
KW - natural image statistics
KW - super resolution (SR)
UR - http://www.scopus.com/inward/record.url?scp=84865444179&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=84865444179&partnerID=8YFLogxK
U2 - 10.1109/TIP.2012.2199330
DO - 10.1109/TIP.2012.2199330
M3 - Article
C2 - 22614649
AN - SCOPUS:84865444179
SN - 1057-7149
VL - 21
SP - 4054
EP - 4067
JO - IEEE Transactions on Image Processing
JF - IEEE Transactions on Image Processing
IS - 9
M1 - 6200344
ER -