TY - JOUR
T1 - Wavelet-based joint estimation and encoding of depth-image-based representations for free-viewpoint rendering
AU - Maitre, Matthieu
AU - Shinagawa, Yoshihisa
AU - Do, Minh N.
N1 - Funding Information:
Manuscript received May 11, 2007; revised February 4, 2008. This work was supported in part by the National Science Foundation under Grant ITR-0312432. The associate editor coordinating the review of this manuscript and approving it for publication was Dr. Hassan Foroosh. M. Maitre is with the Windows Experience Group, Microsoft, Redmond, WA 98052 USA (e-mail: [email protected]). Y. Shinagawa is with Siemens Medical Solutions, Malvern, PA 19355 USA (e-mail: [email protected]). M. N. Do is with the Department of Electrical and Computer Engineering, Coordinated Science Laboratory, Beckman Institute, University of Illinois at Urbana-Champaign, Urbana, IL 61801 USA (e-mail: [email protected]). Color versions of one or more of the figures in this paper are available online at http://ieeexplore.ieee.org. Digital Object Identifier 10.1109/TIP.2008.922425
PY - 2008/6
Y1 - 2008/6
N2 - We propose a wavelet-based codec for the static depth-image-based representation, which allows viewers to freely choose the viewpoint. The proposed codec jointly estimates and encodes the unknown depth map from multiple views using a novel rate-distortion (RD) optimization scheme. The rate constraint reduces the ambiguity of depth estimation by favoring piecewise-smooth depth maps. The optimization is efficiently solved by a novel dynamic programming along trees of integer wavelet coefficients. The codec encodes the image and the depth map jointly to decrease their redundancy and to provide a RD-optimized bitrate allocation between the two. The codec also offers scalability both in resolution and in quality. Experiments on real data show the effectiveness of the proposed codec.
AB - We propose a wavelet-based codec for the static depth-image-based representation, which allows viewers to freely choose the viewpoint. The proposed codec jointly estimates and encodes the unknown depth map from multiple views using a novel rate-distortion (RD) optimization scheme. The rate constraint reduces the ambiguity of depth estimation by favoring piecewise-smooth depth maps. The optimization is efficiently solved by a novel dynamic programming along trees of integer wavelet coefficients. The codec encodes the image and the depth map jointly to decrease their redundancy and to provide a RD-optimized bitrate allocation between the two. The codec also offers scalability both in resolution and in quality. Experiments on real data show the effectiveness of the proposed codec.
KW - 3-D TV
KW - Depth estimation
KW - Depth-image-based representation (DIBR)
KW - Free-viewpoint rendering
KW - Image-based rendering
KW - Joint coding
KW - Rate-distortion optimization
KW - Scalable coding
UR - http://www.scopus.com/inward/record.url?scp=44649172448&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=44649172448&partnerID=8YFLogxK
U2 - 10.1109/TIP.2008.922425
DO - 10.1109/TIP.2008.922425
M3 - Article
C2 - 18482889
AN - SCOPUS:44649172448
SN - 1057-7149
VL - 17
SP - 946
EP - 957
JO - IEEE Transactions on Image Processing
JF - IEEE Transactions on Image Processing
IS - 6
ER -