Wavelet-based joint estimation and encoding of depth-image-based representations for free-viewpoint rendering

Matthieu Maitre, Yoshihisa Shinagawa, Minh N. Do

Research output: Contribution to journalArticlepeer-review


We propose a wavelet-based codec for the static depth-image-based representation, which allows viewers to freely choose the viewpoint. The proposed codec jointly estimates and encodes the unknown depth map from multiple views using a novel rate-distortion (RD) optimization scheme. The rate constraint reduces the ambiguity of depth estimation by favoring piecewise-smooth depth maps. The optimization is efficiently solved by a novel dynamic programming along trees of integer wavelet coefficients. The codec encodes the image and the depth map jointly to decrease their redundancy and to provide a RD-optimized bitrate allocation between the two. The codec also offers scalability both in resolution and in quality. Experiments on real data show the effectiveness of the proposed codec.

Original languageEnglish (US)
Pages (from-to)946-957
Number of pages12
JournalIEEE Transactions on Image Processing
Issue number6
StatePublished - Jun 2008


  • 3-D TV
  • Depth estimation
  • Depth-image-based representation (DIBR)
  • Free-viewpoint rendering
  • Image-based rendering
  • Joint coding
  • Rate-distortion optimization
  • Scalable coding

ASJC Scopus subject areas

  • Electrical and Electronic Engineering
  • Computer Graphics and Computer-Aided Design
  • Software
  • Theoretical Computer Science
  • Computational Theory and Mathematics
  • Computer Vision and Pattern Recognition


Dive into the research topics of 'Wavelet-based joint estimation and encoding of depth-image-based representations for free-viewpoint rendering'. Together they form a unique fingerprint.

Cite this