Depth and depth-color coding using shape-adaptive wavelets

Matthieu Maitre, Minh N. Do

Research output: Contribution to journalArticlepeer-review

Abstract

We present a novel depth and depth-color codec aimed at free-viewpoint 3D-TV. The proposed codec uses a shape-adaptive wavelet transform and an explicit encoding of the locations of major depth edges. Unlike the standard wavelet transform, the shape-adaptive transform generates small wavelet coefficients along depth edges, which greatly reduces the bits required to represent the data. The wavelet transform is implemented by shape-adaptive lifting, which enables fast computations and perfect reconstruction. We derive a simple extension of typical boundary extrapolation methods for lifting schemes to obtain as many vanishing moments near boundaries as away from them. We also develop a novel rate-constrained edge detection algorithm, which integrates the idea of significance bitplanes into the Canny edge detector. Together with a simple chain code, it provides an efficient way to extract and encode edges. Experimental results on synthetic and real data confirm the effectiveness of the proposed codec, with PSNR gains of more than 5 dB for depth images and significantly better visual quality for synthesized novel view images.

Original languageEnglish (US)
Pages (from-to)513-522
Number of pages10
JournalJournal of Visual Communication and Image Representation
Volume21
Issue number5-6
DOIs
StatePublished - Jul 2010

Keywords

  • 3D-TV
  • Boundary wavelets
  • Depth image
  • Depth map
  • Edge coding
  • Free-viewpoint video
  • Lifting
  • Rate-distortion optimization
  • Shape-adaptive wavelet transform

ASJC Scopus subject areas

  • Electrical and Electronic Engineering
  • Media Technology
  • Computer Vision and Pattern Recognition
  • Signal Processing

Fingerprint

Dive into the research topics of 'Depth and depth-color coding using shape-adaptive wavelets'. Together they form a unique fingerprint.

Cite this