A revisit to MRF-based depth map super-resolution and enhancement

Jiangbo Lu, Dongbo Min, Ramanpreet Singh Pahwa, Minh N Do

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

This paper presents a Markov Random Field (MRF)-based approach for depth map super-resolution and enhancement. Given a low-resolution or moderate quality depth map, we study the problem of enhancing its resolution or quality with a registered high-resolution color image. Different from the previous methods, this MRF-based approach is based on a novel data term formulation that fits well to the unique characteristics of depth maps. We also discuss a few important design choices that boost the performance of general MRF-based methods. Experimental results show that our proposed approach achieves high-resolution depth maps at more desirable quality, both qualitatively and quantitatively. It can also be applied to enhance the depth maps derived with state-of-the-art stereo methods, resulting in the raised ranking based on the Middlebury benchmark.

Original languageEnglish (US)
Title of host publication2011 IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP 2011 - Proceedings
Pages985-988
Number of pages4
DOIs
StatePublished - Aug 18 2011
Event36th IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP 2011 - Prague, Czech Republic
Duration: May 22 2011May 27 2011

Publication series

NameICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings
ISSN (Print)1520-6149

Other

Other36th IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP 2011
CountryCzech Republic
CityPrague
Period5/22/115/27/11

Fingerprint

Color

Keywords

  • depth super-resolution
  • depth-enhancement
  • global optimization
  • MRFs
  • Time-of-flight sensor

ASJC Scopus subject areas

  • Signal Processing
  • Software
  • Electrical and Electronic Engineering

Cite this

Lu, J., Min, D., Pahwa, R. S., & Do, M. N. (2011). A revisit to MRF-based depth map super-resolution and enhancement. In 2011 IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP 2011 - Proceedings (pp. 985-988). [5946571] (ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings). https://doi.org/10.1109/ICASSP.2011.5946571

A revisit to MRF-based depth map super-resolution and enhancement. / Lu, Jiangbo; Min, Dongbo; Pahwa, Ramanpreet Singh; Do, Minh N.

2011 IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP 2011 - Proceedings. 2011. p. 985-988 5946571 (ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Lu, J, Min, D, Pahwa, RS & Do, MN 2011, A revisit to MRF-based depth map super-resolution and enhancement. in 2011 IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP 2011 - Proceedings., 5946571, ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings, pp. 985-988, 36th IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP 2011, Prague, Czech Republic, 5/22/11. https://doi.org/10.1109/ICASSP.2011.5946571
Lu J, Min D, Pahwa RS, Do MN. A revisit to MRF-based depth map super-resolution and enhancement. In 2011 IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP 2011 - Proceedings. 2011. p. 985-988. 5946571. (ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings). https://doi.org/10.1109/ICASSP.2011.5946571
Lu, Jiangbo ; Min, Dongbo ; Pahwa, Ramanpreet Singh ; Do, Minh N. / A revisit to MRF-based depth map super-resolution and enhancement. 2011 IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP 2011 - Proceedings. 2011. pp. 985-988 (ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings).
@inproceedings{00cedc936f534959be027a3d7dedb2d6,
title = "A revisit to MRF-based depth map super-resolution and enhancement",
abstract = "This paper presents a Markov Random Field (MRF)-based approach for depth map super-resolution and enhancement. Given a low-resolution or moderate quality depth map, we study the problem of enhancing its resolution or quality with a registered high-resolution color image. Different from the previous methods, this MRF-based approach is based on a novel data term formulation that fits well to the unique characteristics of depth maps. We also discuss a few important design choices that boost the performance of general MRF-based methods. Experimental results show that our proposed approach achieves high-resolution depth maps at more desirable quality, both qualitatively and quantitatively. It can also be applied to enhance the depth maps derived with state-of-the-art stereo methods, resulting in the raised ranking based on the Middlebury benchmark.",
keywords = "depth super-resolution, depth-enhancement, global optimization, MRFs, Time-of-flight sensor",
author = "Jiangbo Lu and Dongbo Min and Pahwa, {Ramanpreet Singh} and Do, {Minh N}",
year = "2011",
month = "8",
day = "18",
doi = "10.1109/ICASSP.2011.5946571",
language = "English (US)",
isbn = "9781457705397",
series = "ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings",
pages = "985--988",
booktitle = "2011 IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP 2011 - Proceedings",

}

TY - GEN

T1 - A revisit to MRF-based depth map super-resolution and enhancement

AU - Lu, Jiangbo

AU - Min, Dongbo

AU - Pahwa, Ramanpreet Singh

AU - Do, Minh N

PY - 2011/8/18

Y1 - 2011/8/18

N2 - This paper presents a Markov Random Field (MRF)-based approach for depth map super-resolution and enhancement. Given a low-resolution or moderate quality depth map, we study the problem of enhancing its resolution or quality with a registered high-resolution color image. Different from the previous methods, this MRF-based approach is based on a novel data term formulation that fits well to the unique characteristics of depth maps. We also discuss a few important design choices that boost the performance of general MRF-based methods. Experimental results show that our proposed approach achieves high-resolution depth maps at more desirable quality, both qualitatively and quantitatively. It can also be applied to enhance the depth maps derived with state-of-the-art stereo methods, resulting in the raised ranking based on the Middlebury benchmark.

AB - This paper presents a Markov Random Field (MRF)-based approach for depth map super-resolution and enhancement. Given a low-resolution or moderate quality depth map, we study the problem of enhancing its resolution or quality with a registered high-resolution color image. Different from the previous methods, this MRF-based approach is based on a novel data term formulation that fits well to the unique characteristics of depth maps. We also discuss a few important design choices that boost the performance of general MRF-based methods. Experimental results show that our proposed approach achieves high-resolution depth maps at more desirable quality, both qualitatively and quantitatively. It can also be applied to enhance the depth maps derived with state-of-the-art stereo methods, resulting in the raised ranking based on the Middlebury benchmark.

KW - depth super-resolution

KW - depth-enhancement

KW - global optimization

KW - MRFs

KW - Time-of-flight sensor

UR - http://www.scopus.com/inward/record.url?scp=80051640232&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=80051640232&partnerID=8YFLogxK

U2 - 10.1109/ICASSP.2011.5946571

DO - 10.1109/ICASSP.2011.5946571

M3 - Conference contribution

SN - 9781457705397

T3 - ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings

SP - 985

EP - 988

BT - 2011 IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP 2011 - Proceedings

ER -