Real-time specular highlight removal using bilateral filtering

Qingxiong Yang, Shengnan Wang, Narendra Ahuja

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

In this paper, we propose a simple but effective specular highlight removal method using a single input image. Our method is based on a key observation - the maximum fraction of the diffuse color component (so called maximum diffuse chromaticity in the literature) in local patches in color images changes smoothly. Using this property, we can estimate the maximum diffuse chromaticity values of the specular pixels by directly applying low-pass filter to the maximum fraction of the color components of the original image, such that the maximum diffuse chromaticity values can be propagated from the diffuse pixels to the specular pixels. The diffuse color at each pixel can then be computed as a nonlinear function of the estimated maximum diffuse chromaticity. Our method can be directly extended for multi-color surfaces if edge-preserving filters (e.g., bilateral filter) are used such that the smoothing can be guided by the maximum diffuse chromaticity. But maximum diffuse chromaticity is to be estimated. We thus present an approximation and demonstrate its effectiveness. Recent development in fast bilateral filtering techniques enables our method to run over 200× faster than the state-of-the-art on a standard CPU and differentiates our method from previous work.

Original languageEnglish (US)
Title of host publicationComputer Vision, ECCV 2010 - 11th European Conference on Computer Vision, Proceedings
PublisherSpringer-Verlag
Pages87-100
Number of pages14
EditionPART 4
ISBN (Print)364215560X, 9783642155604
DOIs
StatePublished - Jan 1 2010
Event11th European Conference on Computer Vision, ECCV 2010 - Heraklion, Crete, Greece
Duration: Sep 10 2010Sep 11 2010

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
NumberPART 4
Volume6314 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference11th European Conference on Computer Vision, ECCV 2010
CountryGreece
CityHeraklion, Crete
Period9/10/109/11/10

Fingerprint

Filtering
Color
Real-time
Pixels
Pixel
Low pass filters
Bilateral Filter
Program processors
Low-pass Filter
Color Image
Differentiate
Nonlinear Function
Patch
Smoothing
Filter
Approximation
Estimate
Demonstrate

ASJC Scopus subject areas

  • Theoretical Computer Science
  • Computer Science(all)

Cite this

Yang, Q., Wang, S., & Ahuja, N. (2010). Real-time specular highlight removal using bilateral filtering. In Computer Vision, ECCV 2010 - 11th European Conference on Computer Vision, Proceedings (PART 4 ed., pp. 87-100). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 6314 LNCS, No. PART 4). Springer-Verlag. https://doi.org/10.1007/978-3-642-15561-1_7

Real-time specular highlight removal using bilateral filtering. / Yang, Qingxiong; Wang, Shengnan; Ahuja, Narendra.

Computer Vision, ECCV 2010 - 11th European Conference on Computer Vision, Proceedings. PART 4. ed. Springer-Verlag, 2010. p. 87-100 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 6314 LNCS, No. PART 4).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Yang, Q, Wang, S & Ahuja, N 2010, Real-time specular highlight removal using bilateral filtering. in Computer Vision, ECCV 2010 - 11th European Conference on Computer Vision, Proceedings. PART 4 edn, Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), no. PART 4, vol. 6314 LNCS, Springer-Verlag, pp. 87-100, 11th European Conference on Computer Vision, ECCV 2010, Heraklion, Crete, Greece, 9/10/10. https://doi.org/10.1007/978-3-642-15561-1_7
Yang Q, Wang S, Ahuja N. Real-time specular highlight removal using bilateral filtering. In Computer Vision, ECCV 2010 - 11th European Conference on Computer Vision, Proceedings. PART 4 ed. Springer-Verlag. 2010. p. 87-100. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); PART 4). https://doi.org/10.1007/978-3-642-15561-1_7
Yang, Qingxiong ; Wang, Shengnan ; Ahuja, Narendra. / Real-time specular highlight removal using bilateral filtering. Computer Vision, ECCV 2010 - 11th European Conference on Computer Vision, Proceedings. PART 4. ed. Springer-Verlag, 2010. pp. 87-100 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); PART 4).
@inproceedings{39019af8806e469e824c6553a7538fd6,
title = "Real-time specular highlight removal using bilateral filtering",
abstract = "In this paper, we propose a simple but effective specular highlight removal method using a single input image. Our method is based on a key observation - the maximum fraction of the diffuse color component (so called maximum diffuse chromaticity in the literature) in local patches in color images changes smoothly. Using this property, we can estimate the maximum diffuse chromaticity values of the specular pixels by directly applying low-pass filter to the maximum fraction of the color components of the original image, such that the maximum diffuse chromaticity values can be propagated from the diffuse pixels to the specular pixels. The diffuse color at each pixel can then be computed as a nonlinear function of the estimated maximum diffuse chromaticity. Our method can be directly extended for multi-color surfaces if edge-preserving filters (e.g., bilateral filter) are used such that the smoothing can be guided by the maximum diffuse chromaticity. But maximum diffuse chromaticity is to be estimated. We thus present an approximation and demonstrate its effectiveness. Recent development in fast bilateral filtering techniques enables our method to run over 200× faster than the state-of-the-art on a standard CPU and differentiates our method from previous work.",
author = "Qingxiong Yang and Shengnan Wang and Narendra Ahuja",
year = "2010",
month = "1",
day = "1",
doi = "10.1007/978-3-642-15561-1_7",
language = "English (US)",
isbn = "364215560X",
series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",
publisher = "Springer-Verlag",
number = "PART 4",
pages = "87--100",
booktitle = "Computer Vision, ECCV 2010 - 11th European Conference on Computer Vision, Proceedings",
edition = "PART 4",

}

TY - GEN

T1 - Real-time specular highlight removal using bilateral filtering

AU - Yang, Qingxiong

AU - Wang, Shengnan

AU - Ahuja, Narendra

PY - 2010/1/1

Y1 - 2010/1/1

N2 - In this paper, we propose a simple but effective specular highlight removal method using a single input image. Our method is based on a key observation - the maximum fraction of the diffuse color component (so called maximum diffuse chromaticity in the literature) in local patches in color images changes smoothly. Using this property, we can estimate the maximum diffuse chromaticity values of the specular pixels by directly applying low-pass filter to the maximum fraction of the color components of the original image, such that the maximum diffuse chromaticity values can be propagated from the diffuse pixels to the specular pixels. The diffuse color at each pixel can then be computed as a nonlinear function of the estimated maximum diffuse chromaticity. Our method can be directly extended for multi-color surfaces if edge-preserving filters (e.g., bilateral filter) are used such that the smoothing can be guided by the maximum diffuse chromaticity. But maximum diffuse chromaticity is to be estimated. We thus present an approximation and demonstrate its effectiveness. Recent development in fast bilateral filtering techniques enables our method to run over 200× faster than the state-of-the-art on a standard CPU and differentiates our method from previous work.

AB - In this paper, we propose a simple but effective specular highlight removal method using a single input image. Our method is based on a key observation - the maximum fraction of the diffuse color component (so called maximum diffuse chromaticity in the literature) in local patches in color images changes smoothly. Using this property, we can estimate the maximum diffuse chromaticity values of the specular pixels by directly applying low-pass filter to the maximum fraction of the color components of the original image, such that the maximum diffuse chromaticity values can be propagated from the diffuse pixels to the specular pixels. The diffuse color at each pixel can then be computed as a nonlinear function of the estimated maximum diffuse chromaticity. Our method can be directly extended for multi-color surfaces if edge-preserving filters (e.g., bilateral filter) are used such that the smoothing can be guided by the maximum diffuse chromaticity. But maximum diffuse chromaticity is to be estimated. We thus present an approximation and demonstrate its effectiveness. Recent development in fast bilateral filtering techniques enables our method to run over 200× faster than the state-of-the-art on a standard CPU and differentiates our method from previous work.

UR - http://www.scopus.com/inward/record.url?scp=78149352614&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=78149352614&partnerID=8YFLogxK

U2 - 10.1007/978-3-642-15561-1_7

DO - 10.1007/978-3-642-15561-1_7

M3 - Conference contribution

AN - SCOPUS:78149352614

SN - 364215560X

SN - 9783642155604

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 87

EP - 100

BT - Computer Vision, ECCV 2010 - 11th European Conference on Computer Vision, Proceedings

PB - Springer-Verlag

ER -