Variable-source shading analysis

Research output: Contribution to journalArticle

Abstract

The shading on curved surfaces is a cue to shape. Current computer vision methods for analyzing shading use physically unrealistic models, have serious mathematical problems, cannot exploit geometric information if it is available, and are not reliable in practice. We introduce a novel method of accounting for variations in irradiance resulting from interreflections, complex sources and the like. Our approach uses a spatially varying source model with a local shading model. Fast spatial variation in the source is penalised, consistent with the rendering community's insight that interreflections are spatially slow. This yields a physically plausible shading model. Because modern cameras can make accurate reports of observed radiance, our method compels the reconstructed surface to have shading exactly consistent with that of the image. For inference, we use a variational formulation, with a selection of regularization terms which guarantee that a solution exists. Our method is evaluated on physically accurate renderings of virtual objects, and on images of real scenes, for a variety of different kinds of boundary condition. Reconstructions for single sources compare well with photometric stereo reconstructions and with ground truth.

Original languageEnglish (US)
Pages (from-to)280-302
Number of pages23
JournalInternational Journal of Computer Vision
Volume91
Issue number3
DOIs
StatePublished - Feb 1 2011

Fingerprint

Computer vision
Cameras
Boundary conditions

Keywords

  • Computer vision
  • Interreflections
  • Object recognition
  • Shape from shading

ASJC Scopus subject areas

  • Software
  • Computer Vision and Pattern Recognition
  • Artificial Intelligence

Cite this

Variable-source shading analysis. / Forsyth, D. A.

In: International Journal of Computer Vision, Vol. 91, No. 3, 01.02.2011, p. 280-302.

Research output: Contribution to journalArticle

@article{0582bfafd8c8476798a1c150e7a1db9c,
title = "Variable-source shading analysis",
abstract = "The shading on curved surfaces is a cue to shape. Current computer vision methods for analyzing shading use physically unrealistic models, have serious mathematical problems, cannot exploit geometric information if it is available, and are not reliable in practice. We introduce a novel method of accounting for variations in irradiance resulting from interreflections, complex sources and the like. Our approach uses a spatially varying source model with a local shading model. Fast spatial variation in the source is penalised, consistent with the rendering community's insight that interreflections are spatially slow. This yields a physically plausible shading model. Because modern cameras can make accurate reports of observed radiance, our method compels the reconstructed surface to have shading exactly consistent with that of the image. For inference, we use a variational formulation, with a selection of regularization terms which guarantee that a solution exists. Our method is evaluated on physically accurate renderings of virtual objects, and on images of real scenes, for a variety of different kinds of boundary condition. Reconstructions for single sources compare well with photometric stereo reconstructions and with ground truth.",
keywords = "Computer vision, Interreflections, Object recognition, Shape from shading",
author = "Forsyth, {D. A.}",
year = "2011",
month = "2",
day = "1",
doi = "10.1007/s11263-010-0396-9",
language = "English (US)",
volume = "91",
pages = "280--302",
journal = "International Journal of Computer Vision",
issn = "0920-5691",
publisher = "Springer Netherlands",
number = "3",

}

TY - JOUR

T1 - Variable-source shading analysis

AU - Forsyth, D. A.

PY - 2011/2/1

Y1 - 2011/2/1

N2 - The shading on curved surfaces is a cue to shape. Current computer vision methods for analyzing shading use physically unrealistic models, have serious mathematical problems, cannot exploit geometric information if it is available, and are not reliable in practice. We introduce a novel method of accounting for variations in irradiance resulting from interreflections, complex sources and the like. Our approach uses a spatially varying source model with a local shading model. Fast spatial variation in the source is penalised, consistent with the rendering community's insight that interreflections are spatially slow. This yields a physically plausible shading model. Because modern cameras can make accurate reports of observed radiance, our method compels the reconstructed surface to have shading exactly consistent with that of the image. For inference, we use a variational formulation, with a selection of regularization terms which guarantee that a solution exists. Our method is evaluated on physically accurate renderings of virtual objects, and on images of real scenes, for a variety of different kinds of boundary condition. Reconstructions for single sources compare well with photometric stereo reconstructions and with ground truth.

AB - The shading on curved surfaces is a cue to shape. Current computer vision methods for analyzing shading use physically unrealistic models, have serious mathematical problems, cannot exploit geometric information if it is available, and are not reliable in practice. We introduce a novel method of accounting for variations in irradiance resulting from interreflections, complex sources and the like. Our approach uses a spatially varying source model with a local shading model. Fast spatial variation in the source is penalised, consistent with the rendering community's insight that interreflections are spatially slow. This yields a physically plausible shading model. Because modern cameras can make accurate reports of observed radiance, our method compels the reconstructed surface to have shading exactly consistent with that of the image. For inference, we use a variational formulation, with a selection of regularization terms which guarantee that a solution exists. Our method is evaluated on physically accurate renderings of virtual objects, and on images of real scenes, for a variety of different kinds of boundary condition. Reconstructions for single sources compare well with photometric stereo reconstructions and with ground truth.

KW - Computer vision

KW - Interreflections

KW - Object recognition

KW - Shape from shading

UR - http://www.scopus.com/inward/record.url?scp=79851515871&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=79851515871&partnerID=8YFLogxK

U2 - 10.1007/s11263-010-0396-9

DO - 10.1007/s11263-010-0396-9

M3 - Article

AN - SCOPUS:79851515871

VL - 91

SP - 280

EP - 302

JO - International Journal of Computer Vision

JF - International Journal of Computer Vision

SN - 0920-5691

IS - 3

ER -