An approximate shading model for object relighting

Zicheng Liao, Kevin Karsch, David Forsyth

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

We propose an approximate shading model for image-based object modeling and insertion. Our approach is a hybrid of 3D rendering and image-based composition. It avoids the difficulties of physically accurate shape estimation from a single image, and allows for more flexible image composition than pure image-based methods. The model decomposes the shading field into (a) a rough shape term that can be reshaded, (b) a parametric shading detail that encodes missing features from the first term, and (c) a geometric detail term that captures fine-scale material properties. With this object model, we build an object relighting system that allows an artist to select an object from an image and insert it into a 3D scene. Through simple interactions, the system can adjust illumination on the inserted object so that it appears more naturally in the scene. Our quantitative evaluation and extensive user study suggest our method is a promising alternative to existing methods of object insertion.

Original languageEnglish (US)
Title of host publicationIEEE Conference on Computer Vision and Pattern Recognition, CVPR 2015
PublisherIEEE Computer Society
Pages5307-5314
Number of pages8
ISBN (Electronic)9781467369640
DOIs
StatePublished - Oct 14 2015
EventIEEE Conference on Computer Vision and Pattern Recognition, CVPR 2015 - Boston, United States
Duration: Jun 7 2015Jun 12 2015

Publication series

NameProceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition
Volume07-12-June-2015
ISSN (Print)1063-6919

Other

OtherIEEE Conference on Computer Vision and Pattern Recognition, CVPR 2015
CountryUnited States
CityBoston
Period6/7/156/12/15

Fingerprint

Chemical analysis
Materials properties
Lighting

ASJC Scopus subject areas

  • Software
  • Computer Vision and Pattern Recognition

Cite this

Liao, Z., Karsch, K., & Forsyth, D. (2015). An approximate shading model for object relighting. In IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2015 (pp. 5307-5314). [7299168] (Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition; Vol. 07-12-June-2015). IEEE Computer Society. https://doi.org/10.1109/CVPR.2015.7299168

An approximate shading model for object relighting. / Liao, Zicheng; Karsch, Kevin; Forsyth, David.

IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2015. IEEE Computer Society, 2015. p. 5307-5314 7299168 (Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition; Vol. 07-12-June-2015).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Liao, Z, Karsch, K & Forsyth, D 2015, An approximate shading model for object relighting. in IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2015., 7299168, Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, vol. 07-12-June-2015, IEEE Computer Society, pp. 5307-5314, IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2015, Boston, United States, 6/7/15. https://doi.org/10.1109/CVPR.2015.7299168
Liao Z, Karsch K, Forsyth D. An approximate shading model for object relighting. In IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2015. IEEE Computer Society. 2015. p. 5307-5314. 7299168. (Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition). https://doi.org/10.1109/CVPR.2015.7299168
Liao, Zicheng ; Karsch, Kevin ; Forsyth, David. / An approximate shading model for object relighting. IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2015. IEEE Computer Society, 2015. pp. 5307-5314 (Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition).
@inproceedings{24ef7ef571e541e6b4c497d23f32d33d,
title = "An approximate shading model for object relighting",
abstract = "We propose an approximate shading model for image-based object modeling and insertion. Our approach is a hybrid of 3D rendering and image-based composition. It avoids the difficulties of physically accurate shape estimation from a single image, and allows for more flexible image composition than pure image-based methods. The model decomposes the shading field into (a) a rough shape term that can be reshaded, (b) a parametric shading detail that encodes missing features from the first term, and (c) a geometric detail term that captures fine-scale material properties. With this object model, we build an object relighting system that allows an artist to select an object from an image and insert it into a 3D scene. Through simple interactions, the system can adjust illumination on the inserted object so that it appears more naturally in the scene. Our quantitative evaluation and extensive user study suggest our method is a promising alternative to existing methods of object insertion.",
author = "Zicheng Liao and Kevin Karsch and David Forsyth",
year = "2015",
month = "10",
day = "14",
doi = "10.1109/CVPR.2015.7299168",
language = "English (US)",
series = "Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition",
publisher = "IEEE Computer Society",
pages = "5307--5314",
booktitle = "IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2015",

}

TY - GEN

T1 - An approximate shading model for object relighting

AU - Liao, Zicheng

AU - Karsch, Kevin

AU - Forsyth, David

PY - 2015/10/14

Y1 - 2015/10/14

N2 - We propose an approximate shading model for image-based object modeling and insertion. Our approach is a hybrid of 3D rendering and image-based composition. It avoids the difficulties of physically accurate shape estimation from a single image, and allows for more flexible image composition than pure image-based methods. The model decomposes the shading field into (a) a rough shape term that can be reshaded, (b) a parametric shading detail that encodes missing features from the first term, and (c) a geometric detail term that captures fine-scale material properties. With this object model, we build an object relighting system that allows an artist to select an object from an image and insert it into a 3D scene. Through simple interactions, the system can adjust illumination on the inserted object so that it appears more naturally in the scene. Our quantitative evaluation and extensive user study suggest our method is a promising alternative to existing methods of object insertion.

AB - We propose an approximate shading model for image-based object modeling and insertion. Our approach is a hybrid of 3D rendering and image-based composition. It avoids the difficulties of physically accurate shape estimation from a single image, and allows for more flexible image composition than pure image-based methods. The model decomposes the shading field into (a) a rough shape term that can be reshaded, (b) a parametric shading detail that encodes missing features from the first term, and (c) a geometric detail term that captures fine-scale material properties. With this object model, we build an object relighting system that allows an artist to select an object from an image and insert it into a 3D scene. Through simple interactions, the system can adjust illumination on the inserted object so that it appears more naturally in the scene. Our quantitative evaluation and extensive user study suggest our method is a promising alternative to existing methods of object insertion.

UR - http://www.scopus.com/inward/record.url?scp=84959215624&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84959215624&partnerID=8YFLogxK

U2 - 10.1109/CVPR.2015.7299168

DO - 10.1109/CVPR.2015.7299168

M3 - Conference contribution

AN - SCOPUS:84959215624

T3 - Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition

SP - 5307

EP - 5314

BT - IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2015

PB - IEEE Computer Society

ER -