TY - JOUR
T1 - Automatic scene inference for 3D object compositing
AU - Karsch, Kevin
AU - Sunkavalli, Kalyan
AU - Hadap, Sunil
AU - Carr, Nathan
AU - Jin, Hailin
AU - Fonte, Rafael
AU - Sittig, Michael
AU - Forsyth, David
PY - 2014/5
Y1 - 2014/5
N2 - We present a user-friendly image editing system that supports a drag-anddrop object insertion (where the user merely drags objects into the image, and the system automatically places them in 3D and relights them appropriately), postprocess illumination editing, and depth-of-field manipulation. Underlying our system is a fully automatic technique for recovering a comprehensive 3D scene model (geometry, illumination, diffuse albedo, and camera parameters) from a single, low dynamic range photograph. This is made possible by two novel contributions: an illumination inference algorithm that recovers a full lighting model of the scene (including light sources that are not directly visible in the photograph), and a depth estimation algorithm that combines data-driven depth transfer with geometric reasoning about the scene layout. A user study shows that our system produces perceptually convincing results, and achieves the same level of realism as techniques that require significant user interaction.
AB - We present a user-friendly image editing system that supports a drag-anddrop object insertion (where the user merely drags objects into the image, and the system automatically places them in 3D and relights them appropriately), postprocess illumination editing, and depth-of-field manipulation. Underlying our system is a fully automatic technique for recovering a comprehensive 3D scene model (geometry, illumination, diffuse albedo, and camera parameters) from a single, low dynamic range photograph. This is made possible by two novel contributions: an illumination inference algorithm that recovers a full lighting model of the scene (including light sources that are not directly visible in the photograph), and a depth estimation algorithm that combines data-driven depth transfer with geometric reasoning about the scene layout. A user study shows that our system produces perceptually convincing results, and achieves the same level of realism as techniques that require significant user interaction.
KW - Depth estimation
KW - Illumination inference
KW - Image-based editing
KW - Image-based rendering
KW - Physically grounded
KW - Scene reconstruction
UR - http://www.scopus.com/inward/record.url?scp=84902241311&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=84902241311&partnerID=8YFLogxK
U2 - 10.1145/2602146
DO - 10.1145/2602146
M3 - Article
AN - SCOPUS:84902241311
SN - 0730-0301
VL - 33
JO - ACM Transactions on Graphics
JF - ACM Transactions on Graphics
IS - 3
M1 - 32
ER -