Photo clip art

Jean François Lalonde, Derek Hoiem, Alexei A. Efros, Carsten Rother, John Winn, Antonio Criminisi

Research output: Contribution to conferencePaper

Abstract

We present a system for inserting new objects into existing photographs by querying a vast image-based object library, pre-computed using a publicly available Internet object database. The central goal is to shield the user from all of the arduous tasks typically involved in image compositing. The user is only asked to do two simple things: 1) pick a 3D location in the scene to place a new object; 2) select an object to insert using a hierarchical menu. We pose the problem of object insertion as a data-driven, 3D-based, context-sensitive object retrieval task. Instead of trying to manipulate the object to change its orientation, color distribution, etc. to fit the new image, we simply retrieve an object of a specified class that has all the required properties (camera pose, lighting, resolution, etc) from our large object library. We present new automatic algorithms for improving object segmentation and blending, estimating true 3D object size and orientation, and estimating scene lighting conditions. We also present an intuitive user interface that makes object insertion fast and simple even for the artistically challenged.

Original languageEnglish (US)
DOIs
StatePublished - Dec 17 2007
Externally publishedYes
Event34th Annual Meeting of the Association for Computing Machinery's Special Interest Group on Graphics - San Diego, CA, United States
Duration: Aug 5 2007Aug 9 2007

Other

Other34th Annual Meeting of the Association for Computing Machinery's Special Interest Group on Graphics
CountryUnited States
CitySan Diego, CA
Period8/5/078/9/07

Keywords

  • 3D scene reasoning
  • Blending and compositing
  • Computational photography
  • Image databases
  • Object insertion

ASJC Scopus subject areas

  • Computer Science(all)

Fingerprint Dive into the research topics of 'Photo clip art'. Together they form a unique fingerprint.

  • Cite this

    Lalonde, J. F., Hoiem, D., Efros, A. A., Rother, C., Winn, J., & Criminisi, A. (2007). Photo clip art. Paper presented at 34th Annual Meeting of the Association for Computing Machinery's Special Interest Group on Graphics, San Diego, CA, United States. https://doi.org/10.1145/1275808.1276381