Annotating photo collections by label propagation according to multiple similarity cues

Liangliang Cao, Jiebo Luo, Thomas S. Huang

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

This paper considers the emerging problem of annotating personal photo collections that are taken by digital cameras and may have been subsequently organized by customers. Unlike the images from the web searching engine or commercial image banks (e.g. the Corel database), the photos in the same personal collection are related to each other in time, location, and content. Advanced technologies can record the GPS coordinates for each photo, and thus provide a richer source of context to model and enforce the correlation between the photos in the same collection. Recognizing the well-known limitations ("semantic gap") of visual recognition algorithms, we exploit the correlation between the photos to enhance the annotation performance. In our approach, high-confidence annotation labels are first obtained for certain photos and then propagated to the remaining photos in the same collection, according to time, location, and visual proximity (or similarity). A novel generative probabilistic model is employed, which outperforms the pervious linear propagation scheme. Experimental results have shown the advantages of the proposed annotation scheme.

Original languageEnglish (US)
Title of host publicationMM'08 - Proceedings of the 2008 ACM International Conference on Multimedia, with co-located Symposium and Workshops
Pages121-129
Number of pages9
DOIs
StatePublished - Dec 1 2008
Event16th ACM International Conference on Multimedia, MM '08 - Vancouver, BC, Canada
Duration: Oct 26 2008Oct 31 2008

Publication series

NameMM'08 - Proceedings of the 2008 ACM International Conference on Multimedia, with co-located Symposium and Workshops

Other

Other16th ACM International Conference on Multimedia, MM '08
Country/TerritoryCanada
CityVancouver, BC
Period10/26/0810/31/08

Keywords

  • Color histogram
  • GPS
  • Label propagation
  • Photo collection
  • Photo similarities
  • SIFT
  • Timestamp

ASJC Scopus subject areas

  • Computer Graphics and Computer-Aided Design
  • Computer Vision and Pattern Recognition
  • Software

Fingerprint

Dive into the research topics of 'Annotating photo collections by label propagation according to multiple similarity cues'. Together they form a unique fingerprint.

Cite this