Semantic visual templates: linking visual features to semantics

Shih Fu Chang, William Chen, Hari Sundaram

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

The rapid growth of visual data over the last few years has lead to many schemes for retrieving such data. With content-based systems today, there exists a significant gap between the user's information needs and what the systems can deliver. We propose to bridge this gap, by introducing the novel idea of Semantic Visual Templates (SVT). Each template represents a personalized view of concepts (e.g. slalom, meetings, sunsets etc.), The SVT is represented using a set of successful queries, which are generated by a two-way interaction between the user and the system. We have developed algorithms that interact with the user and converge upon a small set of exemplar queries that maximize recall. SVT's emphasize intuitive models that allow for easy manipulation and queries to be composited. The resulting system performs well, for example with small number of queries in the 'sunset' template, we are able to achieve 50% recall and 24% precision over a large unannotated database.

Original languageEnglish (US)
Title of host publicationIEEE International Conference on Image Processing
PublisherIEEE Comp Soc
Pages531-535
Number of pages5
Volume3
StatePublished - 1998
Externally publishedYes
EventProceedings of the 1998 International Conference on Image Processing, ICIP. Part 2 (of 3) - Chicago, IL, USA
Duration: Oct 4 1998Oct 7 1998

Other

OtherProceedings of the 1998 International Conference on Image Processing, ICIP. Part 2 (of 3)
CityChicago, IL, USA
Period10/4/9810/7/98

ASJC Scopus subject areas

  • Computer Vision and Pattern Recognition
  • Hardware and Architecture
  • Electrical and Electronic Engineering

Cite this