Semantic visual templates: linking visual features to semantics

Shih Fu Chang, William Chen, Hari Sundaram

Research output: Chapter in Book/Report/Conference proceedingConference contribution


The rapid growth of visual data over the last few years has lead to many schemes for retrieving such data. With content-based systems today, there exists a significant gap between the user's information needs and what the systems can deliver. We propose to bridge this gap, by introducing the novel idea of Semantic Visual Templates (SVT). Each template represents a personalized view of concepts (e.g. slalom, meetings, sunsets etc.), The SVT is represented using a set of successful queries, which are generated by a two-way interaction between the user and the system. We have developed algorithms that interact with the user and converge upon a small set of exemplar queries that maximize recall. SVT's emphasize intuitive models that allow for easy manipulation and queries to be composited. The resulting system performs well, for example with small number of queries in the 'sunset' template, we are able to achieve 50% recall and 24% precision over a large unannotated database.

Original languageEnglish (US)
Title of host publicationIEEE International Conference on Image Processing
PublisherIEEE Comp Soc
Number of pages5
StatePublished - 1998
Externally publishedYes
EventProceedings of the 1998 International Conference on Image Processing, ICIP. Part 2 (of 3) - Chicago, IL, USA
Duration: Oct 4 1998Oct 7 1998


OtherProceedings of the 1998 International Conference on Image Processing, ICIP. Part 2 (of 3)
CityChicago, IL, USA

ASJC Scopus subject areas

  • Computer Vision and Pattern Recognition
  • Hardware and Architecture
  • Electrical and Electronic Engineering

Cite this