A factor graph framework for semantic indexing and retrieval in video

M. Naphade, I. Kozintsev, Thomas S Huang, K. Ramchandran

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

This paper proposes a novel framework for semantic indexing and retrieval in digital video. The components of the framework are probabilistic multimedia objects (multijects) and a network of such objects (multinets). The main contribution of this paper is a novel application of a factor graph framework to model the interactions in a network of multijects (multinet) at a semantic level. Factor graphs are statistical graphical models that provide an efficient framework for exact and approximate inference via the sum-product algorithm. Incorporating the statistical interactions between the concepts using factor graphs enhances the detection probability of individual multijects and provides a unified framework for integrating multiple modalities and supports inference of unobservable concepts based on their relation with observable concepts. Our experiments reveal significant performance improvement using the inference on the factor graph models.

Original languageEnglish (US)
Title of host publicationProceedings - IEEE Workshop on Content-Based Access of Image and Video Libraries, CBAIVL 2000
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages35-39
Number of pages5
ISBN (Electronic)076950695X, 9780769506951
DOIs
StatePublished - Jan 1 2000
EventIEEE Workshop on Content-Based Access of Image and Video Libraries, CBAIVL 2000 - Hilton Head Island, United States
Duration: Jun 12 2000 → …

Publication series

NameProceedings - IEEE Workshop on Content-Based Access of Image and Video Libraries, CBAIVL 2000

Other

OtherIEEE Workshop on Content-Based Access of Image and Video Libraries, CBAIVL 2000
CountryUnited States
CityHilton Head Island
Period6/12/00 → …

ASJC Scopus subject areas

  • Information Systems
  • Media Technology

Fingerprint Dive into the research topics of 'A factor graph framework for semantic indexing and retrieval in video'. Together they form a unique fingerprint.

  • Cite this

    Naphade, M., Kozintsev, I., Huang, T. S., & Ramchandran, K. (2000). A factor graph framework for semantic indexing and retrieval in video. In Proceedings - IEEE Workshop on Content-Based Access of Image and Video Libraries, CBAIVL 2000 (pp. 35-39). [853836] (Proceedings - IEEE Workshop on Content-Based Access of Image and Video Libraries, CBAIVL 2000). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/IVL.2000.853836