Visualization and User-Modeling for Browsing Personal Photo Libraries

Baback Moghaddam, Qi Tian, Neal Lesh, Chia Shen, Thomas S. Huang

Research output: Contribution to journalArticlepeer-review

Abstract

We present a user-centric system for visualization and layout for content-based image retrieval. Image features (visual and/or semantic) are used to display retrievals as thumbnails in a 2-D spatial layout or "configuration" which conveys all pair-wise mutual similarities. A graphical optimization technique is used to provide maximally uncluttered and informative layouts. Moreover, a novel subspace feature weighting technique can be used to modify 2-D layouts in a variety of context-dependent ways. An efficient computational technique for subspace weighting and re-estimation leads to a simple user-modeling framework whereby the system can learn to display query results based on layout examples (or relevance feedback) provided by the user. The resulting retrieval, browsing and visualization can adapt to the user's (time-varying) notions of content, context and preferences in style and interactive navigation. Monte Carlo simulations with machine-generated layouts as well as pilot user studies have demonstrated the ability of this framework to model or "mimic" users, by automatically generating layouts according to their preferences.

Original languageEnglish (US)
Pages (from-to)109-130
Number of pages22
JournalInternational Journal of Computer Vision
Volume56
Issue number1-2
DOIs
StatePublished - Jan 1 2004

Keywords

  • CBIR
  • Estimation
  • PCA
  • Subspace analysis
  • Visualization

ASJC Scopus subject areas

  • Software
  • Computer Vision and Pattern Recognition
  • Artificial Intelligence

Fingerprint Dive into the research topics of 'Visualization and User-Modeling for Browsing Personal Photo Libraries'. Together they form a unique fingerprint.

Cite this