Locally adaptive subspace and similarity metric learning for visual data clustering and retrieval

Yun Fu, Zhu Li, Thomas S. Huang, Aggelos K. Katsaggelos

Research output: Contribution to journalArticlepeer-review


Subspace and similarity metric learning are important issues for image and video analysis in the scenarios of both computer vision and multimedia fields. Many real-world applications, such as image clustering/labeling and video indexing/retrieval, involve feature space dimensionality reduction as well as feature matching metric learning. However, the loss of information from dimensionality reduction may degrade the accuracy of similarity matching. In practice, such basic conflicting requirements for both feature representation efficiency and similarity matching accuracy need to be appropriately addressed. In the style of "Thinking Globally and Fitting Locally", we develop Locally Embedded Analysis (LEA) based solutions for visual data clustering and retrieval. LEA reveals the essential low-dimensional manifold structure of the data by preserving the local nearest neighbor affinity, and allowing a linear subspace embedding through solving a graph embedded eigenvalue decomposition problem. A visual data clustering algorithm, called Locally Embedded Clustering (LEC), and a local similarity metric learning algorithm for robust video retrieval, called Locally Adaptive Retrieval (LAR), are both designed upon the LEA approach, with variations in local affinity graph modeling. For large size database applications, instead of learning a global metric, we localize the metric learning space with kd-tree partition to localities identified by the indexing process. Simulation results demonstrate the effective performance of proposed solutions in both accuracy and speed aspects.

Original languageEnglish (US)
Pages (from-to)390-402
Number of pages13
JournalComputer Vision and Image Understanding
Issue number3
StatePublished - Jun 2008
Externally publishedYes


  • Dimensionality reduction
  • Image and video retrieval
  • Locally adaptive retrieval
  • Locally embedded analysis
  • Locally embedded clustering
  • Manifold
  • Similarity matching
  • Subspace learning
  • Visual clustering

ASJC Scopus subject areas

  • Software
  • Signal Processing
  • Computer Vision and Pattern Recognition


Dive into the research topics of 'Locally adaptive subspace and similarity metric learning for visual data clustering and retrieval'. Together they form a unique fingerprint.

Cite this