Deep semi-supervised metric learning via identification of manifold memberships

Furen Zhuang, Pierre Moulin

Research output: Contribution to journalConference articlepeer-review


Three of the key challenges in semi-supervised metric learning are the difficulty in sampling loss-producing triplets, the difficulty in locating similar data which are faraway from the anchor points, and the difficulty in making the model robust to noisy predicted pseudolabels. We propose a method which allows the use of class-representative anchors (proxies), and avoids the computational costs associated with triplet sampling. Our new semi-supervised metric learning method propagates labels along mutual nearest neighbor pairs, so that faraway similar data can be drawn to the anchors, while data which are not along these paths (and hence not on the same manifold as the anchors) can be pushed away from these anchors. By assessing the number of different labels which were propagated to the same point, we obtain an estimate of the probability that our prediction of the pseudolabel is accurate, and hence able to attenuate the effect of uncertain pseudolabels on our model by factoring in the confidence of these predictions. We show the superiority of our method over various state-of-the-art methods on four diverse public datasets.

Original languageEnglish (US)
Pages (from-to)1755-1759
Number of pages5
JournalICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings
StatePublished - 2021
Event2021 IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP 2021 - Virtual, Toronto, Canada
Duration: Jun 6 2021Jun 11 2021


  • Image
  • Metric
  • Retrieval
  • Semi-supervised
  • Zeroshot

ASJC Scopus subject areas

  • Software
  • Signal Processing
  • Electrical and Electronic Engineering

Cite this