Reinforced similarity integration in image-rich information networks

Xin Jin, Jiebo Luo, Jie Yu, Gang Wang, Dhiraj Joshi, Jiawei Han

Research output: Contribution to journalArticlepeer-review


Social multimedia sharing and hosting websites, such as Flickr and Facebook, contain billions of user-submitted images. Popular Internet commerce websites such as are also furnished with tremendous amounts of product-related images. In addition, images in such social networks are also accompanied by annotations, comments, and other information, thus forming heterogeneous image-rich information networks. In this paper, we introduce the concept of (heterogeneous) image-rich information network and the problem of how to perform information retrieval and recommendation in such networks. We propose a fast algorithm heterogeneous minimum order k-SimRank (HMok-SimRank) to compute link-based similarity in weighted heterogeneous information networks. Then, we propose an algorithm Integrated Weighted Similarity Learning (IWSL) to account for both link-based and content-based similarities by considering the network structure and mutually reinforcing link similarity and feature weight learning. Both local and global feature learning methods are designed. Experimental results on Flickr and Amazon data sets show that our approach is significantly better than traditional methods in terms of both relevance and speed. A new product search and recommendation system for e-commerce has been implemented based on our algorithm.

Original languageEnglish (US)
Article number6081863
Pages (from-to)448-460
Number of pages13
JournalIEEE Transactions on Knowledge and Data Engineering
Issue number2
StatePublished - 2013


  • Information retrieval
  • image mining
  • information network
  • ranking

ASJC Scopus subject areas

  • Information Systems
  • Computer Science Applications
  • Computational Theory and Mathematics


Dive into the research topics of 'Reinforced similarity integration in image-rich information networks'. Together they form a unique fingerprint.

Cite this