Scalable image-based search-and-discovery

Eunji Chong, Matthew K. Hong, Jaehoon Lee, James M. Rehg

Research output: Chapter in Book/Report/Conference proceedingConference contribution


People use online search-and-discovery services, such as Yelp, by first finding a specific item with keywords and then examining the images linked to the item. Images could constitute an important part of users' decision-making process but users reach them indirectly. Although recently researchers proposed several image-based search interfaces, how they can effectively arrange huge number of images in a scalable manner is still not clear. To address this, we introduce PicNav, an image-driven navigation system that automatically arranges photos according to their semantic similarity. PicNav is built on deep neural networks learned from the Yelp food dataset and enables effective zoomin/out features. We conducted interviews with ten users to qualitatively assess the system's usability. The users identified a number of advantages of PicNav, providing insights into the general use of imagery in search-and-discovery services.

Original languageEnglish (US)
Title of host publicationCHI 2017 Extended Abstracts - Proceedings of the 2017 ACM SIGCHI Conference on Human Factors in Computing Systems
Subtitle of host publicationExplore, Innovate, Inspire
PublisherAssociation for Computing Machinery,
Number of pages7
ISBN (Electronic)9781450346566
StatePublished - May 6 2017
Externally publishedYes
Event2017 ACM SIGCHI Conference on Human Factors in Computing Systems, CHI EA 2017 - Denver, United States
Duration: May 6 2017May 11 2017

Publication series

NameConference on Human Factors in Computing Systems - Proceedings
VolumePart F127655


Conference2017 ACM SIGCHI Conference on Human Factors in Computing Systems, CHI EA 2017
Country/TerritoryUnited States


  • Deep learning
  • Exploratory search
  • Image-based search
  • Scalable system

ASJC Scopus subject areas

  • Software
  • Human-Computer Interaction
  • Computer Graphics and Computer-Aided Design


Dive into the research topics of 'Scalable image-based search-and-discovery'. Together they form a unique fingerprint.

Cite this