VizWiz::LocateIt - Enabling blind people to locate objects in their environment

Jeffrey P. Bigham, Chandrika Jayant, Andrew Edmund Miller, Brandyn White, Tom Yeh

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Blind people face a number of challenges when interacting with their environments because so much information is encoded visually. Text is pervasively used to label objects, colors carry special significance, and items can easily become lost in surroundings that cannot be quickly scanned. Many tools seek to help blind people solve these problems by enabling them to query for additional information, such as color or text shown on the object. In this paper we argue that many useful problems may be better solved by direclty modeling them as search problems, and present a solution called VizWiz::LocateIt that directly supports this type of interaction.VizWiz::LocateIt enables blind people to take a picture and ask for assistance in finding a specific object. The request is first forwarded to remote workers who outline the object, enabling efficient and accurate automatic computer vision to guide users interactively from their existing cellphones. A two-stage algorithm is presented that uses this information to guide users to the appropriate object interactively from their phone.

Original languageEnglish (US)
Title of host publication2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Workshops, CVPRW 2010
Pages65-72
Number of pages8
DOIs
StatePublished - Sep 17 2010
Externally publishedYes
Event2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Workshops, CVPRW 2010 - San Francisco, CA, United States
Duration: Jun 13 2010Jun 18 2010

Publication series

Name2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Workshops, CVPRW 2010

Other

Other2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Workshops, CVPRW 2010
CountryUnited States
CitySan Francisco, CA
Period6/13/106/18/10

ASJC Scopus subject areas

  • Computer Vision and Pattern Recognition
  • Electrical and Electronic Engineering

Fingerprint Dive into the research topics of 'VizWiz::LocateIt - Enabling blind people to locate objects in their environment'. Together they form a unique fingerprint.

  • Cite this

    Bigham, J. P., Jayant, C., Miller, A. E., White, B., & Yeh, T. (2010). VizWiz::LocateIt - Enabling blind people to locate objects in their environment. In 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Workshops, CVPRW 2010 (pp. 65-72). [5543821] (2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Workshops, CVPRW 2010). https://doi.org/10.1109/CVPRW.2010.5543821