VizWiz: Nearly real-time answers to visual questions

Jeffrey P. Bigham, Chandrika Jayant, Hanjie Ji, Greg Little, Andrew Miller, Robert C. Miller, Robin Miller, Aubrey Tatarowicz, Brandyn White, Samuel White, Tom Yeh

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

The lack of access to visual information like text labels, icons, and colors can cause frustration and decrease independence for blind people. Current access technology uses automatic approaches to address some problems in this space, but the technology is error-prone, limited in scope, and quite expensive. In this paper, we introduce VizWiz, a talking application for mobile phones that offers a new alternative to answering visual questions in nearly real-time-asking multiple people on the web. To support answering questions quickly, we introduce a general approach for intelligently recruiting human workers in advance called quikTurkit so that workers are available when new questions arrive. A field deployment with 11 blind participants illustrates that blind people can effectively use VizWiz to cheaply answer questions in their everyday lives, highlighting issues that automatic approaches will need to address to be useful. Finally, we illus-trate the potential of using VizWiz as part of the participatory design of advanced tools by using it to build and evaluate VizWiz::LocateIt, an interactive mobile tool that helps blind people solve general visual search problems.

Original languageEnglish (US)
Title of host publicationUIST 2010 - 23rd ACM Symposium on User Interface Software and Technology
Pages333-342
Number of pages10
DOIs
StatePublished - Dec 6 2010
Externally publishedYes
Event23rd Annual ACM Symposium on User Interface Software and Technology, UIST 2010 - New York, NY, United States
Duration: Oct 3 2010Oct 6 2010

Publication series

NameUIST 2010 - 23rd ACM Symposium on User Interface Software and Technology

Other

Other23rd Annual ACM Symposium on User Interface Software and Technology, UIST 2010
CountryUnited States
CityNew York, NY
Period10/3/1010/6/10

Keywords

  • Blind users
  • Non-visual interfaces
  • Real-time human computation

ASJC Scopus subject areas

  • Human-Computer Interaction
  • Software

Fingerprint Dive into the research topics of 'VizWiz: Nearly real-time answers to visual questions'. Together they form a unique fingerprint.

Cite this