Assisting the visually impaired using depth inference on mobile devices via stereo matching

Benjamin Chidester, Minh Do

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

A novel system for assisting the visually impaired, built upon the platform of a mobile device, is proposed. The system uses depth inference and a depth-to-sound mapping to inform the user of the surroundings via sound. Stereo matching is proposed as the appropriate tool for depth inference, and stereo matching approaches are assessed for their potential for real-time performance on a mobile device and their inference quality. A novel depth-to-sound mapping is proposed that can be adjusted by the user through the touch interface of the mobile device. This mapping allows the user to define the field of view and the location of inference. A smart phone 'app' and demo will be produced. The system demonstrates the viability and great benefit of depth inference on mobile devices for assisting the visually impaired.

Original languageEnglish (US)
Title of host publicationElectronic Proceedings of the 2013 IEEE International Conference on Multimedia and Expo Workshops, ICMEW 2013
DOIs
StatePublished - 2013
Event2013 IEEE International Conference on Multimedia and Expo Workshops, ICMEW 2013 - San Jose, CA, United States
Duration: Jul 15 2013Jul 19 2013

Publication series

NameElectronic Proceedings of the 2013 IEEE International Conference on Multimedia and Expo Workshops, ICMEW 2013

Other

Other2013 IEEE International Conference on Multimedia and Expo Workshops, ICMEW 2013
Country/TerritoryUnited States
CitySan Jose, CA
Period7/15/137/19/13

Keywords

  • mobile devices
  • sonification
  • stereo matching
  • Visually impaired assistance

ASJC Scopus subject areas

  • Computer Graphics and Computer-Aided Design
  • Computer Vision and Pattern Recognition

Fingerprint

Dive into the research topics of 'Assisting the visually impaired using depth inference on mobile devices via stereo matching'. Together they form a unique fingerprint.

Cite this