Assisting the visually impaired using depth inference on mobile devices via stereo matching

Benjamin Chidester, Minh N Do

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

A novel system for assisting the visually impaired, built upon the platform of a mobile device, is proposed. The system uses depth inference and a depth-to-sound mapping to inform the user of the surroundings via sound. Stereo matching is proposed as the appropriate tool for depth inference, and stereo matching approaches are assessed for their potential for real-time performance on a mobile device and their inference quality. A novel depth-to-sound mapping is proposed that can be adjusted by the user through the touch interface of the mobile device. This mapping allows the user to define the field of view and the location of inference. A smart phone 'app' and demo will be produced. The system demonstrates the viability and great benefit of depth inference on mobile devices for assisting the visually impaired.

Original languageEnglish (US)
Title of host publicationElectronic Proceedings of the 2013 IEEE International Conference on Multimedia and Expo Workshops, ICMEW 2013
DOIs
StatePublished - Nov 29 2013
Event2013 IEEE International Conference on Multimedia and Expo Workshops, ICMEW 2013 - San Jose, CA, United States
Duration: Jul 15 2013Jul 19 2013

Publication series

NameElectronic Proceedings of the 2013 IEEE International Conference on Multimedia and Expo Workshops, ICMEW 2013

Other

Other2013 IEEE International Conference on Multimedia and Expo Workshops, ICMEW 2013
CountryUnited States
CitySan Jose, CA
Period7/15/137/19/13

Fingerprint

Mobile devices
Acoustic waves
Application programs

Keywords

  • mobile devices
  • sonification
  • stereo matching
  • Visually impaired assistance

ASJC Scopus subject areas

  • Computer Graphics and Computer-Aided Design
  • Computer Vision and Pattern Recognition

Cite this

Chidester, B., & Do, M. N. (2013). Assisting the visually impaired using depth inference on mobile devices via stereo matching. In Electronic Proceedings of the 2013 IEEE International Conference on Multimedia and Expo Workshops, ICMEW 2013 [6618381] (Electronic Proceedings of the 2013 IEEE International Conference on Multimedia and Expo Workshops, ICMEW 2013). https://doi.org/10.1109/ICMEW.2013.6618381

Assisting the visually impaired using depth inference on mobile devices via stereo matching. / Chidester, Benjamin; Do, Minh N.

Electronic Proceedings of the 2013 IEEE International Conference on Multimedia and Expo Workshops, ICMEW 2013. 2013. 6618381 (Electronic Proceedings of the 2013 IEEE International Conference on Multimedia and Expo Workshops, ICMEW 2013).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Chidester, B & Do, MN 2013, Assisting the visually impaired using depth inference on mobile devices via stereo matching. in Electronic Proceedings of the 2013 IEEE International Conference on Multimedia and Expo Workshops, ICMEW 2013., 6618381, Electronic Proceedings of the 2013 IEEE International Conference on Multimedia and Expo Workshops, ICMEW 2013, 2013 IEEE International Conference on Multimedia and Expo Workshops, ICMEW 2013, San Jose, CA, United States, 7/15/13. https://doi.org/10.1109/ICMEW.2013.6618381
Chidester B, Do MN. Assisting the visually impaired using depth inference on mobile devices via stereo matching. In Electronic Proceedings of the 2013 IEEE International Conference on Multimedia and Expo Workshops, ICMEW 2013. 2013. 6618381. (Electronic Proceedings of the 2013 IEEE International Conference on Multimedia and Expo Workshops, ICMEW 2013). https://doi.org/10.1109/ICMEW.2013.6618381
Chidester, Benjamin ; Do, Minh N. / Assisting the visually impaired using depth inference on mobile devices via stereo matching. Electronic Proceedings of the 2013 IEEE International Conference on Multimedia and Expo Workshops, ICMEW 2013. 2013. (Electronic Proceedings of the 2013 IEEE International Conference on Multimedia and Expo Workshops, ICMEW 2013).
@inproceedings{7f3bc41326eb49fdaac8d0411ebe85e2,
title = "Assisting the visually impaired using depth inference on mobile devices via stereo matching",
abstract = "A novel system for assisting the visually impaired, built upon the platform of a mobile device, is proposed. The system uses depth inference and a depth-to-sound mapping to inform the user of the surroundings via sound. Stereo matching is proposed as the appropriate tool for depth inference, and stereo matching approaches are assessed for their potential for real-time performance on a mobile device and their inference quality. A novel depth-to-sound mapping is proposed that can be adjusted by the user through the touch interface of the mobile device. This mapping allows the user to define the field of view and the location of inference. A smart phone 'app' and demo will be produced. The system demonstrates the viability and great benefit of depth inference on mobile devices for assisting the visually impaired.",
keywords = "mobile devices, sonification, stereo matching, Visually impaired assistance",
author = "Benjamin Chidester and Do, {Minh N}",
year = "2013",
month = "11",
day = "29",
doi = "10.1109/ICMEW.2013.6618381",
language = "English (US)",
isbn = "9781479916047",
series = "Electronic Proceedings of the 2013 IEEE International Conference on Multimedia and Expo Workshops, ICMEW 2013",
booktitle = "Electronic Proceedings of the 2013 IEEE International Conference on Multimedia and Expo Workshops, ICMEW 2013",

}

TY - GEN

T1 - Assisting the visually impaired using depth inference on mobile devices via stereo matching

AU - Chidester, Benjamin

AU - Do, Minh N

PY - 2013/11/29

Y1 - 2013/11/29

N2 - A novel system for assisting the visually impaired, built upon the platform of a mobile device, is proposed. The system uses depth inference and a depth-to-sound mapping to inform the user of the surroundings via sound. Stereo matching is proposed as the appropriate tool for depth inference, and stereo matching approaches are assessed for their potential for real-time performance on a mobile device and their inference quality. A novel depth-to-sound mapping is proposed that can be adjusted by the user through the touch interface of the mobile device. This mapping allows the user to define the field of view and the location of inference. A smart phone 'app' and demo will be produced. The system demonstrates the viability and great benefit of depth inference on mobile devices for assisting the visually impaired.

AB - A novel system for assisting the visually impaired, built upon the platform of a mobile device, is proposed. The system uses depth inference and a depth-to-sound mapping to inform the user of the surroundings via sound. Stereo matching is proposed as the appropriate tool for depth inference, and stereo matching approaches are assessed for their potential for real-time performance on a mobile device and their inference quality. A novel depth-to-sound mapping is proposed that can be adjusted by the user through the touch interface of the mobile device. This mapping allows the user to define the field of view and the location of inference. A smart phone 'app' and demo will be produced. The system demonstrates the viability and great benefit of depth inference on mobile devices for assisting the visually impaired.

KW - mobile devices

KW - sonification

KW - stereo matching

KW - Visually impaired assistance

UR - http://www.scopus.com/inward/record.url?scp=84888248625&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84888248625&partnerID=8YFLogxK

U2 - 10.1109/ICMEW.2013.6618381

DO - 10.1109/ICMEW.2013.6618381

M3 - Conference contribution

AN - SCOPUS:84888248625

SN - 9781479916047

T3 - Electronic Proceedings of the 2013 IEEE International Conference on Multimedia and Expo Workshops, ICMEW 2013

BT - Electronic Proceedings of the 2013 IEEE International Conference on Multimedia and Expo Workshops, ICMEW 2013

ER -