Audio Based Handwriting Input for Tiny Mobile Devices

Tuo Yu, Haiming Jin, Klara Nahrstedt

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

The popularization of tiny mobile devices has raised the problem that it is hard to efficiently input messages via tiny keyboards or touch screens. In this paper, we present TableWrite, an audio-based handwriting input scheme, which allows users to input words to mobile devices by writing on tables with fingers. The key feature is that, once trained by a user, TableWrite does not require any retraining phase before each use. To reduce the impacts of audio signal's multipath propagation, we design multiple features that maintain consistency even when writing positions keep changing. We apply machine learning and gesture tracking techniques to further improve the accuracy of handwriting recognition. Our prototype system's experimental results show that the average accuracy of word recognition is around 90%-95% in lab environments, which validates the effectiveness of TableWrite.

Original languageEnglish (US)
Title of host publicationProceedings - IEEE 1st Conference on Multimedia Information Processing and Retrieval, MIPR 2018
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages130-135
Number of pages6
ISBN (Electronic)9781538618578
DOIs
StatePublished - Jun 26 2018
Event1st IEEE Conference on Multimedia Information Processing and Retrieval, MIPR 2018 - Miami, United States
Duration: Apr 10 2018Apr 12 2018

Publication series

NameProceedings - IEEE 1st Conference on Multimedia Information Processing and Retrieval, MIPR 2018

Other

Other1st IEEE Conference on Multimedia Information Processing and Retrieval, MIPR 2018
Country/TerritoryUnited States
CityMiami
Period4/10/184/12/18

Keywords

  • Audio Signals
  • Handwriting Recognition

ASJC Scopus subject areas

  • Computer Networks and Communications
  • Signal Processing
  • Media Technology

Fingerprint

Dive into the research topics of 'Audio Based Handwriting Input for Tiny Mobile Devices'. Together they form a unique fingerprint.

Cite this