Using mobile phones to write in air

Sandip Agrawal, Ionut Constandache, Shravan Gaonkar, Romit Roy Choudhury, Kevin Caves, Frank DeRuyter

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Numerous sensors in modern mobile phones enable a range of people-centric applications. This paper envisions a system called PhonePoint Pen that uses the in-built accelerometer in mobile phones to recognize human writing. By holding the phone like a pen, a user should be able to write short messages or draw simple diagrams in the air. The acceleration due to hand gestures can be translated into geometric strokes, and recognized as characters. We prototype the PhonePoint Pen on the Nokia N95 platform, and evaluate it through real users. Results show that English characters can be identified with an average accuracy of 91.9%, if the users conform to a few reasonable constraints. Future work is focused on refining the prototype, with the goal of offering a new user-experience that complements keyboards and touch-screens.

Original languageEnglish (US)
Title of host publicationMobiSys'11 - Compilation Proceedings of the 9th International Conference on Mobile Systems, Applications, and Services and Co-located Workshops
Pages15-28
Number of pages14
DOIs
StatePublished - Aug 8 2011
Externally publishedYes
Event9th International Conference on Mobile Systems, Applications, and Services, MobiSys'11 and Co-located Workshops - Bethesda, MD, United States
Duration: Jun 28 2011Jul 1 2011

Publication series

NameMobiSys'11 - Compilation Proceedings of the 9th International Conference on Mobile Systems, Applications and Services and Co-located Workshops

Other

Other9th International Conference on Mobile Systems, Applications, and Services, MobiSys'11 and Co-located Workshops
Country/TerritoryUnited States
CityBethesda, MD
Period6/28/117/1/11

Keywords

  • accelerometers
  • activity recognition
  • gestures
  • smartphones

ASJC Scopus subject areas

  • Computer Networks and Communications
  • Computer Science Applications
  • Communication

Fingerprint

Dive into the research topics of 'Using mobile phones to write in air'. Together they form a unique fingerprint.

Cite this