OverLay: Practical mobile augmented reality

Puneet Jain, Justin Manweiler, Romit Roy Choudhury

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

The idea of augmented reality - the ability to look at a physical object through a camera and view annotations about the object - is certainly not new. Yet, this apparently feasible vision has not yet materialized into a precise, fast, and comprehensively usable system. This paper asks: What does it take to enable augmented reality (AR) on smartphones today? To build a ready-to-use mobile AR system, we adopt a top-down approach cutting across smartphone sensing, computer vision, cloud offloading, and linear optimization. Our core contribution is in a novel location-free geometric representation of the environment - from smartphone sensors - and using this geometry to prune down the visual search space. Metrics of success include both accuracy and latency of object identification, coupled with the ease of use and scalability in uncontrolled environments. Our converged system, OverLay, is currently deployed in the engineering building and open for use to regular public; ongoing work is focussed on campuswide deployment to serve as a "historical tour guide" of UIUC. Performance results and user responses thus far have been promising, to say the least.

Original languageEnglish (US)
Title of host publicationMobiSys 2015 - Proceedings of the 13th Annual International Conference on Mobile Systems, Applications, and Services
PublisherAssociation for Computing Machinery, Inc
Pages331-344
Number of pages14
ISBN (Electronic)9781450334945
DOIs
StatePublished - May 18 2015
Event13th Annual International Conference on Mobile Systems, Applications, and Services, MobiSys 2015 - Florence, Italy
Duration: May 18 2015May 22 2015

Publication series

NameMobiSys 2015 - Proceedings of the 13th Annual International Conference on Mobile Systems, Applications, and Services

Other

Other13th Annual International Conference on Mobile Systems, Applications, and Services, MobiSys 2015
CountryItaly
CityFlorence
Period5/18/155/22/15

Keywords

  • Augmented Reality
  • Gyroscope
  • Localization
  • Mobile
  • Tagging

ASJC Scopus subject areas

  • Electrical and Electronic Engineering
  • Computer Networks and Communications
  • Computer Science Applications

Fingerprint Dive into the research topics of 'OverLay: Practical mobile augmented reality'. Together they form a unique fingerprint.

  • Cite this

    Jain, P., Manweiler, J., & Roy Choudhury, R. (2015). OverLay: Practical mobile augmented reality. In MobiSys 2015 - Proceedings of the 13th Annual International Conference on Mobile Systems, Applications, and Services (pp. 331-344). (MobiSys 2015 - Proceedings of the 13th Annual International Conference on Mobile Systems, Applications, and Services). Association for Computing Machinery, Inc. https://doi.org/10.1145/2742647.2742666