Satellites in our pockets: An object positioning system using smartphones

Justin Gregory Manweiler, Puneet Jain, Romit Roy Choudhury

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

This paper attempts to solve the following problem: can a distant object be localized by looking at it through a smartphone. As an example use-case, while driving on a highway entering New York, we want to look at one of the skyscrapers through the smartphone camera, and compute its GPS location. While the problem would have been far more difficult five years back, the growing number of sensors on smartphones, combined with advances in computer vision, have opened up important opportunities. We harness these opportunities through a system called Object Positioning System (OPS) that achieves reasonable localization accuracy. Our core technique uses computer vision to create an approximate 3D structure of the object and camera, and applies mobile phone sensors to scale and rotate the structure to its absolute configuration. Then, by solving (nonlinear) optimizations on the residual (scaling and rotation) error, we ultimately estimate the object's GPS position. We have developed OPS on Android NexusS phones and experimented with localizing 50 objects in the Duke University campus. We believe that OPS shows promising results, enabling a variety of applications. Our ongoing work is focused on coping with large GPS errors, which proves to be the prime limitation of the current prototype.

Original languageEnglish (US)
Title of host publicationMobiSys'12 - Proceedings of the 10th International Conference on Mobile Systems, Applications, and Services
Pages211-224
Number of pages14
DOIs
StatePublished - 2012
Externally publishedYes
Event10th International Conference on Mobile Systems, Applications, and Services, MobiSys'12 - Low Wood Bay, Lake District, United Kingdom
Duration: Jun 25 2012Jun 29 2012

Publication series

NameMobiSys'12 - Proceedings of the 10th International Conference on Mobile Systems, Applications, and Services

Other

Other10th International Conference on Mobile Systems, Applications, and Services, MobiSys'12
Country/TerritoryUnited Kingdom
CityLow Wood Bay, Lake District
Period6/25/126/29/12

Keywords

  • augmented reality
  • localization
  • structure from motion

ASJC Scopus subject areas

  • Computer Networks and Communications
  • Computer Science Applications

Fingerprint

Dive into the research topics of 'Satellites in our pockets: An object positioning system using smartphones'. Together they form a unique fingerprint.

Cite this