Visually fingerprinting humans without face recognition

He Wang, Xuan Bao, Romit Roy Choudhury, Srihari Nelakuditi

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

This paper develops techniques using which humans can be visually recognized. While face recognition would be one approach to this problem, we believe that it may not be always possible to see a person's face. Our technique is complementary to face recognition, and exploits the intuition that human motion patterns and clothing colors can together encode several bits of information. Treating this information as a "temporary fingerprint", it may be feasible to recognize an individual with reasonable consistency, while allowing her to turn off the fingerprint at will. One application of visual fingerprints relates to augmented reality, in which an individual looks at other people through her camera-enabled glass (e.g., Google Glass) and views information about them. Another application is in privacy-preserving pictures - Alice should be able to broadcast her "temporary fingerprint" to all cameras in the vicinity along with a privacy preference, saying "remove me". If a stranger's video happens to include Alice, the device can recognize her fingerprint in the video and erase her completely. This paper develops the core visual fingerprinting engine - InSight - on the platform of Android smartphones and a backend server running MATLAB and OpenCV. Results from real world experiments show that 12 individuals can be discriminated with 90% accuracy using 6 seconds of video/motion observations. Video based emulation confirms scalability up to 40 users.

Original languageEnglish (US)
Title of host publicationMobiSys 2015 - Proceedings of the 13th Annual International Conference on Mobile Systems, Applications, and Services
PublisherAssociation for Computing Machinery, Inc
Pages345-358
Number of pages14
ISBN (Electronic)9781450334945
DOIs
StatePublished - May 18 2015
Event13th Annual International Conference on Mobile Systems, Applications, and Services, MobiSys 2015 - Florence, Italy
Duration: May 18 2015May 22 2015

Publication series

NameMobiSys 2015 - Proceedings of the 13th Annual International Conference on Mobile Systems, Applications, and Services

Other

Other13th Annual International Conference on Mobile Systems, Applications, and Services, MobiSys 2015
CountryItaly
CityFlorence
Period5/18/155/22/15

Keywords

  • Augmented reality
  • Matching
  • Smartphones
  • Visual fingerprinting

ASJC Scopus subject areas

  • Electrical and Electronic Engineering
  • Computer Networks and Communications
  • Computer Science Applications

Fingerprint Dive into the research topics of 'Visually fingerprinting humans without face recognition'. Together they form a unique fingerprint.

Cite this