Real-time 3D face verification with a consumer depth camera

Gregory Meyer, Minh Do

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

We present a system for accurate real-time 3D face verification using a low-quality consumer depth camera. To verify the identity of a subject, we built a high-quality reference model offline by fitting a 3D morphable model to a sequence of low-quality depth images. At runtime, we compare the similarity between the reference model and a single depth image by aligning the model to the image and measuring differences between every point on the two facial surfaces. The model and the image will not match exactly due to sensor noise, occlusions, as well as changes in expression, hairstyle, and eye-wear; therefore, we leverage a data driven approach to determine whether or not the model and the image match. We train a random decision forest to verify the identity of a subject where the point-to-point distances between the reference model and the depth image are used as input features to the classifier. Our approach runs in real-time and is designed to continuously authenticate a user as he/she uses his/her device. In addition, our proposed method outperforms existing 2D and 3D face verification methods on a benchmark data set.

Original languageEnglish (US)
Title of host publicationProceedings - 2018 15th Conference on Computer and Robot Vision, CRV 2018
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages71-79
Number of pages9
ISBN (Electronic)9781538664810
DOIs
StatePublished - Dec 13 2018
Event15th Conference on Computer and Robot Vision, CRV 2018 - Toronto, Canada
Duration: May 9 2018May 11 2018

Publication series

NameProceedings - 2018 15th Conference on Computer and Robot Vision, CRV 2018

Conference

Conference15th Conference on Computer and Robot Vision, CRV 2018
CountryCanada
CityToronto
Period5/9/185/11/18

Keywords

  • 3D Computer Vision
  • Depth Cameras
  • Face Recognition
  • Face Verification

ASJC Scopus subject areas

  • Artificial Intelligence
  • Computer Vision and Pattern Recognition

Fingerprint Dive into the research topics of 'Real-time 3D face verification with a consumer depth camera'. Together they form a unique fingerprint.

  • Cite this

    Meyer, G., & Do, M. (2018). Real-time 3D face verification with a consumer depth camera. In Proceedings - 2018 15th Conference on Computer and Robot Vision, CRV 2018 (pp. 71-79). [8575738] (Proceedings - 2018 15th Conference on Computer and Robot Vision, CRV 2018). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/CRV.2018.00020