Real-time 3D face verification with a consumer depth camera

Gregory Meyer, Minh N Do

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

We present a system for accurate real-time 3D face verification using a low-quality consumer depth camera. To verify the identity of a subject, we built a high-quality reference model offline by fitting a 3D morphable model to a sequence of low-quality depth images. At runtime, we compare the similarity between the reference model and a single depth image by aligning the model to the image and measuring differences between every point on the two facial surfaces. The model and the image will not match exactly due to sensor noise, occlusions, as well as changes in expression, hairstyle, and eye-wear; therefore, we leverage a data driven approach to determine whether or not the model and the image match. We train a random decision forest to verify the identity of a subject where the point-to-point distances between the reference model and the depth image are used as input features to the classifier. Our approach runs in real-time and is designed to continuously authenticate a user as he/she uses his/her device. In addition, our proposed method outperforms existing 2D and 3D face verification methods on a benchmark data set.

Original languageEnglish (US)
Title of host publicationProceedings - 2018 15th Conference on Computer and Robot Vision, CRV 2018
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages71-79
Number of pages9
ISBN (Electronic)9781538664810
DOIs
StatePublished - Dec 13 2018
Event15th Conference on Computer and Robot Vision, CRV 2018 - Toronto, Canada
Duration: May 9 2018May 11 2018

Publication series

NameProceedings - 2018 15th Conference on Computer and Robot Vision, CRV 2018

Conference

Conference15th Conference on Computer and Robot Vision, CRV 2018
CountryCanada
CityToronto
Period5/9/185/11/18

Fingerprint

Cameras
Classifiers
Wear of materials
Sensors

Keywords

  • 3D Computer Vision
  • Depth Cameras
  • Face Recognition
  • Face Verification

ASJC Scopus subject areas

  • Artificial Intelligence
  • Computer Vision and Pattern Recognition

Cite this

Meyer, G., & Do, M. N. (2018). Real-time 3D face verification with a consumer depth camera. In Proceedings - 2018 15th Conference on Computer and Robot Vision, CRV 2018 (pp. 71-79). [8575738] (Proceedings - 2018 15th Conference on Computer and Robot Vision, CRV 2018). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/CRV.2018.00020

Real-time 3D face verification with a consumer depth camera. / Meyer, Gregory; Do, Minh N.

Proceedings - 2018 15th Conference on Computer and Robot Vision, CRV 2018. Institute of Electrical and Electronics Engineers Inc., 2018. p. 71-79 8575738 (Proceedings - 2018 15th Conference on Computer and Robot Vision, CRV 2018).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Meyer, G & Do, MN 2018, Real-time 3D face verification with a consumer depth camera. in Proceedings - 2018 15th Conference on Computer and Robot Vision, CRV 2018., 8575738, Proceedings - 2018 15th Conference on Computer and Robot Vision, CRV 2018, Institute of Electrical and Electronics Engineers Inc., pp. 71-79, 15th Conference on Computer and Robot Vision, CRV 2018, Toronto, Canada, 5/9/18. https://doi.org/10.1109/CRV.2018.00020
Meyer G, Do MN. Real-time 3D face verification with a consumer depth camera. In Proceedings - 2018 15th Conference on Computer and Robot Vision, CRV 2018. Institute of Electrical and Electronics Engineers Inc. 2018. p. 71-79. 8575738. (Proceedings - 2018 15th Conference on Computer and Robot Vision, CRV 2018). https://doi.org/10.1109/CRV.2018.00020
Meyer, Gregory ; Do, Minh N. / Real-time 3D face verification with a consumer depth camera. Proceedings - 2018 15th Conference on Computer and Robot Vision, CRV 2018. Institute of Electrical and Electronics Engineers Inc., 2018. pp. 71-79 (Proceedings - 2018 15th Conference on Computer and Robot Vision, CRV 2018).
@inproceedings{6332e461f2814a2aba0a097e9d1a1349,
title = "Real-time 3D face verification with a consumer depth camera",
abstract = "We present a system for accurate real-time 3D face verification using a low-quality consumer depth camera. To verify the identity of a subject, we built a high-quality reference model offline by fitting a 3D morphable model to a sequence of low-quality depth images. At runtime, we compare the similarity between the reference model and a single depth image by aligning the model to the image and measuring differences between every point on the two facial surfaces. The model and the image will not match exactly due to sensor noise, occlusions, as well as changes in expression, hairstyle, and eye-wear; therefore, we leverage a data driven approach to determine whether or not the model and the image match. We train a random decision forest to verify the identity of a subject where the point-to-point distances between the reference model and the depth image are used as input features to the classifier. Our approach runs in real-time and is designed to continuously authenticate a user as he/she uses his/her device. In addition, our proposed method outperforms existing 2D and 3D face verification methods on a benchmark data set.",
keywords = "3D Computer Vision, Depth Cameras, Face Recognition, Face Verification",
author = "Gregory Meyer and Do, {Minh N}",
year = "2018",
month = "12",
day = "13",
doi = "10.1109/CRV.2018.00020",
language = "English (US)",
series = "Proceedings - 2018 15th Conference on Computer and Robot Vision, CRV 2018",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
pages = "71--79",
booktitle = "Proceedings - 2018 15th Conference on Computer and Robot Vision, CRV 2018",
address = "United States",

}

TY - GEN

T1 - Real-time 3D face verification with a consumer depth camera

AU - Meyer, Gregory

AU - Do, Minh N

PY - 2018/12/13

Y1 - 2018/12/13

N2 - We present a system for accurate real-time 3D face verification using a low-quality consumer depth camera. To verify the identity of a subject, we built a high-quality reference model offline by fitting a 3D morphable model to a sequence of low-quality depth images. At runtime, we compare the similarity between the reference model and a single depth image by aligning the model to the image and measuring differences between every point on the two facial surfaces. The model and the image will not match exactly due to sensor noise, occlusions, as well as changes in expression, hairstyle, and eye-wear; therefore, we leverage a data driven approach to determine whether or not the model and the image match. We train a random decision forest to verify the identity of a subject where the point-to-point distances between the reference model and the depth image are used as input features to the classifier. Our approach runs in real-time and is designed to continuously authenticate a user as he/she uses his/her device. In addition, our proposed method outperforms existing 2D and 3D face verification methods on a benchmark data set.

AB - We present a system for accurate real-time 3D face verification using a low-quality consumer depth camera. To verify the identity of a subject, we built a high-quality reference model offline by fitting a 3D morphable model to a sequence of low-quality depth images. At runtime, we compare the similarity between the reference model and a single depth image by aligning the model to the image and measuring differences between every point on the two facial surfaces. The model and the image will not match exactly due to sensor noise, occlusions, as well as changes in expression, hairstyle, and eye-wear; therefore, we leverage a data driven approach to determine whether or not the model and the image match. We train a random decision forest to verify the identity of a subject where the point-to-point distances between the reference model and the depth image are used as input features to the classifier. Our approach runs in real-time and is designed to continuously authenticate a user as he/she uses his/her device. In addition, our proposed method outperforms existing 2D and 3D face verification methods on a benchmark data set.

KW - 3D Computer Vision

KW - Depth Cameras

KW - Face Recognition

KW - Face Verification

UR - http://www.scopus.com/inward/record.url?scp=85060520302&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85060520302&partnerID=8YFLogxK

U2 - 10.1109/CRV.2018.00020

DO - 10.1109/CRV.2018.00020

M3 - Conference contribution

AN - SCOPUS:85060520302

T3 - Proceedings - 2018 15th Conference on Computer and Robot Vision, CRV 2018

SP - 71

EP - 79

BT - Proceedings - 2018 15th Conference on Computer and Robot Vision, CRV 2018

PB - Institute of Electrical and Electronics Engineers Inc.

ER -