Capturing subtle facial motions in 3D face tracking

Zhen Wen, Thomas S Huang

Research output: Contribution to conferencePaper

Abstract

Facial motions produce not only facial feature points motions, but also subtle appearance changes such as wrinkles and shading changes. These subtle changes are important yet difficult issues for both analysis (tracking) and synthesis (animation). Previous approaches were mostly based on models learned from extensive training appearance examples. However, the space of all possible facial motion appearance is huge. Thus, it is not feasible to collect samples covering all possible variations due to lighting conditions, individualities, and head poses. Therefore, it is difficult to adapt such models to new conditions. In this paper, we present an adaptive technique for analyzing subtle facial appearance changes. We propose a new ratio-image based appearance feature, which is independent of a person's face albedo. This feature is used to track face appearance variations based on exemplars. To adapt the exemplar appearance model to new people and lighting conditions, we develop an online EM-based algorithm. Experiments show that the proposed method improves classification results in a facial expression recognition task, where a variety of people and lighting conditions are involved.

Original languageEnglish (US)
Pages1343-1350
Number of pages8
StatePublished - Dec 2 2003
EventNINTH IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION - Nice, France
Duration: Oct 13 2003Oct 16 2003

Other

OtherNINTH IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION
CountryFrance
CityNice
Period10/13/0310/16/03

ASJC Scopus subject areas

  • Software
  • Computer Vision and Pattern Recognition

Fingerprint Dive into the research topics of 'Capturing subtle facial motions in 3D face tracking'. Together they form a unique fingerprint.

  • Cite this

    Wen, Z., & Huang, T. S. (2003). Capturing subtle facial motions in 3D face tracking. 1343-1350. Paper presented at NINTH IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION, Nice, France.