Visual face tracking and its application to 3D model-based video coding

Thomas S. Huang, Hai Tao

Research output: Contribution to conferencePaperpeer-review


The MPEG4 standard supports the transmission and composition of facial animation with natural video by including a facial animation parameter (FAP) set that is defined based on the study of minimal facial actions and is closely related to muscle actions. The FAP set enables model-based representation of natural or synthetic talking head sequences and allows intelligible visual reproduction of facial expressions, emotions, and speech pronunciations at the receiver. This paper describes two key components we have developed for building a model-based video coding system: (1) a method for estimating FAP parameters based on our previously proposed piecewise Bézier volume deformation model (PBVD), and (2) various methods for encoding FAP parameters. PBVD is a linear deformation model suitable for both the synthesis and the analysis of facial images. Each FAP parameter is a basis function in this model Experimental results on PBVD-based animation, model-based tracking, and spatial-temporal compression of FAP parameters are shown in this paper.

Original languageEnglish (US)
Number of pages4
StatePublished - 2001
EventProceedings of the 22nd Picture Coding Symposium: PCS-2001 - Seoul, Korea, Republic of
Duration: Apr 25 2001Apr 27 2001


OtherProceedings of the 22nd Picture Coding Symposium: PCS-2001
Country/TerritoryKorea, Republic of

ASJC Scopus subject areas

  • General Engineering


Dive into the research topics of 'Visual face tracking and its application to 3D model-based video coding'. Together they form a unique fingerprint.

Cite this