Visual estimation and compression of facial motion Parameters - Elements of a 3D model-based video coding system

Hai Tao, Thomas S. Huang

Research output: Contribution to journalArticlepeer-review

Abstract

The MPEG4 standard supports the transmission and composition of facial animation with natural video by including a facial animation parameter (FAP) set that is defined based on the study of minimal facial actions and is closely related to muscle actions. The FAP set enables model-based representation of natural or synthetic talking head sequences and allows intelligible visual reproduction of facial expressions, emotions, and speech pronunciations at the receiver. This paper describes two key components we have developed for building a model-based video coding system: (1) a method for estimating FAP parameters based on our previously proposed piecewise Bézier volume deformation model (PBVD), and (2) various methods for encoding FAP parameters. PBVD is a linear deformation model suitable for both the synthesis and the analysis of facial images. Each FAP parameter is a basis function in this model. Experimental results on PBVD-based animation, model-based tracking, and spatial-temporal compression of FAP parameters are demonstrated in this paper.

Original languageEnglish (US)
Article number5097827
Pages (from-to)111-125
Number of pages15
JournalInternational Journal of Computer Vision
Volume50
Issue number2
DOIs
StatePublished - Jan 1 2002

Keywords

  • Facial animation
  • MPEG4
  • Model-based coding
  • Nonrigid motion analysis

ASJC Scopus subject areas

  • Software
  • Computer Vision and Pattern Recognition
  • Artificial Intelligence

Fingerprint Dive into the research topics of 'Visual estimation and compression of facial motion Parameters - Elements of a 3D model-based video coding system'. Together they form a unique fingerprint.

Cite this