MPEG4 performance-driven avatar via robust facial motion tracking

Hao Tang, Thomas S Huang

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

In this paper, an MPEG4 real-time performance-driven avatar is proposed. The facial motion parameters, namely head rotation angles and translation distances as well as a set of action unit weights, are estimated from live video on a per-frame basis using a two-step robust facial motion tracking algorithm. The estimated parameters are then converted into MPEG4 facial animation parameter (FAP) values by solving an overdetermined constrained linear least-squares optimization problem. These FAP values can be used to drive an MPEG4-compliant face model to generate on-the-fly realistic facial animation that resembles the facial actions of the performer in the video. Such a real-time performance-driven avatar has important applications in a broad range of areas including very low bit rate video communication, movie and game industries as well as human-computer intelligent interaction.

Original languageEnglish (US)
Title of host publication2008 IEEE International Conference on Image Processing, ICIP 2008 Proceedings
Pages249-252
Number of pages4
DOIs
StatePublished - Dec 1 2008
Event2008 IEEE International Conference on Image Processing, ICIP 2008 - San Diego, CA, United States
Duration: Oct 12 2008Oct 15 2008

Publication series

NameProceedings - International Conference on Image Processing, ICIP
ISSN (Print)1522-4880

Other

Other2008 IEEE International Conference on Image Processing, ICIP 2008
CountryUnited States
CitySan Diego, CA
Period10/12/0810/15/08

Keywords

  • Avatar
  • Facial animation
  • Facial motion tracking
  • MPEG4
  • Performance-driven

ASJC Scopus subject areas

  • Software
  • Computer Vision and Pattern Recognition
  • Signal Processing

Fingerprint Dive into the research topics of 'MPEG4 performance-driven avatar via robust facial motion tracking'. Together they form a unique fingerprint.

Cite this