3D-model-based head tracking

Antonio J. Colmenarez, Ricardo Lopez, Thomas S. Huang

Research output: Contribution to journalConference article

Abstract

This paper introduces a new approach to feature-based head tracking and pose estimation. Head tracking and pose estimation find their most important applications in motion analysis for model-based video coding. The proposed algorithm employs an underlying 3D head model, feature-based pose estimation, and texture mapping to produce accurate templates for the feature tracking. In this way, the set of templates used for the matching is constantly updated with the pose changes, allowing the algorithm to track the features over a large range of head motion without loss of precision and error accumulation. Given a rough estimate of the head scale, the initial feature identification is performed automatically and the tracking is successful over a large number of video frames. Computational complexity is also considered with the aim towards creating a real-time end-to-end model-based video coding system.

Original languageEnglish (US)
Pages (from-to)426-434
Number of pages9
JournalProceedings of SPIE - The International Society for Optical Engineering
Volume3024
DOIs
StatePublished - Dec 1 1997
EventVisual Communications and Image Processing '97 - San Jose, CA, United States
Duration: Feb 12 1997Feb 12 1997

Fingerprint

Pose Estimation
3D Model
Video Coding
Model-based
Image coding
Template
Feature Tracking
Texture Mapping
Motion Analysis
coding
templates
Feature Model
Rough
Computational complexity
Computational Complexity
Textures
Real-time
textures
Motion
Estimate

Keywords

  • Feature extraction
  • Feature tracking
  • Head tracking
  • Model-based coding

ASJC Scopus subject areas

  • Electronic, Optical and Magnetic Materials
  • Condensed Matter Physics
  • Computer Science Applications
  • Applied Mathematics
  • Electrical and Electronic Engineering

Cite this

3D-model-based head tracking. / Colmenarez, Antonio J.; Lopez, Ricardo; Huang, Thomas S.

In: Proceedings of SPIE - The International Society for Optical Engineering, Vol. 3024, 01.12.1997, p. 426-434.

Research output: Contribution to journalConference article

Colmenarez, Antonio J. ; Lopez, Ricardo ; Huang, Thomas S. / 3D-model-based head tracking. In: Proceedings of SPIE - The International Society for Optical Engineering. 1997 ; Vol. 3024. pp. 426-434.
@article{57227174a584477a9d78ecdc7c445cb4,
title = "3D-model-based head tracking",
abstract = "This paper introduces a new approach to feature-based head tracking and pose estimation. Head tracking and pose estimation find their most important applications in motion analysis for model-based video coding. The proposed algorithm employs an underlying 3D head model, feature-based pose estimation, and texture mapping to produce accurate templates for the feature tracking. In this way, the set of templates used for the matching is constantly updated with the pose changes, allowing the algorithm to track the features over a large range of head motion without loss of precision and error accumulation. Given a rough estimate of the head scale, the initial feature identification is performed automatically and the tracking is successful over a large number of video frames. Computational complexity is also considered with the aim towards creating a real-time end-to-end model-based video coding system.",
keywords = "Feature extraction, Feature tracking, Head tracking, Model-based coding",
author = "Colmenarez, {Antonio J.} and Ricardo Lopez and Huang, {Thomas S.}",
year = "1997",
month = "12",
day = "1",
doi = "10.1117/12.263254",
language = "English (US)",
volume = "3024",
pages = "426--434",
journal = "Proceedings of SPIE - The International Society for Optical Engineering",
issn = "0277-786X",
publisher = "SPIE",

}

TY - JOUR

T1 - 3D-model-based head tracking

AU - Colmenarez, Antonio J.

AU - Lopez, Ricardo

AU - Huang, Thomas S.

PY - 1997/12/1

Y1 - 1997/12/1

N2 - This paper introduces a new approach to feature-based head tracking and pose estimation. Head tracking and pose estimation find their most important applications in motion analysis for model-based video coding. The proposed algorithm employs an underlying 3D head model, feature-based pose estimation, and texture mapping to produce accurate templates for the feature tracking. In this way, the set of templates used for the matching is constantly updated with the pose changes, allowing the algorithm to track the features over a large range of head motion without loss of precision and error accumulation. Given a rough estimate of the head scale, the initial feature identification is performed automatically and the tracking is successful over a large number of video frames. Computational complexity is also considered with the aim towards creating a real-time end-to-end model-based video coding system.

AB - This paper introduces a new approach to feature-based head tracking and pose estimation. Head tracking and pose estimation find their most important applications in motion analysis for model-based video coding. The proposed algorithm employs an underlying 3D head model, feature-based pose estimation, and texture mapping to produce accurate templates for the feature tracking. In this way, the set of templates used for the matching is constantly updated with the pose changes, allowing the algorithm to track the features over a large range of head motion without loss of precision and error accumulation. Given a rough estimate of the head scale, the initial feature identification is performed automatically and the tracking is successful over a large number of video frames. Computational complexity is also considered with the aim towards creating a real-time end-to-end model-based video coding system.

KW - Feature extraction

KW - Feature tracking

KW - Head tracking

KW - Model-based coding

UR - http://www.scopus.com/inward/record.url?scp=57749093283&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=57749093283&partnerID=8YFLogxK

U2 - 10.1117/12.263254

DO - 10.1117/12.263254

M3 - Conference article

AN - SCOPUS:57749093283

VL - 3024

SP - 426

EP - 434

JO - Proceedings of SPIE - The International Society for Optical Engineering

JF - Proceedings of SPIE - The International Society for Optical Engineering

SN - 0277-786X

ER -