Human video textures

Matthew Flagg, Atsushi Nakazawa, Qiushuang Zhang, Sing Bing Kang, Young Kee Ryu, Irfan Essa, James M. Rehg

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

This paper describes a data-driven approach for generating photorealistic animations of human motion. Each animation sequence follows a user-choreographed path and plays continuously by seamlessly transitioning between different segments of the captured data. To produce these animations, we capitalize on the complementary characteristics of motion capture data and video. We customize our capture system to record motion capture data that are synchronized with our video source. Candidate transition points in video clips are identified using a new similarity metric based on 3-D marker trajectories and their 2-D projections into video. Once the transitions have been identified, a video-based motion graph is constructed. We further exploit hybrid motion and video data to ensure that the transitions are seamless when generating animations. Motion capture marker projections serve as control points for segmentation of layers and nonrigid transformation of regions. This allows warping and blending to generate seamless in-between frames for animation. We show a series of choreographed animations of walks and martial arts scenes as validation of our approach.

Original languageEnglish (US)
Title of host publicationProceedings of I3D 2009
Subtitle of host publicationThe 2009 ACM SIGGRAPH Symposium on Interactive 3D Graphics and Games
Pages199-206
Number of pages8
DOIs
StatePublished - 2009
Externally publishedYes
Event2009 ACM SIGGRAPH Symposium on Interactive 3D Graphics and Games, I3D 2009 - Boston, MA, United States
Duration: Feb 27 2009Mar 1 2009

Publication series

NameProceedings of I3D 2009: The 2009 ACM SIGGRAPH Symposium on Interactive 3D Graphics and Games

Conference

Conference2009 ACM SIGGRAPH Symposium on Interactive 3D Graphics and Games, I3D 2009
Country/TerritoryUnited States
CityBoston, MA
Period2/27/093/1/09

Keywords

  • Image-based rendering
  • Layered motion
  • Motion capture

ASJC Scopus subject areas

  • Artificial Intelligence
  • Computational Theory and Mathematics
  • Computer Graphics and Computer-Aided Design
  • Human-Computer Interaction

Fingerprint

Dive into the research topics of 'Human video textures'. Together they form a unique fingerprint.

Cite this