Dynamic textures synthesis as nonlinear manifold learning and traversing

Che Bin Liu, Ruei Sung Lin, Narendra Ahuja, Ming Hsuan Yang

Research output: Contribution to conferencePaper

Abstract

We formulate the problem of dynamic texture synthesis as a nonlinear manifold learning and traversing problem. We characterize dynamic textures as the temporal changes in spectral parameters of image sequences. For continuous changes of such parameters, it is commonly assumed that all these parameters lie on or close to a low-dimensional manifold embedded in the original configuration space. For complex dynamic data, the manifolds are usually nonlinear and we propose to use a mixture of linear subspaces to model a nonlinear manifold. These locally linear subspaces are further aligned within a global coordinate system. With the nonlinear manifold being globally parameterized, we overcome motion discontinuity problems encountered in switching linear models and dynamics. We present a nonparametric method to describe the complex dynamics of data sequences on the manifold. We also apply such approach to dynamic spatial parameters such as motion capture data. The experimental results suggest that our approach is able to synthesize smooth, complex dynamic textures and human motions, and has potential applications to other dynamic data synthesis problems.

Original languageEnglish (US)
Pages859-868
Number of pages10
StatePublished - Jan 1 2006
Event2006 17th British Machine Vision Conference, BMVC 2006 - Edinburgh, United Kingdom
Duration: Sep 4 2006Sep 7 2006

Other

Other2006 17th British Machine Vision Conference, BMVC 2006
CountryUnited Kingdom
CityEdinburgh
Period9/4/069/7/06

ASJC Scopus subject areas

  • Computer Vision and Pattern Recognition

Fingerprint Dive into the research topics of 'Dynamic textures synthesis as nonlinear manifold learning and traversing'. Together they form a unique fingerprint.

  • Cite this

    Liu, C. B., Lin, R. S., Ahuja, N., & Yang, M. H. (2006). Dynamic textures synthesis as nonlinear manifold learning and traversing. 859-868. Paper presented at 2006 17th British Machine Vision Conference, BMVC 2006, Edinburgh, United Kingdom.