Motion coherent tracking with multi-label MRF optimization

David Tsai, Matthew Flagg, James M. Rehg

Research output: Contribution to conferencePaperpeer-review


We present a novel off-line algorithm for target segmentation and tracking in video. In our approach, video data is represented by a multi-label Markov Random Field model, and segmentation is accomplished by finding the minimum energy label assignment. We propose a novel energy formulation which incorporates both segmentation and motion estimation in a single framework. Our energy functions enforce motion coherence both within and across frames. We utilize state-of-the-art methods to efficiently optimize over a large number of discrete labels. In addition, we introduce a new ground-truth dataset, called SegTrack, for the evaluation of segmentation accuracy in video tracking. We compare our method with two recent on-line tracking algorithms and provide quantitative and qualitative performance comparisons.

Original languageEnglish (US)
StatePublished - 2010
Externally publishedYes
Event2010 21st British Machine Vision Conference, BMVC 2010 - Aberystwyth, United Kingdom
Duration: Aug 31 2010Sep 3 2010


Conference2010 21st British Machine Vision Conference, BMVC 2010
Country/TerritoryUnited Kingdom

ASJC Scopus subject areas

  • Computer Vision and Pattern Recognition


Dive into the research topics of 'Motion coherent tracking with multi-label MRF optimization'. Together they form a unique fingerprint.

Cite this