Using temporal coherence to build models of animals

Deva Ramanan, D. A. Forsyth

Research output: Contribution to conferencePaperpeer-review


This paper describes a system that can build appearance models of animals automatically from a video sequence of the relevant animal with no explicit supervisory information. The video sequence need not have any form of special background. Animals are modeled as a 2D kinematic chain of rectangular segments, where the number of segments and the topology of the chain are unknown. The system detects possible segments, clusters segments whose appearance is coherent over time, and then builds a spatial model of such segment clusters. The resulting representation of the spatial configuration of the animal in each frame can be seen either as a track - in which case the system described should be viewed as a generalized tracker, that is capable of modeling objects while tracking them - or as the source of an appearance model which can be used to build detectors for the particular animal. This is because knowing a video sequence is temporally coherent i.e. that a particular animal is present through the sequence - is a strong supervisory signal. The method is shown to be successful as a tracker on video sequences of real scenes showing three different animals. For the same reason it is successful as a tracker, the method results in detectors that can be used to find each animal fairly reliably within the Corel collection of images.

Original languageEnglish (US)
Number of pages8
StatePublished - 2003
Externally publishedYes
EventProceedings: Ninth IEEE International Conference on Computer Vision - Nice, France
Duration: Oct 13 2003Oct 16 2003


OtherProceedings: Ninth IEEE International Conference on Computer Vision

ASJC Scopus subject areas

  • Software
  • Computer Vision and Pattern Recognition


Dive into the research topics of 'Using temporal coherence to build models of animals'. Together they form a unique fingerprint.

Cite this