Searching for complex human activities with no visual examples

Nazli Ikizler, David A. Forsyth

Research output: Contribution to journalArticlepeer-review

Abstract

We describe a method of representing human activities that allows a collection of motions to be queried without examples, using a simple and effective query language. Our approach is based on units of activity at segments of the body, that can be composed across space and across the body to produce complex queries. The presence of search units is inferred automatically by tracking the body, lifting the tracks to 3D and comparing to models trained using motion capture data. Our models of short time scale limb behaviour are built using labelled motion capture set. We show results for a large range of queries applied to a collection of complex motion and activity. We compare with discriminative methods applied to tracker data; our method offers significantly improved performance. We show experimental evidence that our method is robust to view direction and is unaffected by some important changes of clothing.

Original languageEnglish (US)
Pages (from-to)337-357
Number of pages21
JournalInternational Journal of Computer Vision
Volume80
Issue number3
DOIs
StatePublished - Dec 2008

Keywords

  • Activity
  • HMM
  • Human action recognition
  • Motion capture
  • Video retrieval

ASJC Scopus subject areas

  • Software
  • Computer Vision and Pattern Recognition
  • Artificial Intelligence

Fingerprint Dive into the research topics of 'Searching for complex human activities with no visual examples'. Together they form a unique fingerprint.

Cite this