A joint system for person tracking and face detection

Zhenqiu Zhang, Gerasimos Potamianos, Andrew Senior, Stephen Chu, Thomas S. Huang

Research output: Chapter in Book/Report/Conference proceedingConference contribution


Visual detection and tracking of humans in complex scenes is a challenging problem with a wide range of applications, for example surveillance and human-computer interaction. In many such applications, time-synchronous views from multiple calibrated cameras are available, and both frame-view and space-level human location information is desired. In such scenarios, efficiently combining the strengths of face detection and person tracking is a viable approach that can provide both levels of information required and improve robustness. In this paper, we propose a novel vision system that detects and tracks human faces automatically, using input from multiple calibrated cameras. The method uses an Adaboost algorithm variant combined with mean shift tracking applied on single camera views for face detection and tracking, and fuses the results on multiple camera views to check for consistency and obtain the three-dimensional head estimate. We apply the proposed system to a lecture scenario in a smart room, on a corpus collected as part of the CHIL European Union integrated project. We report results on both frame-level face detection and three-dimensional head tracking. For the latter, the proposed algorithm achieves similar results with the IBM "PeopleVision" system.

Original languageEnglish (US)
Title of host publicationComputer Vision in Human-Computer Interaction - ICCV 2005 Workshop on HCI, Proceedings
Number of pages13
ISBN (Print)3540296204, 9783540296201
StatePublished - 2005
EventICCV 2005 Workshop on HCI - Computer Vision in Human-Computer Interaction - Beijing, China
Duration: Oct 21 2005Oct 21 2005

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume3766 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349


OtherICCV 2005 Workshop on HCI - Computer Vision in Human-Computer Interaction

ASJC Scopus subject areas

  • Theoretical Computer Science
  • General Computer Science


Dive into the research topics of 'A joint system for person tracking and face detection'. Together they form a unique fingerprint.

Cite this