Person identification based on multichannel and multimodality fusion

Ming Liu, Hao Tang, Huazhong Ning, Thomas Huang

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Person ID is a very useful information for high level video analysis and retrieval. In some scenario, the recording is not only multimodality and also multichannel(microphone array, camera array). In this paper, we describe a Multimodal person ID system base on multichannel and multimodal fusion. The audio only system is combining 7 channel microphone recording at decision output individual audio-only system. The modeling technique of audio system is Universal Background Model(UBM) and Maximum a Posterior adaptation framework which is very popular in speaker recognition literature. The visual only system works directly on the appearance space via Zi norm and nearest neighbor classifier. The linear fusion is then combining the two modalities to improve the ID performance. The experiments indicate the effectiviness of micropohone array fusion and audio/visual fusion.

Original languageEnglish (US)
Title of host publicationMultimodal Technologies for Perception of Humans - First International Evaluation Workshop on Classification of Events, Activities and Relationships, CLEAR 2006 Revised Selected Papers
PublisherSpringer
Pages241-248
Number of pages8
ISBN (Print)9783540695677
DOIs
StatePublished - 2007
Event1st International Evaluation Workshop on Classification of Events, Activities and Relationships, CLEAR 2006 - Southhampton, United Kingdom
Duration: Apr 6 2006Apr 7 2006

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume4122 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Other

Other1st International Evaluation Workshop on Classification of Events, Activities and Relationships, CLEAR 2006
Country/TerritoryUnited Kingdom
CitySouthhampton
Period4/6/064/7/06

ASJC Scopus subject areas

  • Theoretical Computer Science
  • General Computer Science

Fingerprint

Dive into the research topics of 'Person identification based on multichannel and multimodality fusion'. Together they form a unique fingerprint.

Cite this