Multichannel and multimodality person identification

Ming Liu; Yanxiang Chen; Xi Zhou; Xiaodan Zhuang; Mark Hasegawa-Johnson; Thomas Huang

doi:10.1007/978-3-540-68585-2_23

Multichannel and multimodality person identification

Ming Liu, Yanxiang Chen, Xi Zhou, Xiaodan Zhuang, Mark Hasegawa-Johnson, Thomas Huang

Research output: Contribution to journal › Conference article › peer-review

Abstract

Person's identity is a very important high level information for video analysis and retrieval. Along the growth of multimedia data, the recording is not only multimodality and also multichannel(microphone array, camera array). In this paper, we describe a multimodal person identification system of UIUC team for CLEAR 2007 evaluation. The audio only system is based on a new proposed model - Chain of Gaussian Mixtures. The visual only system is a face recognition module based on nearest neighbor classifier at appearance space. Final system fuses 7 channel microphone recordings and 4 camera recordings at decision level. The experimental results indicate the effectiviness of speaker modeling methods and the fusion scheme.

Original language	English (US)
Pages (from-to)	248-255
Number of pages	8
Journal	Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume	4625 LNCS
DOIs	https://doi.org/10.1007/978-3-540-68585-2_23
State	Published - 2008
Event	2nd Annual Classifcation of Events Activities and Relationships, CLEAR 2007 and Rich Transcription, RT 2007 - Baltimore, MD, United States Duration: May 8 2007 → May 11 2007

ASJC Scopus subject areas

Theoretical Computer Science
General Computer Science

Online availability

10.1007/978-3-540-68585-2_23

Library availability

Discover UIUC Full Text

Cite this

@article{dc656b32529e48aa9ea77ef467569a23,

title = "Multichannel and multimodality person identification",

abstract = "Person's identity is a very important high level information for video analysis and retrieval. Along the growth of multimedia data, the recording is not only multimodality and also multichannel(microphone array, camera array). In this paper, we describe a multimodal person identification system of UIUC team for CLEAR 2007 evaluation. The audio only system is based on a new proposed model - Chain of Gaussian Mixtures. The visual only system is a face recognition module based on nearest neighbor classifier at appearance space. Final system fuses 7 channel microphone recordings and 4 camera recordings at decision level. The experimental results indicate the effectiviness of speaker modeling methods and the fusion scheme.",

author = "Ming Liu and Yanxiang Chen and Xi Zhou and Xiaodan Zhuang and Mark Hasegawa-Johnson and Thomas Huang",

year = "2008",

doi = "10.1007/978-3-540-68585-2_23",

language = "English (US)",

volume = "4625 LNCS",

pages = "248--255",

journal = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",

issn = "0302-9743",

publisher = "Springer",

note = "2nd Annual Classifcation of Events Activities and Relationships, CLEAR 2007 and Rich Transcription, RT 2007 ; Conference date: 08-05-2007 Through 11-05-2007",

}

TY - JOUR

T1 - Multichannel and multimodality person identification

AU - Liu, Ming

AU - Chen, Yanxiang

AU - Zhou, Xi

AU - Zhuang, Xiaodan

AU - Hasegawa-Johnson, Mark

AU - Huang, Thomas

PY - 2008

Y1 - 2008

N2 - Person's identity is a very important high level information for video analysis and retrieval. Along the growth of multimedia data, the recording is not only multimodality and also multichannel(microphone array, camera array). In this paper, we describe a multimodal person identification system of UIUC team for CLEAR 2007 evaluation. The audio only system is based on a new proposed model - Chain of Gaussian Mixtures. The visual only system is a face recognition module based on nearest neighbor classifier at appearance space. Final system fuses 7 channel microphone recordings and 4 camera recordings at decision level. The experimental results indicate the effectiviness of speaker modeling methods and the fusion scheme.

AB - Person's identity is a very important high level information for video analysis and retrieval. Along the growth of multimedia data, the recording is not only multimodality and also multichannel(microphone array, camera array). In this paper, we describe a multimodal person identification system of UIUC team for CLEAR 2007 evaluation. The audio only system is based on a new proposed model - Chain of Gaussian Mixtures. The visual only system is a face recognition module based on nearest neighbor classifier at appearance space. Final system fuses 7 channel microphone recordings and 4 camera recordings at decision level. The experimental results indicate the effectiviness of speaker modeling methods and the fusion scheme.

UR - http://www.scopus.com/inward/record.url?scp=47749156390&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=47749156390&partnerID=8YFLogxK

U2 - 10.1007/978-3-540-68585-2_23

DO - 10.1007/978-3-540-68585-2_23

M3 - Conference article

AN - SCOPUS:47749156390

SN - 0302-9743

VL - 4625 LNCS

SP - 248

EP - 255

JO - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

JF - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

T2 - 2nd Annual Classifcation of Events Activities and Relationships, CLEAR 2007 and Rich Transcription, RT 2007

Y2 - 8 May 2007 through 11 May 2007

ER -

Multichannel and multimodality person identification

Abstract

ASJC Scopus subject areas

Online availability

Library availability

Related links

Fingerprint

Cite this