Camera and microphone array for 3D audiovisual face data collection

Yuxiao Hu; Hao Tang; Thomas S. Huang

doi:10.1109/ICASSP.2008.4518071

Camera and microphone array for 3D audiovisual face data collection

Yuxiao Hu, Hao Tang, Thomas S. Huang

Coordinated Science Lab

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Abstract

This paper proposes a novel camera/microphone array system capable of capturing dynamic facial expression video with synchronized speech and reconstructing realistic 3D face models from the data. Both hardware and software issues including camera calibration, video/audio synchronization, facial marker tracking and 3D shape reconstruction are considered. To our best knowledge, this system is the first camera/microphone array system that is able to capture high-resolution facial expression video with synchronized speech. The system can be used to collect dynamic 3D audiovisual face data for many multimedia applications.

Original language	English (US)
Title of host publication	2008 IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP
Pages	2161-2164
Number of pages	4
DOIs	https://doi.org/10.1109/ICASSP.2008.4518071
State	Published - 2008
Event	2008 IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP - Las Vegas, NV, United States Duration: Mar 31 2008 → Apr 4 2008

Publication series

Name	ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings
ISSN (Print)	1520-6149

Other

Other	2008 IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP
Country/Territory	United States
City	Las Vegas, NV
Period	3/31/08 → 4/4/08

Keywords

3D face model
3D shape reconstruction
Camera/microphone array

ASJC Scopus subject areas

Software
Signal Processing
Electrical and Electronic Engineering

Online availability

10.1109/ICASSP.2008.4518071

Library availability

Discover UIUC Full Text

Cite this

Hu, Y., Tang, H., & Huang, T. S. (2008). Camera and microphone array for 3D audiovisual face data collection. In 2008 IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP (pp. 2161-2164). Article 4518071 (ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings). https://doi.org/10.1109/ICASSP.2008.4518071

Camera and microphone array for 3D audiovisual face data collection. / Hu, Yuxiao; Tang, Hao; Huang, Thomas S.
2008 IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP. 2008. p. 2161-2164 4518071 (ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Hu, Y, Tang, H & Huang, TS 2008, Camera and microphone array for 3D audiovisual face data collection. in 2008 IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP., 4518071, ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings, pp. 2161-2164, 2008 IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP, Las Vegas, NV, United States, 3/31/08. https://doi.org/10.1109/ICASSP.2008.4518071

@inproceedings{e53e1e3bea514b09afd42bed95546a4a,

title = "Camera and microphone array for 3D audiovisual face data collection",

abstract = "This paper proposes a novel camera/microphone array system capable of capturing dynamic facial expression video with synchronized speech and reconstructing realistic 3D face models from the data. Both hardware and software issues including camera calibration, video/audio synchronization, facial marker tracking and 3D shape reconstruction are considered. To our best knowledge, this system is the first camera/microphone array system that is able to capture high-resolution facial expression video with synchronized speech. The system can be used to collect dynamic 3D audiovisual face data for many multimedia applications.",

keywords = "3D face model, 3D shape reconstruction, Camera/microphone array",

author = "Yuxiao Hu and Hao Tang and Huang, {Thomas S.}",

year = "2008",

doi = "10.1109/ICASSP.2008.4518071",

language = "English (US)",

isbn = "1424414849",

series = "ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings",

pages = "2161--2164",

booktitle = "2008 IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP",

note = "2008 IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP ; Conference date: 31-03-2008 Through 04-04-2008",

}

TY - GEN

T1 - Camera and microphone array for 3D audiovisual face data collection

AU - Hu, Yuxiao

AU - Tang, Hao

AU - Huang, Thomas S.

PY - 2008

Y1 - 2008

N2 - This paper proposes a novel camera/microphone array system capable of capturing dynamic facial expression video with synchronized speech and reconstructing realistic 3D face models from the data. Both hardware and software issues including camera calibration, video/audio synchronization, facial marker tracking and 3D shape reconstruction are considered. To our best knowledge, this system is the first camera/microphone array system that is able to capture high-resolution facial expression video with synchronized speech. The system can be used to collect dynamic 3D audiovisual face data for many multimedia applications.

AB - This paper proposes a novel camera/microphone array system capable of capturing dynamic facial expression video with synchronized speech and reconstructing realistic 3D face models from the data. Both hardware and software issues including camera calibration, video/audio synchronization, facial marker tracking and 3D shape reconstruction are considered. To our best knowledge, this system is the first camera/microphone array system that is able to capture high-resolution facial expression video with synchronized speech. The system can be used to collect dynamic 3D audiovisual face data for many multimedia applications.

KW - 3D face model

KW - 3D shape reconstruction

KW - Camera/microphone array

UR - http://www.scopus.com/inward/record.url?scp=51449104955&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=51449104955&partnerID=8YFLogxK

U2 - 10.1109/ICASSP.2008.4518071

DO - 10.1109/ICASSP.2008.4518071

M3 - Conference contribution

AN - SCOPUS:51449104955

SN - 1424414849

SN - 9781424414840

T3 - ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings

SP - 2161

EP - 2164

BT - 2008 IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP

T2 - 2008 IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP

Y2 - 31 March 2008 through 4 April 2008

ER -

Camera and microphone array for 3D audiovisual face data collection

Abstract

Publication series

Other

Keywords

ASJC Scopus subject areas

Online availability

Library availability

Related links

Fingerprint

Cite this