Spatialized audio multiparty teleconferencing with commodity miniature microphone array

Viet Anh Nguyen; Shengkui Zhao; Tien Dung Vu; Douglas L. Jones; Minh N. Do

doi:10.1145/2502081.2502146

Spatialized audio multiparty teleconferencing with commodity miniature microphone array

Viet Anh Nguyen, Shengkui Zhao, Tien Dung Vu, Douglas L. Jones, Minh N. Do

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Abstract

This paper presents a Spatialized Audio Multiparty Tele- conferencing (SAMT) system with a radically new communication experience for group teleconferencing. The system includes our recently developed 3D audio technologies: 3D sound source localization (SSL) and 3D audio capture and reproduction using a low-cost and compact design micro- phone array. In essence, the SAMT system offers 3D audio capture capability and spatial audio perception with multiple participants at a site, which still falls short in teleconferencing solutions. In addition to being able to identify and automatically track the active speaker, the system allows more compelling visual presentation for effective communication. Requiring only a low-cost microphone array and a consumer depth camera, the proposed system runs reliably and comfortably in real time on a commodity laptop or desk- Top PC. With such a minimal deployment requirement, we present a variety of user experiences created by SAMT.

Original language	English (US)
Title of host publication	MM 2013 - Proceedings of the 2013 ACM Multimedia Conference
Pages	553-556
Number of pages	4
DOIs	https://doi.org/10.1145/2502081.2502146
State	Published - Nov 18 2013
Event	21st ACM International Conference on Multimedia, MM 2013 - Barcelona, Spain Duration: Oct 21 2013 → Oct 25 2013

Publication series

Name	MM 2013 - Proceedings of the 2013 ACM Multimedia Conference

Other

Other	21st ACM International Conference on Multimedia, MM 2013
Country	Spain
City	Barcelona
Period	10/21/13 → 10/25/13

Keywords

3d sound localization
3d spatialized audio
Video conferencing

ASJC Scopus subject areas

Computer Graphics and Computer-Aided Design
Human-Computer Interaction
Software

Access to Document

10.1145/2502081.2502146

Fingerprint Dive into the research topics of 'Spatialized audio multiparty teleconferencing with commodity miniature microphone array'. Together they form a unique fingerprint.

Cite this

Spatialized audio multiparty teleconferencing with commodity miniature microphone array. / Nguyen, Viet Anh; Zhao, Shengkui; Vu, Tien Dung; Jones, Douglas L.; Do, Minh N.

MM 2013 - Proceedings of the 2013 ACM Multimedia Conference. 2013. p. 553-556 (MM 2013 - Proceedings of the 2013 ACM Multimedia Conference).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Nguyen, VA, Zhao, S, Vu, TD, Jones, DL & Do, MN 2013, Spatialized audio multiparty teleconferencing with commodity miniature microphone array. in MM 2013 - Proceedings of the 2013 ACM Multimedia Conference. MM 2013 - Proceedings of the 2013 ACM Multimedia Conference, pp. 553-556, 21st ACM International Conference on Multimedia, MM 2013, Barcelona, Spain, 10/21/13. https://doi.org/10.1145/2502081.2502146

@inproceedings{21d8337e96e441ab8385040b3960e733,

title = "Spatialized audio multiparty teleconferencing with commodity miniature microphone array",

abstract = "This paper presents a Spatialized Audio Multiparty Tele- conferencing (SAMT) system with a radically new communication experience for group teleconferencing. The system includes our recently developed 3D audio technologies: 3D sound source localization (SSL) and 3D audio capture and reproduction using a low-cost and compact design micro- phone array. In essence, the SAMT system offers 3D audio capture capability and spatial audio perception with multiple participants at a site, which still falls short in teleconferencing solutions. In addition to being able to identify and automatically track the active speaker, the system allows more compelling visual presentation for effective communication. Requiring only a low-cost microphone array and a consumer depth camera, the proposed system runs reliably and comfortably in real time on a commodity laptop or desk- Top PC. With such a minimal deployment requirement, we present a variety of user experiences created by SAMT.",

keywords = "3d sound localization, 3d spatialized audio, Video conferencing",

author = "Nguyen, {Viet Anh} and Shengkui Zhao and Vu, {Tien Dung} and Jones, {Douglas L.} and Do, {Minh N.}",

year = "2013",

month = nov,

day = "18",

doi = "10.1145/2502081.2502146",

language = "English (US)",

isbn = "9781450324045",

series = "MM 2013 - Proceedings of the 2013 ACM Multimedia Conference",

pages = "553--556",

booktitle = "MM 2013 - Proceedings of the 2013 ACM Multimedia Conference",

note = "21st ACM International Conference on Multimedia, MM 2013 ; Conference date: 21-10-2013 Through 25-10-2013",

}

TY - GEN

T1 - Spatialized audio multiparty teleconferencing with commodity miniature microphone array

AU - Nguyen, Viet Anh

AU - Zhao, Shengkui

AU - Vu, Tien Dung

AU - Jones, Douglas L.

AU - Do, Minh N.

PY - 2013/11/18

Y1 - 2013/11/18

N2 - This paper presents a Spatialized Audio Multiparty Tele- conferencing (SAMT) system with a radically new communication experience for group teleconferencing. The system includes our recently developed 3D audio technologies: 3D sound source localization (SSL) and 3D audio capture and reproduction using a low-cost and compact design micro- phone array. In essence, the SAMT system offers 3D audio capture capability and spatial audio perception with multiple participants at a site, which still falls short in teleconferencing solutions. In addition to being able to identify and automatically track the active speaker, the system allows more compelling visual presentation for effective communication. Requiring only a low-cost microphone array and a consumer depth camera, the proposed system runs reliably and comfortably in real time on a commodity laptop or desk- Top PC. With such a minimal deployment requirement, we present a variety of user experiences created by SAMT.

AB - This paper presents a Spatialized Audio Multiparty Tele- conferencing (SAMT) system with a radically new communication experience for group teleconferencing. The system includes our recently developed 3D audio technologies: 3D sound source localization (SSL) and 3D audio capture and reproduction using a low-cost and compact design micro- phone array. In essence, the SAMT system offers 3D audio capture capability and spatial audio perception with multiple participants at a site, which still falls short in teleconferencing solutions. In addition to being able to identify and automatically track the active speaker, the system allows more compelling visual presentation for effective communication. Requiring only a low-cost microphone array and a consumer depth camera, the proposed system runs reliably and comfortably in real time on a commodity laptop or desk- Top PC. With such a minimal deployment requirement, we present a variety of user experiences created by SAMT.

KW - 3d sound localization

KW - 3d spatialized audio

KW - Video conferencing

UR - http://www.scopus.com/inward/record.url?scp=84887455517&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84887455517&partnerID=8YFLogxK

U2 - 10.1145/2502081.2502146

DO - 10.1145/2502081.2502146

M3 - Conference contribution

AN - SCOPUS:84887455517

SN - 9781450324045

T3 - MM 2013 - Proceedings of the 2013 ACM Multimedia Conference

SP - 553

EP - 556

BT - MM 2013 - Proceedings of the 2013 ACM Multimedia Conference

T2 - 21st ACM International Conference on Multimedia, MM 2013

Y2 - 21 October 2013 through 25 October 2013

ER -