Spatialized audio multiparty teleconferencing with commodity miniature microphone array

Viet Anh Nguyen, Shengkui Zhao, Tien Dung Vu, Douglas L Jones, Minh N Do

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

This paper presents a Spatialized Audio Multiparty Tele- conferencing (SAMT) system with a radically new communication experience for group teleconferencing. The system includes our recently developed 3D audio technologies: 3D sound source localization (SSL) and 3D audio capture and reproduction using a low-cost and compact design micro- phone array. In essence, the SAMT system offers 3D audio capture capability and spatial audio perception with multiple participants at a site, which still falls short in teleconferencing solutions. In addition to being able to identify and automatically track the active speaker, the system allows more compelling visual presentation for effective communication. Requiring only a low-cost microphone array and a consumer depth camera, the proposed system runs reliably and comfortably in real time on a commodity laptop or desk- Top PC. With such a minimal deployment requirement, we present a variety of user experiences created by SAMT.

Original languageEnglish (US)
Title of host publicationMM 2013 - Proceedings of the 2013 ACM Multimedia Conference
Pages553-556
Number of pages4
DOIs
StatePublished - Nov 18 2013
Event21st ACM International Conference on Multimedia, MM 2013 - Barcelona, Spain
Duration: Oct 21 2013Oct 25 2013

Publication series

NameMM 2013 - Proceedings of the 2013 ACM Multimedia Conference

Other

Other21st ACM International Conference on Multimedia, MM 2013
CountrySpain
CityBarcelona
Period10/21/1310/25/13

Fingerprint

Teleconferencing
Microphones
Communication
Costs
Cameras
Acoustic waves

Keywords

  • 3d sound localization
  • 3d spatialized audio
  • Video conferencing

ASJC Scopus subject areas

  • Computer Graphics and Computer-Aided Design
  • Human-Computer Interaction
  • Software

Cite this

Nguyen, V. A., Zhao, S., Vu, T. D., Jones, D. L., & Do, M. N. (2013). Spatialized audio multiparty teleconferencing with commodity miniature microphone array. In MM 2013 - Proceedings of the 2013 ACM Multimedia Conference (pp. 553-556). (MM 2013 - Proceedings of the 2013 ACM Multimedia Conference). https://doi.org/10.1145/2502081.2502146

Spatialized audio multiparty teleconferencing with commodity miniature microphone array. / Nguyen, Viet Anh; Zhao, Shengkui; Vu, Tien Dung; Jones, Douglas L; Do, Minh N.

MM 2013 - Proceedings of the 2013 ACM Multimedia Conference. 2013. p. 553-556 (MM 2013 - Proceedings of the 2013 ACM Multimedia Conference).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Nguyen, VA, Zhao, S, Vu, TD, Jones, DL & Do, MN 2013, Spatialized audio multiparty teleconferencing with commodity miniature microphone array. in MM 2013 - Proceedings of the 2013 ACM Multimedia Conference. MM 2013 - Proceedings of the 2013 ACM Multimedia Conference, pp. 553-556, 21st ACM International Conference on Multimedia, MM 2013, Barcelona, Spain, 10/21/13. https://doi.org/10.1145/2502081.2502146
Nguyen VA, Zhao S, Vu TD, Jones DL, Do MN. Spatialized audio multiparty teleconferencing with commodity miniature microphone array. In MM 2013 - Proceedings of the 2013 ACM Multimedia Conference. 2013. p. 553-556. (MM 2013 - Proceedings of the 2013 ACM Multimedia Conference). https://doi.org/10.1145/2502081.2502146
Nguyen, Viet Anh ; Zhao, Shengkui ; Vu, Tien Dung ; Jones, Douglas L ; Do, Minh N. / Spatialized audio multiparty teleconferencing with commodity miniature microphone array. MM 2013 - Proceedings of the 2013 ACM Multimedia Conference. 2013. pp. 553-556 (MM 2013 - Proceedings of the 2013 ACM Multimedia Conference).
@inproceedings{21d8337e96e441ab8385040b3960e733,
title = "Spatialized audio multiparty teleconferencing with commodity miniature microphone array",
abstract = "This paper presents a Spatialized Audio Multiparty Tele- conferencing (SAMT) system with a radically new communication experience for group teleconferencing. The system includes our recently developed 3D audio technologies: 3D sound source localization (SSL) and 3D audio capture and reproduction using a low-cost and compact design micro- phone array. In essence, the SAMT system offers 3D audio capture capability and spatial audio perception with multiple participants at a site, which still falls short in teleconferencing solutions. In addition to being able to identify and automatically track the active speaker, the system allows more compelling visual presentation for effective communication. Requiring only a low-cost microphone array and a consumer depth camera, the proposed system runs reliably and comfortably in real time on a commodity laptop or desk- Top PC. With such a minimal deployment requirement, we present a variety of user experiences created by SAMT.",
keywords = "3d sound localization, 3d spatialized audio, Video conferencing",
author = "Nguyen, {Viet Anh} and Shengkui Zhao and Vu, {Tien Dung} and Jones, {Douglas L} and Do, {Minh N}",
year = "2013",
month = "11",
day = "18",
doi = "10.1145/2502081.2502146",
language = "English (US)",
isbn = "9781450324045",
series = "MM 2013 - Proceedings of the 2013 ACM Multimedia Conference",
pages = "553--556",
booktitle = "MM 2013 - Proceedings of the 2013 ACM Multimedia Conference",

}

TY - GEN

T1 - Spatialized audio multiparty teleconferencing with commodity miniature microphone array

AU - Nguyen, Viet Anh

AU - Zhao, Shengkui

AU - Vu, Tien Dung

AU - Jones, Douglas L

AU - Do, Minh N

PY - 2013/11/18

Y1 - 2013/11/18

N2 - This paper presents a Spatialized Audio Multiparty Tele- conferencing (SAMT) system with a radically new communication experience for group teleconferencing. The system includes our recently developed 3D audio technologies: 3D sound source localization (SSL) and 3D audio capture and reproduction using a low-cost and compact design micro- phone array. In essence, the SAMT system offers 3D audio capture capability and spatial audio perception with multiple participants at a site, which still falls short in teleconferencing solutions. In addition to being able to identify and automatically track the active speaker, the system allows more compelling visual presentation for effective communication. Requiring only a low-cost microphone array and a consumer depth camera, the proposed system runs reliably and comfortably in real time on a commodity laptop or desk- Top PC. With such a minimal deployment requirement, we present a variety of user experiences created by SAMT.

AB - This paper presents a Spatialized Audio Multiparty Tele- conferencing (SAMT) system with a radically new communication experience for group teleconferencing. The system includes our recently developed 3D audio technologies: 3D sound source localization (SSL) and 3D audio capture and reproduction using a low-cost and compact design micro- phone array. In essence, the SAMT system offers 3D audio capture capability and spatial audio perception with multiple participants at a site, which still falls short in teleconferencing solutions. In addition to being able to identify and automatically track the active speaker, the system allows more compelling visual presentation for effective communication. Requiring only a low-cost microphone array and a consumer depth camera, the proposed system runs reliably and comfortably in real time on a commodity laptop or desk- Top PC. With such a minimal deployment requirement, we present a variety of user experiences created by SAMT.

KW - 3d sound localization

KW - 3d spatialized audio

KW - Video conferencing

UR - http://www.scopus.com/inward/record.url?scp=84887455517&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84887455517&partnerID=8YFLogxK

U2 - 10.1145/2502081.2502146

DO - 10.1145/2502081.2502146

M3 - Conference contribution

AN - SCOPUS:84887455517

SN - 9781450324045

T3 - MM 2013 - Proceedings of the 2013 ACM Multimedia Conference

SP - 553

EP - 556

BT - MM 2013 - Proceedings of the 2013 ACM Multimedia Conference

ER -