Spatialized audio multiparty teleconferencing with commodity miniature microphone array

Viet Anh Nguyen, Shengkui Zhao, Tien Dung Vu, Douglas L. Jones, Minh N. Do

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

This paper presents a Spatialized Audio Multiparty Tele- conferencing (SAMT) system with a radically new communication experience for group teleconferencing. The system includes our recently developed 3D audio technologies: 3D sound source localization (SSL) and 3D audio capture and reproduction using a low-cost and compact design micro- phone array. In essence, the SAMT system offers 3D audio capture capability and spatial audio perception with multiple participants at a site, which still falls short in teleconferencing solutions. In addition to being able to identify and automatically track the active speaker, the system allows more compelling visual presentation for effective communication. Requiring only a low-cost microphone array and a consumer depth camera, the proposed system runs reliably and comfortably in real time on a commodity laptop or desk- Top PC. With such a minimal deployment requirement, we present a variety of user experiences created by SAMT.

Original languageEnglish (US)
Title of host publicationMM 2013 - Proceedings of the 2013 ACM Multimedia Conference
Pages553-556
Number of pages4
DOIs
StatePublished - Nov 18 2013
Event21st ACM International Conference on Multimedia, MM 2013 - Barcelona, Spain
Duration: Oct 21 2013Oct 25 2013

Publication series

NameMM 2013 - Proceedings of the 2013 ACM Multimedia Conference

Other

Other21st ACM International Conference on Multimedia, MM 2013
CountrySpain
CityBarcelona
Period10/21/1310/25/13

Keywords

  • 3d sound localization
  • 3d spatialized audio
  • Video conferencing

ASJC Scopus subject areas

  • Computer Graphics and Computer-Aided Design
  • Human-Computer Interaction
  • Software

Fingerprint Dive into the research topics of 'Spatialized audio multiparty teleconferencing with commodity miniature microphone array'. Together they form a unique fingerprint.

  • Cite this

    Nguyen, V. A., Zhao, S., Vu, T. D., Jones, D. L., & Do, M. N. (2013). Spatialized audio multiparty teleconferencing with commodity miniature microphone array. In MM 2013 - Proceedings of the 2013 ACM Multimedia Conference (pp. 553-556). (MM 2013 - Proceedings of the 2013 ACM Multimedia Conference). https://doi.org/10.1145/2502081.2502146