3D Binaural audio capture and reproduction using a miniature microphone array

Shengkui Zhao, Ryan Rogowski, Reece Johnson, Douglas L. Jones

Research output: Contribution to conferencePaper

Abstract

This paper presents a new low-cost and efficient approach for the real-time three-dimensional (3D) binaural audio capture and reproduction via headphones using a miniature microphone array. The microphone array is configured in B-format to minimize space requirement using an omnidirectional microphone and three bidirectional microphones. The signals captured by the microphone array are applied by a set of optimal time-invariant gain vectors, which converts a B-format Ambisonic sinal into binaural signal for headphone reproduction. The optimal time-invariant gain vectors that are computed offline integrate the two stages of beamforming and head related transfer function (HRTF) filtering. As an alternative to the virtual speaker method, the proposed beamforming approach is independent of the number of virtual audio sources and flexible for working on different sets of HRTFs. A real-time system has been implemented based on the proposed method. Psychophysical hearing tests show good localization accuracy.

Original languageEnglish (US)
StatePublished - Dec 1 2012
Event15th International Conference on Digital Audio Effects, DAFx 2012 - York, United Kingdom
Duration: Sep 17 2012Sep 21 2012

Other

Other15th International Conference on Digital Audio Effects, DAFx 2012
CountryUnited Kingdom
CityYork
Period9/17/129/21/12

Fingerprint

Microphones
Headphones
Beamforming
Audition
Real time systems
Transfer functions
Costs

ASJC Scopus subject areas

  • Signal Processing

Cite this

Zhao, S., Rogowski, R., Johnson, R., & Jones, D. L. (2012). 3D Binaural audio capture and reproduction using a miniature microphone array. Paper presented at 15th International Conference on Digital Audio Effects, DAFx 2012, York, United Kingdom.

3D Binaural audio capture and reproduction using a miniature microphone array. / Zhao, Shengkui; Rogowski, Ryan; Johnson, Reece; Jones, Douglas L.

2012. Paper presented at 15th International Conference on Digital Audio Effects, DAFx 2012, York, United Kingdom.

Research output: Contribution to conferencePaper

Zhao, S, Rogowski, R, Johnson, R & Jones, DL 2012, '3D Binaural audio capture and reproduction using a miniature microphone array', Paper presented at 15th International Conference on Digital Audio Effects, DAFx 2012, York, United Kingdom, 9/17/12 - 9/21/12.
Zhao S, Rogowski R, Johnson R, Jones DL. 3D Binaural audio capture and reproduction using a miniature microphone array. 2012. Paper presented at 15th International Conference on Digital Audio Effects, DAFx 2012, York, United Kingdom.
Zhao, Shengkui ; Rogowski, Ryan ; Johnson, Reece ; Jones, Douglas L. / 3D Binaural audio capture and reproduction using a miniature microphone array. Paper presented at 15th International Conference on Digital Audio Effects, DAFx 2012, York, United Kingdom.
@conference{8b60a9e85d784c4aa0741165b2207140,
title = "3D Binaural audio capture and reproduction using a miniature microphone array",
abstract = "This paper presents a new low-cost and efficient approach for the real-time three-dimensional (3D) binaural audio capture and reproduction via headphones using a miniature microphone array. The microphone array is configured in B-format to minimize space requirement using an omnidirectional microphone and three bidirectional microphones. The signals captured by the microphone array are applied by a set of optimal time-invariant gain vectors, which converts a B-format Ambisonic sinal into binaural signal for headphone reproduction. The optimal time-invariant gain vectors that are computed offline integrate the two stages of beamforming and head related transfer function (HRTF) filtering. As an alternative to the virtual speaker method, the proposed beamforming approach is independent of the number of virtual audio sources and flexible for working on different sets of HRTFs. A real-time system has been implemented based on the proposed method. Psychophysical hearing tests show good localization accuracy.",
author = "Shengkui Zhao and Ryan Rogowski and Reece Johnson and Jones, {Douglas L.}",
year = "2012",
month = "12",
day = "1",
language = "English (US)",
note = "15th International Conference on Digital Audio Effects, DAFx 2012 ; Conference date: 17-09-2012 Through 21-09-2012",

}

TY - CONF

T1 - 3D Binaural audio capture and reproduction using a miniature microphone array

AU - Zhao, Shengkui

AU - Rogowski, Ryan

AU - Johnson, Reece

AU - Jones, Douglas L.

PY - 2012/12/1

Y1 - 2012/12/1

N2 - This paper presents a new low-cost and efficient approach for the real-time three-dimensional (3D) binaural audio capture and reproduction via headphones using a miniature microphone array. The microphone array is configured in B-format to minimize space requirement using an omnidirectional microphone and three bidirectional microphones. The signals captured by the microphone array are applied by a set of optimal time-invariant gain vectors, which converts a B-format Ambisonic sinal into binaural signal for headphone reproduction. The optimal time-invariant gain vectors that are computed offline integrate the two stages of beamforming and head related transfer function (HRTF) filtering. As an alternative to the virtual speaker method, the proposed beamforming approach is independent of the number of virtual audio sources and flexible for working on different sets of HRTFs. A real-time system has been implemented based on the proposed method. Psychophysical hearing tests show good localization accuracy.

AB - This paper presents a new low-cost and efficient approach for the real-time three-dimensional (3D) binaural audio capture and reproduction via headphones using a miniature microphone array. The microphone array is configured in B-format to minimize space requirement using an omnidirectional microphone and three bidirectional microphones. The signals captured by the microphone array are applied by a set of optimal time-invariant gain vectors, which converts a B-format Ambisonic sinal into binaural signal for headphone reproduction. The optimal time-invariant gain vectors that are computed offline integrate the two stages of beamforming and head related transfer function (HRTF) filtering. As an alternative to the virtual speaker method, the proposed beamforming approach is independent of the number of virtual audio sources and flexible for working on different sets of HRTFs. A real-time system has been implemented based on the proposed method. Psychophysical hearing tests show good localization accuracy.

UR - http://www.scopus.com/inward/record.url?scp=84872738337&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84872738337&partnerID=8YFLogxK

M3 - Paper

AN - SCOPUS:84872738337

ER -