Cooperative Audio Source Separation and Enhancement Using Distributed Microphone Arrays and Wearable Devices

Ryan M. Corey, Matthew D. Skarha, Andrew C. Singer

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Augmented listening devices such as hearing aids often perform poorly in noisy and reverberant environments with many competing sound sources. Large distributed microphone arrays can improve performance, but data from remote microphones often cannot be used for delay-constrained real-time processing. We present a cooperative audio source separation and enhancement system that leverages wearable listening devices and other microphone arrays spread around a room. The full distributed array is used to separate sound sources and estimate their statistics. Each listening device uses these statistics to design real-time binaural audio enhancement filters using its own local microphones. The system is demonstrated experimentally using 10 speech sources and 160 microphones in a large, reverberant room.

Original languageEnglish (US)
Title of host publication2019 IEEE 8th International Workshop on Computational Advances in Multi-Sensor Adaptive Processing, CAMSAP 2019 - Proceedings
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages296-300
Number of pages5
ISBN (Electronic)9781728155494
DOIs
StatePublished - Dec 2019
Event8th IEEE International Workshop on Computational Advances in Multi-Sensor Adaptive Processing, CAMSAP 2019 - Le Gosier, Guadeloupe
Duration: Dec 15 2019Dec 18 2019

Publication series

Name2019 IEEE 8th International Workshop on Computational Advances in Multi-Sensor Adaptive Processing, CAMSAP 2019 - Proceedings

Conference

Conference8th IEEE International Workshop on Computational Advances in Multi-Sensor Adaptive Processing, CAMSAP 2019
CountryGuadeloupe
CityLe Gosier
Period12/15/1912/18/19

Keywords

  • audio source separation
  • augmented listening
  • Distributed microphone array
  • hearing aids
  • speech enhancement

ASJC Scopus subject areas

  • Control and Optimization
  • Artificial Intelligence
  • Computer Networks and Communications

Fingerprint Dive into the research topics of 'Cooperative Audio Source Separation and Enhancement Using Distributed Microphone Arrays and Wearable Devices'. Together they form a unique fingerprint.

  • Cite this

    Corey, R. M., Skarha, M. D., & Singer, A. C. (2019). Cooperative Audio Source Separation and Enhancement Using Distributed Microphone Arrays and Wearable Devices. In 2019 IEEE 8th International Workshop on Computational Advances in Multi-Sensor Adaptive Processing, CAMSAP 2019 - Proceedings (pp. 296-300). [9022475] (2019 IEEE 8th International Workshop on Computational Advances in Multi-Sensor Adaptive Processing, CAMSAP 2019 - Proceedings). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/CAMSAP45676.2019.9022475