Direction of Arrival with One Microphone, a Few LEGOs, and Non-Negative Matrix Factorization

Dalia El Badawy, Ivan Dokmanic

Research output: Contribution to journalArticlepeer-review

Abstract

Conventional approaches to sound source localization require at least two microphones. It is known, however, that people with unilateral hearing loss can also localize sounds. Monaural localization is possible thanks to the scattering by the head, though it hinges on learning the spectra of the various sources. We take inspiration from this human ability to propose algorithms for accurate sound source localization using a single microphone embedded in an arbitrary scattering structure. The structure modifies the frequency response of the microphone in a direction-dependent way giving each direction a signature. While knowing those signatures is sufficient to localize sources of white noise, localizing speech is much more challenging: it is an ill-posed inverse problem, which we regularize by prior knowledge in the form of learned non-negative dictionaries. We demonstrate a monaural speech localization algorithm based on non-negative matrix factorization that does not depend on sophisticated, designed scatterers. In fact, we show experimental results with ad hoc scatterers made of LEGO bricks. Even with these rudimentary structures we can accurately localize arbitrary speakers; that is, we do not need to learn the dictionary for the particular speaker to be localized. Finally, we discuss multi-source localization and the related limitations of our approach.

Original languageEnglish (US)
Article number8445656
Pages (from-to)2436-2446
Number of pages11
JournalIEEE/ACM Transactions on Audio Speech and Language Processing
Volume26
Issue number12
DOIs
StatePublished - Dec 2018

Keywords

  • Direction-of-arrival estimation
  • group sparsity
  • monaural localization
  • non-negative matrix factorization
  • sound scattering
  • universal speech model

ASJC Scopus subject areas

  • Computer Science (miscellaneous)
  • Acoustics and Ultrasonics
  • Computational Mathematics
  • Electrical and Electronic Engineering

Fingerprint

Dive into the research topics of 'Direction of Arrival with One Microphone, a Few LEGOs, and Non-Negative Matrix Factorization'. Together they form a unique fingerprint.

Cite this