Voice localization using nearby wall reflections

Sheng Shen, Daguan Chen, Yu Lin Wei, Zhijian Yang, Romit Roy Choudhury

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Voice assistants such as Amazon Echo (Alexa) and Google Home use microphone arrays to estimate the angle of arrival (AoA) of the human voice. This paper focuses on adding user localization as a new capability to voice assistants. For any voice command, we desire Alexa to be able to localize the user inside the home. The core challenge is two-fold: (1) accurately estimating the AoAs of multipath echoes without the knowledge of the source signal, and (2) tracing back these AoAs to reverse triangulate the user's location. We develop VoLoc, a system that proposes an iterative align-and-cancel algorithm for improved multipath AoA estimation, followed by an error-minimization technique to estimate the geometry of a nearby wall reflection. The AoAs and geometric parameters of the nearby wall are then fused to reveal the user's location. Under modest assumptions, we report localization accuracy of 0.44 m across different rooms, clutter, and user/microphone locations. VoLoc runs in near real-time but needs to hear around 15 voice commands before becoming operational.

Original languageEnglish (US)
Title of host publicationProceedings of the 26th Annual International Conference on Mobile Computing and Networking, MobiCom 2020
PublisherAssociation for Computing Machinery
Pages82-95
Number of pages14
ISBN (Electronic)9781450370851
DOIs
StatePublished - Apr 16 2020
Event26th Annual International Conference on Mobile Computing and Networking, MobiCom 2020 - London, United Kingdom
Duration: Sep 21 2020Sep 25 2020

Publication series

NameProceedings of the Annual International Conference on Mobile Computing and Networking, MOBICOM

Conference

Conference26th Annual International Conference on Mobile Computing and Networking, MobiCom 2020
Country/TerritoryUnited Kingdom
CityLondon
Period9/21/209/25/20

Keywords

  • Amazon alexa
  • acoustic reverberation
  • angle-of-arrival
  • edge computing
  • microphone array
  • smart home
  • source localization
  • voice assistant

ASJC Scopus subject areas

  • Computer Networks and Communications
  • Hardware and Architecture
  • Software

Fingerprint

Dive into the research topics of 'Voice localization using nearby wall reflections'. Together they form a unique fingerprint.

Cite this