HASA-Net: A Non-Intrusive Hearing-Aid Speech Assessment Network

Hsin Tien Chiang, Yi Chiao Wu, Cheng Yu, Tomoki Toda, Hsin Min Wang, Yih Chun Hu, Yu Tsao

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Without the need of a clean reference, non-intrusive speech assessment methods have caught great attention for objective evaluations. Recently, deep neural network (DNN) models have been applied to build non-intrusive speech assessment approaches and confirmed to provide promising performance. However, most DNN-based approaches are designed for normal-hearing listeners without considering hearing-loss factors. In this study, we propose a DNN-based hearing aid speech assessment network (HASA-Net), formed by a bidirectional long short-term memory (BLSTM) model, to predict speech quality and intelligibility scores simultaneously according to input speech signals and specified hearing-loss patterns. To the best of our knowledge, HASA-Net is the first work to incorporate quality and intelligibility assessments utilizing a unified DNN-based non-intrusive model for hearing aids. Experimental results show that the predicted speech quality and intelligibility scores of HASA-Net are highly correlated to two well-known intrusive hearing-aid evaluation metrics, hearing aid speech quality index (HASQI) and hearing aid speech perception index (HASPI), respectively.

Original languageEnglish (US)
Title of host publication2021 IEEE Automatic Speech Recognition and Understanding Workshop, ASRU 2021 - Proceedings
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages907-913
Number of pages7
ISBN (Electronic)9781665437394
DOIs
StatePublished - 2021
Event2021 IEEE Automatic Speech Recognition and Understanding Workshop, ASRU 2021 - Cartagena, Colombia
Duration: Dec 13 2021Dec 17 2021

Publication series

Name2021 IEEE Automatic Speech Recognition and Understanding Workshop, ASRU 2021 - Proceedings

Conference

Conference2021 IEEE Automatic Speech Recognition and Understanding Workshop, ASRU 2021
Country/TerritoryColombia
CityCartagena
Period12/13/2112/17/21

Keywords

  • end-to-end
  • hearing loss
  • multi-task learning
  • non-intrusive
  • objective metrics

ASJC Scopus subject areas

  • Computer Vision and Pattern Recognition
  • Signal Processing
  • Linguistics and Language

Fingerprint

Dive into the research topics of 'HASA-Net: A Non-Intrusive Hearing-Aid Speech Assessment Network'. Together they form a unique fingerprint.

Cite this