The effect of modality onset asynchrony and processing time on the recognition of text-supplemented speech

Kimberly G. Smith, Daniel Fogerty

Research output: Contribution to journalArticlepeer-review

Abstract

This study examined the effect of modality onset asynchrony and response processing time for the recognition of text-supplemented speech. Speech and text were periodically interrupted by noise or black bars, respectively, to preserve 50% of the sentence and presented in unimodal and multimodal conditions. Sentence recognition and response errors were assessed for responses made simultaneous with the stimulus or after its presentation. Increased processing time allowed for the cognitive repair of initial response errors in working memory. Text-supplemented speech was best recognized with minimal temporal asynchrony. Overall, text supplementation facilitated the recognition of degraded speech when provided sufficient processing time.
Original languageEnglish (US)
Article number025202
JournalJASA Express Letters
Volume3
Issue number2
DOIs
StatePublished - Feb 1 2023

Keywords

  • Electroacoustics
  • speech communication
  • phonetics
  • hearing impairment
  • audiometry
  • Acoustic attenuation
  • speech recognition
  • cognitive science
  • statistical analysis
  • analysis of variance

ASJC Scopus subject areas

  • Acoustics and Ultrasonics
  • Music
  • Arts and Humanities (miscellaneous)

Fingerprint

Dive into the research topics of 'The effect of modality onset asynchrony and processing time on the recognition of text-supplemented speech'. Together they form a unique fingerprint.

Cite this