Dynamics of plosive consonants via imaging, computations, and soft electronics

Jin Tae Kim, Wei Ouyang, Hanul Hwang, Hyoyoung Jeong, Soohyeon Kang, Sanjeeb Bose, Sung Soo Kwak, Xiaoyue Ni, Hyeonsu Kim, Jaehong Park, Hope Chen, Alan Soetikno, Joohee Kim, Shuai Xu, Leonardo P. Chamorro, John A Rogers

Research output: Contribution to journalArticlepeer-review

Abstract

A quantitative understanding of the coupled dynamics of flow and particles in aerosol and droplet transmission associated with speech remains elusive. Here, we summarize an effort that integrates insights into flow-particle dynamics induced by the production plosive sounds during speech with skin-integrated electronic systems for monitoring the production of these sounds. In particular, we uncover diffusive and ballistic regimes separated by a threshold particle size and characterize the Lagrangian acceleration and pair dispersion. Lagrangian dynamics of the particles in the diffusive regime exhibit features of isotropic turbulence. These fundamental findings highlight the value in skin-interfaced wireless sensors for continuously measuring critical speech patterns in clinical settings, work environments, and the home, based on unique neck biomechanics associated with the generation of plosive sounds. We introduce a wireless, soft device that captures these motions to enable detection of plosive sounds in multiple languages through a convolutional neural network approach. This work spans fundamental flow-particle physics to soft electronic technology, with implications in monitoring and studying critical speech patterns associated with aerosol and droplet transmissions relevant to the spread of infectious diseases.

Original languageEnglish (US)
Article numbere2214164119
JournalProceedings of the National Academy of Sciences of the United States of America
Volume119
Issue number46
DOIs
StatePublished - Nov 15 2022

Keywords

  • computational fluid dynamics
  • experimental fluid mechanics
  • flow-particle physics
  • machine learning
  • skin-integrated electronics

ASJC Scopus subject areas

  • General

Fingerprint

Dive into the research topics of 'Dynamics of plosive consonants via imaging, computations, and soft electronics'. Together they form a unique fingerprint.

Cite this