High-resolution dynamic speech imaging with deformation estimation

Maojing Fu, Marissa S. Barlaz, Ryan K. Shosted, Zhi Pei Liang, Bradley P. Sutton

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Dynamic speech magnetic resonance imaging (DSMRI) is a promising technique for visualizing articulatory motion in real time. However, many existing applications of DSMRI have been limited by slow imaging speed and the lack of quantitative motion analysis. In this paper, we present a novel DS-MRI technique to simultaneously estimate dynamic image sequence of speech and the associated deformation field. Extending on our previous Partial Separability (PS) model-based methods, the proposed technique visualizes both speech motion and deformation with a spatial resolution of 2.2 × 2.2 mm2 and a nominal frame rate of 100 fps. Also, the technique enables direct analysis of articulatory motion through the deformation fields. Effectiveness of the method is systematically examined via in vivo experiments. Utilizing the obtained high-resolution images and deformation fields, we also performed a phonetics study on Brazilian Portuguese to show the method's practical utility.

Original languageEnglish (US)
Title of host publication37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages1568-1571
Number of pages4
ISBN (Electronic)9781424492718
DOIs
StatePublished - Nov 4 2015
Event37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBC 2015 - Milan, Italy
Duration: Aug 25 2015Aug 29 2015

Publication series

NameProceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS
Volume2015-November
ISSN (Print)1557-170X

Other

Other37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBC 2015
CountryItaly
CityMilan
Period8/25/158/29/15

Fingerprint

Imaging techniques
Magnetic resonance
Magnetic Resonance Imaging
Phonetics
Speech analysis
Image resolution
Magnetic resonance imaging
Experiments
Motion analysis

ASJC Scopus subject areas

  • Signal Processing
  • Biomedical Engineering
  • Computer Vision and Pattern Recognition
  • Health Informatics

Cite this

Fu, M., Barlaz, M. S., Shosted, R. K., Liang, Z. P., & Sutton, B. P. (2015). High-resolution dynamic speech imaging with deformation estimation. In 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (pp. 1568-1571). [7318672] (Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS; Vol. 2015-November). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/EMBC.2015.7318672

High-resolution dynamic speech imaging with deformation estimation. / Fu, Maojing; Barlaz, Marissa S.; Shosted, Ryan K.; Liang, Zhi Pei; Sutton, Bradley P.

37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society. Institute of Electrical and Electronics Engineers Inc., 2015. p. 1568-1571 7318672 (Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS; Vol. 2015-November).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Fu, M, Barlaz, MS, Shosted, RK, Liang, ZP & Sutton, BP 2015, High-resolution dynamic speech imaging with deformation estimation. in 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society., 7318672, Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS, vol. 2015-November, Institute of Electrical and Electronics Engineers Inc., pp. 1568-1571, 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBC 2015, Milan, Italy, 8/25/15. https://doi.org/10.1109/EMBC.2015.7318672
Fu M, Barlaz MS, Shosted RK, Liang ZP, Sutton BP. High-resolution dynamic speech imaging with deformation estimation. In 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society. Institute of Electrical and Electronics Engineers Inc. 2015. p. 1568-1571. 7318672. (Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS). https://doi.org/10.1109/EMBC.2015.7318672
Fu, Maojing ; Barlaz, Marissa S. ; Shosted, Ryan K. ; Liang, Zhi Pei ; Sutton, Bradley P. / High-resolution dynamic speech imaging with deformation estimation. 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society. Institute of Electrical and Electronics Engineers Inc., 2015. pp. 1568-1571 (Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS).
@inproceedings{ae20222220614d46bfe9afcdc2615809,
title = "High-resolution dynamic speech imaging with deformation estimation",
abstract = "Dynamic speech magnetic resonance imaging (DSMRI) is a promising technique for visualizing articulatory motion in real time. However, many existing applications of DSMRI have been limited by slow imaging speed and the lack of quantitative motion analysis. In this paper, we present a novel DS-MRI technique to simultaneously estimate dynamic image sequence of speech and the associated deformation field. Extending on our previous Partial Separability (PS) model-based methods, the proposed technique visualizes both speech motion and deformation with a spatial resolution of 2.2 × 2.2 mm2 and a nominal frame rate of 100 fps. Also, the technique enables direct analysis of articulatory motion through the deformation fields. Effectiveness of the method is systematically examined via in vivo experiments. Utilizing the obtained high-resolution images and deformation fields, we also performed a phonetics study on Brazilian Portuguese to show the method's practical utility.",
author = "Maojing Fu and Barlaz, {Marissa S.} and Shosted, {Ryan K.} and Liang, {Zhi Pei} and Sutton, {Bradley P.}",
year = "2015",
month = "11",
day = "4",
doi = "10.1109/EMBC.2015.7318672",
language = "English (US)",
series = "Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
pages = "1568--1571",
booktitle = "37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society",
address = "United States",

}

TY - GEN

T1 - High-resolution dynamic speech imaging with deformation estimation

AU - Fu, Maojing

AU - Barlaz, Marissa S.

AU - Shosted, Ryan K.

AU - Liang, Zhi Pei

AU - Sutton, Bradley P.

PY - 2015/11/4

Y1 - 2015/11/4

N2 - Dynamic speech magnetic resonance imaging (DSMRI) is a promising technique for visualizing articulatory motion in real time. However, many existing applications of DSMRI have been limited by slow imaging speed and the lack of quantitative motion analysis. In this paper, we present a novel DS-MRI technique to simultaneously estimate dynamic image sequence of speech and the associated deformation field. Extending on our previous Partial Separability (PS) model-based methods, the proposed technique visualizes both speech motion and deformation with a spatial resolution of 2.2 × 2.2 mm2 and a nominal frame rate of 100 fps. Also, the technique enables direct analysis of articulatory motion through the deformation fields. Effectiveness of the method is systematically examined via in vivo experiments. Utilizing the obtained high-resolution images and deformation fields, we also performed a phonetics study on Brazilian Portuguese to show the method's practical utility.

AB - Dynamic speech magnetic resonance imaging (DSMRI) is a promising technique for visualizing articulatory motion in real time. However, many existing applications of DSMRI have been limited by slow imaging speed and the lack of quantitative motion analysis. In this paper, we present a novel DS-MRI technique to simultaneously estimate dynamic image sequence of speech and the associated deformation field. Extending on our previous Partial Separability (PS) model-based methods, the proposed technique visualizes both speech motion and deformation with a spatial resolution of 2.2 × 2.2 mm2 and a nominal frame rate of 100 fps. Also, the technique enables direct analysis of articulatory motion through the deformation fields. Effectiveness of the method is systematically examined via in vivo experiments. Utilizing the obtained high-resolution images and deformation fields, we also performed a phonetics study on Brazilian Portuguese to show the method's practical utility.

UR - http://www.scopus.com/inward/record.url?scp=84953341906&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84953341906&partnerID=8YFLogxK

U2 - 10.1109/EMBC.2015.7318672

DO - 10.1109/EMBC.2015.7318672

M3 - Conference contribution

C2 - 26736572

AN - SCOPUS:84953341906

T3 - Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS

SP - 1568

EP - 1571

BT - 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society

PB - Institute of Electrical and Electronics Engineers Inc.

ER -