High-resolution dynamic speech imaging with joint low-rank and sparsity constraints

Maojing Fu, Bo Zhao, Christopher Carignan, Ryan K. Shosted, Jamie L. Perry, David P. Kuehn, Zhi Pei Liang, Bradley P. Sutton

Research output: Contribution to journalArticle

Abstract

Purpose To enable dynamic speech imaging with high spatiotemporal resolution and full-vocal-tract spatial coverage, leveraging recent advances in sparse sampling. Methods An imaging method is developed to enable high-speed dynamic speech imaging exploiting low-rank and sparsity of the dynamic images of articulatory motion during speech. The proposed method includes: (a) a novel data acquisition strategy that collects spiral navigators with high temporal frame rate and (b) an image reconstruction method that derives temporal subspaces from navigators and reconstructs high-resolution images from sparsely sampled data with joint low-rank and sparsity constraints. Results The proposed method has been systematically evaluated and validated through several dynamic speech experiments. A nominal imaging speed of 102 frames per second (fps) was achieved for a single-slice imaging protocol with a spatial resolution of 2.2 × 2.2 × 6.5 mm3. An eight-slice imaging protocol covering the entire vocal tract achieved a nominal imaging speed of 12.8 fps with the identical spatial resolution. The effectiveness of the proposed method and its practical utility was also demonstrated in a phonetic investigation. Conclusion High spatiotemporal resolution with full-vocal-tract spatial coverage can be achieved for dynamic speech imaging experiments with low-rank and sparsity constraints. Magn Reson Med 73:1820-1832, 2015.

Original languageEnglish (US)
Pages (from-to)1820-1832
Number of pages13
JournalMagnetic Resonance in Medicine
Volume73
Issue number5
DOIs
StatePublished - May 1 2015

Fingerprint

Joints
Phonetics
Computer-Assisted Image Processing

Keywords

  • dynamic speech imaging
  • low-rank approximation
  • partial separability modeling
  • sparsity
  • spiral navigation

ASJC Scopus subject areas

  • Radiology Nuclear Medicine and imaging

Cite this

High-resolution dynamic speech imaging with joint low-rank and sparsity constraints. / Fu, Maojing; Zhao, Bo; Carignan, Christopher; Shosted, Ryan K.; Perry, Jamie L.; Kuehn, David P.; Liang, Zhi Pei; Sutton, Bradley P.

In: Magnetic Resonance in Medicine, Vol. 73, No. 5, 01.05.2015, p. 1820-1832.

Research output: Contribution to journalArticle

Fu, Maojing ; Zhao, Bo ; Carignan, Christopher ; Shosted, Ryan K. ; Perry, Jamie L. ; Kuehn, David P. ; Liang, Zhi Pei ; Sutton, Bradley P. / High-resolution dynamic speech imaging with joint low-rank and sparsity constraints. In: Magnetic Resonance in Medicine. 2015 ; Vol. 73, No. 5. pp. 1820-1832.
@article{913971a7b3354b34bd95a4b99371dccf,
title = "High-resolution dynamic speech imaging with joint low-rank and sparsity constraints",
abstract = "Purpose To enable dynamic speech imaging with high spatiotemporal resolution and full-vocal-tract spatial coverage, leveraging recent advances in sparse sampling. Methods An imaging method is developed to enable high-speed dynamic speech imaging exploiting low-rank and sparsity of the dynamic images of articulatory motion during speech. The proposed method includes: (a) a novel data acquisition strategy that collects spiral navigators with high temporal frame rate and (b) an image reconstruction method that derives temporal subspaces from navigators and reconstructs high-resolution images from sparsely sampled data with joint low-rank and sparsity constraints. Results The proposed method has been systematically evaluated and validated through several dynamic speech experiments. A nominal imaging speed of 102 frames per second (fps) was achieved for a single-slice imaging protocol with a spatial resolution of 2.2 × 2.2 × 6.5 mm3. An eight-slice imaging protocol covering the entire vocal tract achieved a nominal imaging speed of 12.8 fps with the identical spatial resolution. The effectiveness of the proposed method and its practical utility was also demonstrated in a phonetic investigation. Conclusion High spatiotemporal resolution with full-vocal-tract spatial coverage can be achieved for dynamic speech imaging experiments with low-rank and sparsity constraints. Magn Reson Med 73:1820-1832, 2015.",
keywords = "dynamic speech imaging, low-rank approximation, partial separability modeling, sparsity, spiral navigation",
author = "Maojing Fu and Bo Zhao and Christopher Carignan and Shosted, {Ryan K.} and Perry, {Jamie L.} and Kuehn, {David P.} and Liang, {Zhi Pei} and Sutton, {Bradley P.}",
year = "2015",
month = "5",
day = "1",
doi = "10.1002/mrm.25302",
language = "English (US)",
volume = "73",
pages = "1820--1832",
journal = "Magnetic Resonance in Medicine",
issn = "0740-3194",
publisher = "John Wiley and Sons Inc.",
number = "5",

}

TY - JOUR

T1 - High-resolution dynamic speech imaging with joint low-rank and sparsity constraints

AU - Fu, Maojing

AU - Zhao, Bo

AU - Carignan, Christopher

AU - Shosted, Ryan K.

AU - Perry, Jamie L.

AU - Kuehn, David P.

AU - Liang, Zhi Pei

AU - Sutton, Bradley P.

PY - 2015/5/1

Y1 - 2015/5/1

N2 - Purpose To enable dynamic speech imaging with high spatiotemporal resolution and full-vocal-tract spatial coverage, leveraging recent advances in sparse sampling. Methods An imaging method is developed to enable high-speed dynamic speech imaging exploiting low-rank and sparsity of the dynamic images of articulatory motion during speech. The proposed method includes: (a) a novel data acquisition strategy that collects spiral navigators with high temporal frame rate and (b) an image reconstruction method that derives temporal subspaces from navigators and reconstructs high-resolution images from sparsely sampled data with joint low-rank and sparsity constraints. Results The proposed method has been systematically evaluated and validated through several dynamic speech experiments. A nominal imaging speed of 102 frames per second (fps) was achieved for a single-slice imaging protocol with a spatial resolution of 2.2 × 2.2 × 6.5 mm3. An eight-slice imaging protocol covering the entire vocal tract achieved a nominal imaging speed of 12.8 fps with the identical spatial resolution. The effectiveness of the proposed method and its practical utility was also demonstrated in a phonetic investigation. Conclusion High spatiotemporal resolution with full-vocal-tract spatial coverage can be achieved for dynamic speech imaging experiments with low-rank and sparsity constraints. Magn Reson Med 73:1820-1832, 2015.

AB - Purpose To enable dynamic speech imaging with high spatiotemporal resolution and full-vocal-tract spatial coverage, leveraging recent advances in sparse sampling. Methods An imaging method is developed to enable high-speed dynamic speech imaging exploiting low-rank and sparsity of the dynamic images of articulatory motion during speech. The proposed method includes: (a) a novel data acquisition strategy that collects spiral navigators with high temporal frame rate and (b) an image reconstruction method that derives temporal subspaces from navigators and reconstructs high-resolution images from sparsely sampled data with joint low-rank and sparsity constraints. Results The proposed method has been systematically evaluated and validated through several dynamic speech experiments. A nominal imaging speed of 102 frames per second (fps) was achieved for a single-slice imaging protocol with a spatial resolution of 2.2 × 2.2 × 6.5 mm3. An eight-slice imaging protocol covering the entire vocal tract achieved a nominal imaging speed of 12.8 fps with the identical spatial resolution. The effectiveness of the proposed method and its practical utility was also demonstrated in a phonetic investigation. Conclusion High spatiotemporal resolution with full-vocal-tract spatial coverage can be achieved for dynamic speech imaging experiments with low-rank and sparsity constraints. Magn Reson Med 73:1820-1832, 2015.

KW - dynamic speech imaging

KW - low-rank approximation

KW - partial separability modeling

KW - sparsity

KW - spiral navigation

UR - http://www.scopus.com/inward/record.url?scp=84928078144&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84928078144&partnerID=8YFLogxK

U2 - 10.1002/mrm.25302

DO - 10.1002/mrm.25302

M3 - Article

C2 - 24912452

AN - SCOPUS:84928078144

VL - 73

SP - 1820

EP - 1832

JO - Magnetic Resonance in Medicine

JF - Magnetic Resonance in Medicine

SN - 0740-3194

IS - 5

ER -