FMRI data augmentation via synthesis

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

We present an empirical evaluation of fMRI data augmentation via synthesis. For synthesis we use generative models trained on real neuroimaging data to produce novel task-dependent functional brain images. Analyzed generative models include classic approaches such as the Gaussian mixture model (GMM), and modern implicit generative models such as the generative adversarial network (GAN) and the variational autoencoder (VAE). In particular, the proposed GAN and VAE models utilize 3-dimensional convolutions, which enables modeling of high-dimensional brain image tensors with structured spatial correlations. The synthesized datasets are then used to augment classifiers designed to predict cognitive and behavioural outcomes. Our results suggest that the proposed models are able to generate high-quality synthetic brain images which are diverse and task-dependent. Perhaps most importantly, the performance improvements of data augmentation via synthesis are shown to be complementary to the choice of the predictive model. Thus, our results suggest that data augmentation via synthesis is a promising approach to address the limited availability of fMRI data, and to improve the quality of predictive fMRI models.

Original languageEnglish (US)
Title of host publicationISBI 2019 - 2019 IEEE International Symposium on Biomedical Imaging
PublisherIEEE Computer Society
Pages1783-1787
Number of pages5
ISBN (Electronic)9781538636411
DOIs
StatePublished - Apr 2019
Event16th IEEE International Symposium on Biomedical Imaging, ISBI 2019 - Venice, Italy
Duration: Apr 8 2019Apr 11 2019

Publication series

NameProceedings - International Symposium on Biomedical Imaging
Volume2019-April
ISSN (Print)1945-7928
ISSN (Electronic)1945-8452

Conference

Conference16th IEEE International Symposium on Biomedical Imaging, ISBI 2019
CountryItaly
CityVenice
Period4/8/194/11/19

Keywords

  • FMRI generation
  • GANs
  • GMMs
  • VAEs

ASJC Scopus subject areas

  • Biomedical Engineering
  • Radiology Nuclear Medicine and imaging

Fingerprint Dive into the research topics of 'FMRI data augmentation via synthesis'. Together they form a unique fingerprint.

  • Cite this

    Zhuang, P., Schwing, A. G., & Koyejo, O. (2019). FMRI data augmentation via synthesis. In ISBI 2019 - 2019 IEEE International Symposium on Biomedical Imaging (pp. 1783-1787). [8759585] (Proceedings - International Symposium on Biomedical Imaging; Vol. 2019-April). IEEE Computer Society. https://doi.org/10.1109/ISBI.2019.8759585