An Adversarial Learning Based Approach for 2D Unknown View Tomography

Mona Zehni, Zhizhen Zhao

Research output: Contribution to journalArticlepeer-review

Abstract

The goal of 2D tomography is to recover an image given its projections from various views. It is often presumed that viewing angles associated with the projections are known in advance. Under certain situations, however, these angles are known only approximately or are completely unknown. It becomes more challenging to reconstruct the image from a collection of random projections with unknown viewing directions. We propose an adversarial learning based approach to recover the image and the viewing angle distribution by matching the empirical distribution of the measurements with the generated data. Fitting the distributions is achieved through solving a min-max game between a generator and a critic based on Wasserstein generative adversarial network structure. To accommodate the update of the viewing angle distribution through gradient back propagation, we approximate the loss using the Gumbel-Softmax reparameterization of samples from discrete distributions. Our theoretical analysis verifies the unique recovery of the image and the projection distribution up to a rotation and reflection upon convergence. Our extensive numerical experiments showcase the potential of our method to accurately recover the image and the viewing angle distribution under noise contamination.

Original languageEnglish (US)
Pages (from-to)705-720
Number of pages16
JournalIEEE Transactions on Computational Imaging
Volume8
DOIs
StatePublished - 2022

Keywords

  • 2D unknown view tomography
  • Gumbel-softmax
  • Hartley-Bessel expansion
  • categorical distribution
  • generative adversarial learning

ASJC Scopus subject areas

  • Signal Processing
  • Computer Science Applications
  • Computational Mathematics

Fingerprint

Dive into the research topics of 'An Adversarial Learning Based Approach for 2D Unknown View Tomography'. Together they form a unique fingerprint.

Cite this