Image Restoration with Deep Generative Models

Raymond A. Yeh; Teck Yian Lim; Chen Chen; Alexander G. Schwing; Mark Hasegawa-Johnson; Minhn Do

doi:10.1109/ICASSP.2018.8462317

Image Restoration with Deep Generative Models

Raymond A. Yeh, Teck Yian Lim, Chen Chen, Alexander G. Schwing, Mark Hasegawa-Johnson, Minhn Do

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Abstract

Many image restoration problems are ill-posed in nature, hence, beyond the input image, most existing methods rely on a carefully engineered image prior, which enforces some local image consistency in the recovered image. How tightly the prior assumptions are fulfilled has a big impact on the resulting task performance. To obtain more flexibility, in this work, we proposed to design the image prior in a data-driven manner. Instead of explicitly defining the prior, we learn it using deep generative models. We demonstrate that this learned prior can be applied to many image restoration problems using an unified framework.

Original language	English (US)
Title of host publication	2018 IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP 2018 - Proceedings
Publisher	Institute of Electrical and Electronics Engineers Inc.
Pages	6772-6776
Number of pages	5
ISBN (Print)	9781538646588
DOIs	https://doi.org/10.1109/ICASSP.2018.8462317
State	Published - Sep 10 2018
Event	2018 IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP 2018 - Calgary, Canada Duration: Apr 15 2018 → Apr 20 2018

Publication series

Name	ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings
Volume	2018-April
ISSN (Print)	1520-6149

Other

Other	2018 IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP 2018
Country/Territory	Canada
City	Calgary
Period	4/15/18 → 4/20/18

Keywords

Deep generative models
Generative adversarial networks
Image restoration

ASJC Scopus subject areas

Software
Signal Processing
Electrical and Electronic Engineering

Online availability

10.1109/ICASSP.2018.8462317

Library availability

Discover UIUC Full Text

Cite this

Yeh, R. A., Lim, T. Y., Chen, C., Schwing, A. G., Hasegawa-Johnson, M., & Do, M. (2018). Image Restoration with Deep Generative Models. In 2018 IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP 2018 - Proceedings (pp. 6772-6776). Article 8462317 (ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings; Vol. 2018-April). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/ICASSP.2018.8462317

Image Restoration with Deep Generative Models. / Yeh, Raymond A.; Lim, Teck Yian; Chen, Chen et al.
2018 IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP 2018 - Proceedings. Institute of Electrical and Electronics Engineers Inc., 2018. p. 6772-6776 8462317 (ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings; Vol. 2018-April).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Yeh, RA, Lim, TY, Chen, C, Schwing, AG , Hasegawa-Johnson, M & Do, M 2018, Image Restoration with Deep Generative Models. in 2018 IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP 2018 - Proceedings., 8462317, ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings, vol. 2018-April, Institute of Electrical and Electronics Engineers Inc., pp. 6772-6776, 2018 IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP 2018, Calgary, Canada, 4/15/18. https://doi.org/10.1109/ICASSP.2018.8462317

Yeh RA, Lim TY, Chen C, Schwing AG , Hasegawa-Johnson M , Do M. Image Restoration with Deep Generative Models. In 2018 IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP 2018 - Proceedings. Institute of Electrical and Electronics Engineers Inc. 2018. p. 6772-6776. 8462317. (ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings). doi: 10.1109/ICASSP.2018.8462317

Yeh, Raymond A. ; Lim, Teck Yian ; Chen, Chen et al. / Image Restoration with Deep Generative Models. 2018 IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP 2018 - Proceedings. Institute of Electrical and Electronics Engineers Inc., 2018. pp. 6772-6776 (ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings).

@inproceedings{ae0fc58d24584ca3ba6e711cb39aaf66,

title = "Image Restoration with Deep Generative Models",

abstract = "Many image restoration problems are ill-posed in nature, hence, beyond the input image, most existing methods rely on a carefully engineered image prior, which enforces some local image consistency in the recovered image. How tightly the prior assumptions are fulfilled has a big impact on the resulting task performance. To obtain more flexibility, in this work, we proposed to design the image prior in a data-driven manner. Instead of explicitly defining the prior, we learn it using deep generative models. We demonstrate that this learned prior can be applied to many image restoration problems using an unified framework.",

keywords = "Deep generative models, Generative adversarial networks, Image restoration",

author = "Yeh, {Raymond A.} and Lim, {Teck Yian} and Chen Chen and Schwing, {Alexander G.} and Mark Hasegawa-Johnson and Minhn Do",

note = "Publisher Copyright: {\textcopyright} 2018 IEEE.; 2018 IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP 2018 ; Conference date: 15-04-2018 Through 20-04-2018",

year = "2018",

month = sep,

day = "10",

doi = "10.1109/ICASSP.2018.8462317",

language = "English (US)",

isbn = "9781538646588",

series = "ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

pages = "6772--6776",

booktitle = "2018 IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP 2018 - Proceedings",

address = "United States",

}

TY - GEN

T1 - Image Restoration with Deep Generative Models

AU - Yeh, Raymond A.

AU - Lim, Teck Yian

AU - Chen, Chen

AU - Schwing, Alexander G.

AU - Hasegawa-Johnson, Mark

AU - Do, Minhn

PY - 2018/9/10

Y1 - 2018/9/10

N2 - Many image restoration problems are ill-posed in nature, hence, beyond the input image, most existing methods rely on a carefully engineered image prior, which enforces some local image consistency in the recovered image. How tightly the prior assumptions are fulfilled has a big impact on the resulting task performance. To obtain more flexibility, in this work, we proposed to design the image prior in a data-driven manner. Instead of explicitly defining the prior, we learn it using deep generative models. We demonstrate that this learned prior can be applied to many image restoration problems using an unified framework.

AB - Many image restoration problems are ill-posed in nature, hence, beyond the input image, most existing methods rely on a carefully engineered image prior, which enforces some local image consistency in the recovered image. How tightly the prior assumptions are fulfilled has a big impact on the resulting task performance. To obtain more flexibility, in this work, we proposed to design the image prior in a data-driven manner. Instead of explicitly defining the prior, we learn it using deep generative models. We demonstrate that this learned prior can be applied to many image restoration problems using an unified framework.

KW - Deep generative models

KW - Generative adversarial networks

KW - Image restoration

UR - http://www.scopus.com/inward/record.url?scp=85054209504&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85054209504&partnerID=8YFLogxK

U2 - 10.1109/ICASSP.2018.8462317

DO - 10.1109/ICASSP.2018.8462317

M3 - Conference contribution

AN - SCOPUS:85054209504

SN - 9781538646588

T3 - ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings

SP - 6772

EP - 6776

BT - 2018 IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP 2018 - Proceedings

PB - Institute of Electrical and Electronics Engineers Inc.

T2 - 2018 IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP 2018

Y2 - 15 April 2018 through 20 April 2018

ER -

Image Restoration with Deep Generative Models

Abstract

Publication series

Other

Keywords

ASJC Scopus subject areas

Online availability

Library availability

Related links

Fingerprint

Cite this