Lap-Based Video Frame Interpolation

Tejas Jayashankar, Pierre Moulin, Thierry Blu, Chris Gilliam

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

High-quality video frame interpolation often necessitates accurate motion estimation, which can be obtained using modern optical flow methods. In this paper, we use the recently proposed Local All-Pass (LAP) algorithm to compute the optical flow between two consecutive frames. The resulting flow field is used to perform interpolation using cubic splines. We compare the interpolation results against a well-known optical flow estimation algorithm as well as against a recent con-volutional neural network scheme for video frame interpolation. Qualitative and quantitative results show that the LAP algorithm performs fast, high-quality video frame interpolation, and perceptually outperforms the neural network and the Lucas-Kanade method on a variety of test sequences.

Original languageEnglish (US)
Title of host publication2019 IEEE International Conference on Image Processing, ICIP 2019 - Proceedings
PublisherIEEE Computer Society
Pages4195-4199
Number of pages5
ISBN (Electronic)9781538662496
DOIs
StatePublished - Sep 2019
Event26th IEEE International Conference on Image Processing, ICIP 2019 - Taipei, Taiwan, Province of China
Duration: Sep 22 2019Sep 25 2019

Publication series

NameProceedings - International Conference on Image Processing, ICIP
Volume2019-September
ISSN (Print)1522-4880

Conference

Conference26th IEEE International Conference on Image Processing, ICIP 2019
CountryTaiwan, Province of China
CityTaipei
Period9/22/199/25/19

Keywords

  • Convolutional neural network
  • Lucas-Kanade algorithm
  • Optical flow
  • Splines
  • Video interpolation

ASJC Scopus subject areas

  • Software
  • Computer Vision and Pattern Recognition
  • Signal Processing

Fingerprint Dive into the research topics of 'Lap-Based Video Frame Interpolation'. Together they form a unique fingerprint.

  • Cite this

    Jayashankar, T., Moulin, P., Blu, T., & Gilliam, C. (2019). Lap-Based Video Frame Interpolation. In 2019 IEEE International Conference on Image Processing, ICIP 2019 - Proceedings (pp. 4195-4199). [8803484] (Proceedings - International Conference on Image Processing, ICIP; Vol. 2019-September). IEEE Computer Society. https://doi.org/10.1109/ICIP.2019.8803484