Redefine the A in ABR for 360-degree Videos: A Flexible ABR Framework

Kuan Ying Lee, Andrrw Yoo, Jounsup Park, Klara Nahrstedt

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

360-degree video has been popular due to the immersive experience it provides to the viewer. While watching, viewer can control the field of view (FoV)1 In this paper, we use viewport interchangeably with FoV in the range of 360° by 180°. As this trend continues, adaptive bitrate (ABR) streaming is becoming a prevalent issue. Most existing ABR algorithms for 360 videos (360 ABR algorithms) require real-time head traces and certain computation resource from the client for streaming, which largely constrains the range of audience. Also, while more 360 ABR algorithms rely upon machine learning (ML) for viewport prediction, ML and ABR are research topics that grow mostly independently. In this paper, we propose a two-fold ABR algorithm for 360 video streaming that utilizes 1) an off-the-shelf ABR algorithm for ordinary videos, and 2) an off-the-shelf viewport prediction model. Our algorithm requires neither real-time head traces nor additional computation from the viewing device. In addition, it adapts easily to the newest developments in viewport prediction and ABR. As a consequence, the proposed method fits nicely to the existing streaming framework and any advancement in viewport prediction and ABR could enhance its performance. With the quantitative experiments, we demonstrate that the proposed method achieves twice the quality of experience (QoE) compared to the baseline.

Original languageEnglish (US)
Title of host publicationProceedings - 2020 IEEE International Symposium on Multimedia, ISM 2020
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages82-84
Number of pages3
ISBN (Electronic)9781728186979
DOIs
StatePublished - Dec 2020
Event22nd IEEE International Symposium on Multimedia, ISM 2020 - Virtual, Naples, Italy
Duration: Dec 2 2020Dec 4 2020

Publication series

NameProceedings - 2020 IEEE International Symposium on Multimedia, ISM 2020

Conference

Conference22nd IEEE International Symposium on Multimedia, ISM 2020
Country/TerritoryItaly
CityVirtual, Naples
Period12/2/2012/4/20

Keywords

  • 360°Video Streaming
  • Machine Learning

ASJC Scopus subject areas

  • Media Technology

Fingerprint

Dive into the research topics of 'Redefine the A in ABR for 360-degree Videos: A Flexible ABR Framework'. Together they form a unique fingerprint.

Cite this