Semantic-aware virtual reality video streaming

Yue Leng, Chi Chun Chen, Qiuyue Sun, Jian Huang, Yuhao Zhu

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Virtual reality (VR) technologies have huge potential to enable radically new applications, among which spherical panoramic (a.k.a., 360°) video streaming is on the verge of hitting the critical mass. Current VR systems treat 360° VR content as plain RGB pixels, similar to conventional planar frames, resulting in significant waste in data transfer and client-side processing. In this paper, we make the case that next-generation VR platforms can take advantage of semantics information inherent to VR content so as to improve the streaming and processing efficiency. To that end, we present SVR, a semantic-aware VR system that utilizes the object information in VR frames for content indexing and streaming. SVR exploits the key observation that end-users' viewing behaviors tend to be object-oriented. Instead of streaming entire frames, SVR delivers miniature frames that cover only the tracked visual objects in VR videos. We implement SVR prototype with a real hardware board and demonstrate that it achieves up to 34% network bandwidth reduction along with 21% device power saving.

Original languageEnglish (US)
Title of host publicationProceedings of the 9th Asia-Pacific Workshop on Systems, APSys 2018
PublisherAssociation for Computing Machinery, Inc
ISBN (Electronic)9781450360067
DOIs
StatePublished - Aug 27 2018
Event9th Asia-Pacific Workshop on Systems, APSys 2018 - Jeju Island, Korea, Republic of
Duration: Aug 27 2018Aug 28 2018

Publication series

NameProceedings of the 9th Asia-Pacific Workshop on Systems, APSys 2018

Conference

Conference9th Asia-Pacific Workshop on Systems, APSys 2018
CountryKorea, Republic of
CityJeju Island
Period8/27/188/28/18

ASJC Scopus subject areas

  • Hardware and Architecture
  • Computer Networks and Communications

Fingerprint Dive into the research topics of 'Semantic-aware virtual reality video streaming'. Together they form a unique fingerprint.

Cite this