Activity-based synthesized frame generation in 3DTI video

Shannon Chen, Klara Nahrstedt

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

In view of the high resource demand of 3D Tele-immersion (3DTI), we propose a user activity-based resource adaptation scheme that adjusts the compression ratio of 3DTI videos according to the user activity. The compression technique we designed is based on the frame synthesis via feature-based morphing. This technique is customized for 3DTI video due to the special properties of its scenes and the depth information provided by the system. Via a machine learning approach, our system can classify the user's current activity and choose the most suitable priority among temporal resolution, spatial resolution, and resource consumption in the adaptation. Our results show that the resource saving can reach up to 25% without perceptible degradation of the 3DTI videos.

Original languageEnglish (US)
Title of host publication2013 IEEE International Conference on Multimedia and Expo, ICME 2013
DOIs
StatePublished - 2013
Event2013 IEEE International Conference on Multimedia and Expo, ICME 2013 - San Jose, CA, United States
Duration: Jul 15 2013Jul 19 2013

Publication series

NameProceedings - IEEE International Conference on Multimedia and Expo
ISSN (Print)1945-7871
ISSN (Electronic)1945-788X

Other

Other2013 IEEE International Conference on Multimedia and Expo, ICME 2013
Country/TerritoryUnited States
CitySan Jose, CA
Period7/15/137/19/13

Keywords

  • 3D tele-immersion
  • QoE
  • SVM
  • morphing
  • resource adaptation

ASJC Scopus subject areas

  • Computer Networks and Communications
  • Computer Science Applications

Fingerprint

Dive into the research topics of 'Activity-based synthesized frame generation in 3DTI video'. Together they form a unique fingerprint.

Cite this