Activity-based synthesized frame generation in 3DTI video

Shannon Chen, Klara Nahrstedt

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

In view of the high resource demand of 3D Tele-immersion (3DTI), we propose a user activity-based resource adaptation scheme that adjusts the compression ratio of 3DTI videos according to the user activity. The compression technique we designed is based on the frame synthesis via feature-based morphing. This technique is customized for 3DTI video due to the special properties of its scenes and the depth information provided by the system. Via a machine learning approach, our system can classify the user's current activity and choose the most suitable priority among temporal resolution, spatial resolution, and resource consumption in the adaptation. Our results show that the resource saving can reach up to 25% without perceptible degradation of the 3DTI videos.

Original languageEnglish (US)
Title of host publication2013 IEEE International Conference on Multimedia and Expo, ICME 2013
DOIs
StatePublished - Oct 21 2013
Event2013 IEEE International Conference on Multimedia and Expo, ICME 2013 - San Jose, CA, United States
Duration: Jul 15 2013Jul 19 2013

Publication series

NameProceedings - IEEE International Conference on Multimedia and Expo
ISSN (Print)1945-7871
ISSN (Electronic)1945-788X

Other

Other2013 IEEE International Conference on Multimedia and Expo, ICME 2013
CountryUnited States
CitySan Jose, CA
Period7/15/137/19/13

Fingerprint

Learning systems
Degradation

Keywords

  • 3D tele-immersion
  • QoE
  • SVM
  • morphing
  • resource adaptation

ASJC Scopus subject areas

  • Computer Networks and Communications
  • Computer Science Applications

Cite this

Chen, S., & Nahrstedt, K. (2013). Activity-based synthesized frame generation in 3DTI video. In 2013 IEEE International Conference on Multimedia and Expo, ICME 2013 [6607586] (Proceedings - IEEE International Conference on Multimedia and Expo). https://doi.org/10.1109/ICME.2013.6607586

Activity-based synthesized frame generation in 3DTI video. / Chen, Shannon; Nahrstedt, Klara.

2013 IEEE International Conference on Multimedia and Expo, ICME 2013. 2013. 6607586 (Proceedings - IEEE International Conference on Multimedia and Expo).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Chen, S & Nahrstedt, K 2013, Activity-based synthesized frame generation in 3DTI video. in 2013 IEEE International Conference on Multimedia and Expo, ICME 2013., 6607586, Proceedings - IEEE International Conference on Multimedia and Expo, 2013 IEEE International Conference on Multimedia and Expo, ICME 2013, San Jose, CA, United States, 7/15/13. https://doi.org/10.1109/ICME.2013.6607586
Chen S, Nahrstedt K. Activity-based synthesized frame generation in 3DTI video. In 2013 IEEE International Conference on Multimedia and Expo, ICME 2013. 2013. 6607586. (Proceedings - IEEE International Conference on Multimedia and Expo). https://doi.org/10.1109/ICME.2013.6607586
Chen, Shannon ; Nahrstedt, Klara. / Activity-based synthesized frame generation in 3DTI video. 2013 IEEE International Conference on Multimedia and Expo, ICME 2013. 2013. (Proceedings - IEEE International Conference on Multimedia and Expo).
@inproceedings{7d916363b35d429499db723e3a6c75af,
title = "Activity-based synthesized frame generation in 3DTI video",
abstract = "In view of the high resource demand of 3D Tele-immersion (3DTI), we propose a user activity-based resource adaptation scheme that adjusts the compression ratio of 3DTI videos according to the user activity. The compression technique we designed is based on the frame synthesis via feature-based morphing. This technique is customized for 3DTI video due to the special properties of its scenes and the depth information provided by the system. Via a machine learning approach, our system can classify the user's current activity and choose the most suitable priority among temporal resolution, spatial resolution, and resource consumption in the adaptation. Our results show that the resource saving can reach up to 25{\%} without perceptible degradation of the 3DTI videos.",
keywords = "3D tele-immersion, QoE, SVM, morphing, resource adaptation",
author = "Shannon Chen and Klara Nahrstedt",
year = "2013",
month = "10",
day = "21",
doi = "10.1109/ICME.2013.6607586",
language = "English (US)",
isbn = "9781479900152",
series = "Proceedings - IEEE International Conference on Multimedia and Expo",
booktitle = "2013 IEEE International Conference on Multimedia and Expo, ICME 2013",

}

TY - GEN

T1 - Activity-based synthesized frame generation in 3DTI video

AU - Chen, Shannon

AU - Nahrstedt, Klara

PY - 2013/10/21

Y1 - 2013/10/21

N2 - In view of the high resource demand of 3D Tele-immersion (3DTI), we propose a user activity-based resource adaptation scheme that adjusts the compression ratio of 3DTI videos according to the user activity. The compression technique we designed is based on the frame synthesis via feature-based morphing. This technique is customized for 3DTI video due to the special properties of its scenes and the depth information provided by the system. Via a machine learning approach, our system can classify the user's current activity and choose the most suitable priority among temporal resolution, spatial resolution, and resource consumption in the adaptation. Our results show that the resource saving can reach up to 25% without perceptible degradation of the 3DTI videos.

AB - In view of the high resource demand of 3D Tele-immersion (3DTI), we propose a user activity-based resource adaptation scheme that adjusts the compression ratio of 3DTI videos according to the user activity. The compression technique we designed is based on the frame synthesis via feature-based morphing. This technique is customized for 3DTI video due to the special properties of its scenes and the depth information provided by the system. Via a machine learning approach, our system can classify the user's current activity and choose the most suitable priority among temporal resolution, spatial resolution, and resource consumption in the adaptation. Our results show that the resource saving can reach up to 25% without perceptible degradation of the 3DTI videos.

KW - 3D tele-immersion

KW - QoE

KW - SVM

KW - morphing

KW - resource adaptation

UR - http://www.scopus.com/inward/record.url?scp=84885632542&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84885632542&partnerID=8YFLogxK

U2 - 10.1109/ICME.2013.6607586

DO - 10.1109/ICME.2013.6607586

M3 - Conference contribution

AN - SCOPUS:84885632542

SN - 9781479900152

T3 - Proceedings - IEEE International Conference on Multimedia and Expo

BT - 2013 IEEE International Conference on Multimedia and Expo, ICME 2013

ER -