A multi-stream adaptation framework for bandwidth management in 3D tele-immersion

Zhenyu Yang, Bin Yu, Klara Nahrstedt, Ruzena Bajscy

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Tele-immersive environments will improve the state of collaboration among distributed participants. However, along with the promise a new set of challenges have emerged including the real-time acquisition, streaming and rendering of 3D scenes to convey a realistic sense of immersive spaces. Unlike 2D video conferencing, a 3D tele-immersive environment employs multiple 3D cameras to cover a much wider field of view, thus generating a very large volume of data that need to be carefully coordinated, organized, and synchronized for Internet transmission, rendering and display. This is a challenging task and a dynamic bandwidth management must be in place. To achieve this goal, we propose a multi-stream adaptation framework for bandwidth management in 3D tele-immersion. The adaptation framework relies on the hierarchy of mechanisms and services that exploits the semantic link of multiple 3D video streams in the tele-immersive environment. We implement a prototype of the framework that integrates semantic stream selection, content adaptation, and 3D data compression services with user preference. The experimental results have demonstrated that the framework shows a good quality of the resulting composite 3D rendered video in case of sufficient bandwidth, while it adapts individual 3D video streams in a coordinated and user-friendly fashion, and yields graceful quality degradation in case of low bandwidth availability.

Original languageEnglish (US)
Title of host publicationProceedings of the 16th Annual International Workshop on Network and Operating Systems Support for Digital Audio and Video, NOSSDAV 2006
DOIs
StatePublished - 2006
Event16th Annual International Workshop on Network and Operating Systems Support for Digital Audio and Video, NOSSDAV 2006 - Newport, RI, United States
Duration: May 22 2006May 23 2006

Publication series

NameProceedings of the International Workshop on Network and Operating System Support for Digital Audio and Video

Other

Other16th Annual International Workshop on Network and Operating Systems Support for Digital Audio and Video, NOSSDAV 2006
Country/TerritoryUnited States
CityNewport, RI
Period5/22/065/23/06

Keywords

  • 3d tele-immersion
  • Adaptation
  • Bandwidth management

ASJC Scopus subject areas

  • Software
  • Media Technology
  • Computer Networks and Communications

Fingerprint

Dive into the research topics of 'A multi-stream adaptation framework for bandwidth management in 3D tele-immersion'. Together they form a unique fingerprint.

Cite this