TY - GEN
T1 - A multi-stream adaptation framework for bandwidth management in 3D tele-immersion
AU - Yang, Zhenyu
AU - Yu, Bin
AU - Nahrstedt, Klara
AU - Bajscy, Ruzena
PY - 2006
Y1 - 2006
N2 - Tele-immersive environments will improve the state of collaboration among distributed participants. However, along with the promise a new set of challenges have emerged including the real-time acquisition, streaming and rendering of 3D scenes to convey a realistic sense of immersive spaces. Unlike 2D video conferencing, a 3D tele-immersive environment employs multiple 3D cameras to cover a much wider field of view, thus generating a very large volume of data that need to be carefully coordinated, organized, and synchronized for Internet transmission, rendering and display. This is a challenging task and a dynamic bandwidth management must be in place. To achieve this goal, we propose a multi-stream adaptation framework for bandwidth management in 3D tele-immersion. The adaptation framework relies on the hierarchy of mechanisms and services that exploits the semantic link of multiple 3D video streams in the tele-immersive environment. We implement a prototype of the framework that integrates semantic stream selection, content adaptation, and 3D data compression services with user preference. The experimental results have demonstrated that the framework shows a good quality of the resulting composite 3D rendered video in case of sufficient bandwidth, while it adapts individual 3D video streams in a coordinated and user-friendly fashion, and yields graceful quality degradation in case of low bandwidth availability.
AB - Tele-immersive environments will improve the state of collaboration among distributed participants. However, along with the promise a new set of challenges have emerged including the real-time acquisition, streaming and rendering of 3D scenes to convey a realistic sense of immersive spaces. Unlike 2D video conferencing, a 3D tele-immersive environment employs multiple 3D cameras to cover a much wider field of view, thus generating a very large volume of data that need to be carefully coordinated, organized, and synchronized for Internet transmission, rendering and display. This is a challenging task and a dynamic bandwidth management must be in place. To achieve this goal, we propose a multi-stream adaptation framework for bandwidth management in 3D tele-immersion. The adaptation framework relies on the hierarchy of mechanisms and services that exploits the semantic link of multiple 3D video streams in the tele-immersive environment. We implement a prototype of the framework that integrates semantic stream selection, content adaptation, and 3D data compression services with user preference. The experimental results have demonstrated that the framework shows a good quality of the resulting composite 3D rendered video in case of sufficient bandwidth, while it adapts individual 3D video streams in a coordinated and user-friendly fashion, and yields graceful quality degradation in case of low bandwidth availability.
KW - 3d tele-immersion
KW - Adaptation
KW - Bandwidth management
UR - http://www.scopus.com/inward/record.url?scp=57249091549&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=57249091549&partnerID=8YFLogxK
U2 - 10.1145/1378191.1378209
DO - 10.1145/1378191.1378209
M3 - Conference contribution
AN - SCOPUS:57249091549
SN - 1595932852
SN - 9781595932853
T3 - Proceedings of the International Workshop on Network and Operating System Support for Digital Audio and Video
BT - Proceedings of the 16th Annual International Workshop on Network and Operating Systems Support for Digital Audio and Video, NOSSDAV 2006
T2 - 16th Annual International Workshop on Network and Operating Systems Support for Digital Audio and Video, NOSSDAV 2006
Y2 - 22 May 2006 through 23 May 2006
ER -