TSync: A new synchronization framework for multi-site 3D tele-immersion

Zixia Huang, Wanmin Wu, Klara Nahrstedt, Ahsan Arefin, Raoul Rivas

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Synchronization is a challenge in the multi-site 3D tele-immersion (3DTI) because it is complicated by the coexistence of highly correlated heterogenous streams from multiple sources, and the need for multi-stream resynchronization when user views change. To address the problems, we present TSync: a new multi-tier synchronization framework for 3DTI which can effectively reduce the multi-stream sync skews. Our contributions are focusing on (1) the use of timed synchronization points for multi-stream synchronization; (2) Internet bandwidth estimation based on machine learning; (3) the cooperative frame rate allocation for correlated multi-streams and (4) the resynchronization protocol used when user views change. Experimental results show that TSync can successfully achieve the synchronization of multi-source heterogeneous streams in 3DTI under Internet dynamics.

Original languageEnglish (US)
Title of host publicationNOSSDAV'10 - Proceedings of the 20th International Workshop on Network and Operating Systems Support for Digital Audio and Video
Pages39-44
Number of pages6
DOIs
StatePublished - Jul 23 2010
Event20th ACM Workshop on Network and Operating System Support for Digital Audio and Video, NOSSDAV 2010 - Amsterdam, Netherlands
Duration: Jun 2 2010Jun 4 2010

Publication series

NameProceedings of the International Workshop on Network and Operating System Support for Digital Audio and Video

Other

Other20th ACM Workshop on Network and Operating System Support for Digital Audio and Video, NOSSDAV 2010
CountryNetherlands
CityAmsterdam
Period6/2/106/4/10

Fingerprint

Synchronization
Internet
Learning systems
Bandwidth
Network protocols

Keywords

  • 3d tele-immersion
  • synchronization

ASJC Scopus subject areas

  • Software
  • Media Technology
  • Computer Networks and Communications

Cite this

Huang, Z., Wu, W., Nahrstedt, K., Arefin, A., & Rivas, R. (2010). TSync: A new synchronization framework for multi-site 3D tele-immersion. In NOSSDAV'10 - Proceedings of the 20th International Workshop on Network and Operating Systems Support for Digital Audio and Video (pp. 39-44). (Proceedings of the International Workshop on Network and Operating System Support for Digital Audio and Video). https://doi.org/10.1145/1806565.1806577

TSync : A new synchronization framework for multi-site 3D tele-immersion. / Huang, Zixia; Wu, Wanmin; Nahrstedt, Klara; Arefin, Ahsan; Rivas, Raoul.

NOSSDAV'10 - Proceedings of the 20th International Workshop on Network and Operating Systems Support for Digital Audio and Video. 2010. p. 39-44 (Proceedings of the International Workshop on Network and Operating System Support for Digital Audio and Video).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Huang, Z, Wu, W, Nahrstedt, K, Arefin, A & Rivas, R 2010, TSync: A new synchronization framework for multi-site 3D tele-immersion. in NOSSDAV'10 - Proceedings of the 20th International Workshop on Network and Operating Systems Support for Digital Audio and Video. Proceedings of the International Workshop on Network and Operating System Support for Digital Audio and Video, pp. 39-44, 20th ACM Workshop on Network and Operating System Support for Digital Audio and Video, NOSSDAV 2010, Amsterdam, Netherlands, 6/2/10. https://doi.org/10.1145/1806565.1806577
Huang Z, Wu W, Nahrstedt K, Arefin A, Rivas R. TSync: A new synchronization framework for multi-site 3D tele-immersion. In NOSSDAV'10 - Proceedings of the 20th International Workshop on Network and Operating Systems Support for Digital Audio and Video. 2010. p. 39-44. (Proceedings of the International Workshop on Network and Operating System Support for Digital Audio and Video). https://doi.org/10.1145/1806565.1806577
Huang, Zixia ; Wu, Wanmin ; Nahrstedt, Klara ; Arefin, Ahsan ; Rivas, Raoul. / TSync : A new synchronization framework for multi-site 3D tele-immersion. NOSSDAV'10 - Proceedings of the 20th International Workshop on Network and Operating Systems Support for Digital Audio and Video. 2010. pp. 39-44 (Proceedings of the International Workshop on Network and Operating System Support for Digital Audio and Video).
@inproceedings{f526e9c8283a43db93143fce2700334d,
title = "TSync: A new synchronization framework for multi-site 3D tele-immersion",
abstract = "Synchronization is a challenge in the multi-site 3D tele-immersion (3DTI) because it is complicated by the coexistence of highly correlated heterogenous streams from multiple sources, and the need for multi-stream resynchronization when user views change. To address the problems, we present TSync: a new multi-tier synchronization framework for 3DTI which can effectively reduce the multi-stream sync skews. Our contributions are focusing on (1) the use of timed synchronization points for multi-stream synchronization; (2) Internet bandwidth estimation based on machine learning; (3) the cooperative frame rate allocation for correlated multi-streams and (4) the resynchronization protocol used when user views change. Experimental results show that TSync can successfully achieve the synchronization of multi-source heterogeneous streams in 3DTI under Internet dynamics.",
keywords = "3d tele-immersion, synchronization",
author = "Zixia Huang and Wanmin Wu and Klara Nahrstedt and Ahsan Arefin and Raoul Rivas",
year = "2010",
month = "7",
day = "23",
doi = "10.1145/1806565.1806577",
language = "English (US)",
isbn = "9781450300438",
series = "Proceedings of the International Workshop on Network and Operating System Support for Digital Audio and Video",
pages = "39--44",
booktitle = "NOSSDAV'10 - Proceedings of the 20th International Workshop on Network and Operating Systems Support for Digital Audio and Video",

}

TY - GEN

T1 - TSync

T2 - A new synchronization framework for multi-site 3D tele-immersion

AU - Huang, Zixia

AU - Wu, Wanmin

AU - Nahrstedt, Klara

AU - Arefin, Ahsan

AU - Rivas, Raoul

PY - 2010/7/23

Y1 - 2010/7/23

N2 - Synchronization is a challenge in the multi-site 3D tele-immersion (3DTI) because it is complicated by the coexistence of highly correlated heterogenous streams from multiple sources, and the need for multi-stream resynchronization when user views change. To address the problems, we present TSync: a new multi-tier synchronization framework for 3DTI which can effectively reduce the multi-stream sync skews. Our contributions are focusing on (1) the use of timed synchronization points for multi-stream synchronization; (2) Internet bandwidth estimation based on machine learning; (3) the cooperative frame rate allocation for correlated multi-streams and (4) the resynchronization protocol used when user views change. Experimental results show that TSync can successfully achieve the synchronization of multi-source heterogeneous streams in 3DTI under Internet dynamics.

AB - Synchronization is a challenge in the multi-site 3D tele-immersion (3DTI) because it is complicated by the coexistence of highly correlated heterogenous streams from multiple sources, and the need for multi-stream resynchronization when user views change. To address the problems, we present TSync: a new multi-tier synchronization framework for 3DTI which can effectively reduce the multi-stream sync skews. Our contributions are focusing on (1) the use of timed synchronization points for multi-stream synchronization; (2) Internet bandwidth estimation based on machine learning; (3) the cooperative frame rate allocation for correlated multi-streams and (4) the resynchronization protocol used when user views change. Experimental results show that TSync can successfully achieve the synchronization of multi-source heterogeneous streams in 3DTI under Internet dynamics.

KW - 3d tele-immersion

KW - synchronization

UR - http://www.scopus.com/inward/record.url?scp=77954752053&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=77954752053&partnerID=8YFLogxK

U2 - 10.1145/1806565.1806577

DO - 10.1145/1806565.1806577

M3 - Conference contribution

AN - SCOPUS:77954752053

SN - 9781450300438

T3 - Proceedings of the International Workshop on Network and Operating System Support for Digital Audio and Video

SP - 39

EP - 44

BT - NOSSDAV'10 - Proceedings of the 20th International Workshop on Network and Operating Systems Support for Digital Audio and Video

ER -