Real-time stereo-vision system for 3D teleimmersive collaboration

Ram Vasudevan, Zhong Zhou, Gregorij Kurillo, Edgar Lobaton, Ruzena Bajcsy, Klara Nahrstedt

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Though the variety of desktop real time stereo vision systems has grown considerably in the past several years, few make any verifiable claims about the accuracy of the algorithms used to construct 3D data or describe how the data generated by such systems, which is large in size, can be effectively distributed. In this paper, we describe a system that creates an accurate (on the order of a centimeter), 3D reconstruction of an environment in real time (under 30 ms) that also allows for remote interaction between users. This paper addresses how to reconstruct, compress, and visualize the 3D environment. In contrast to most commercial desktop real time stereo vision systems our algorithm produces 3D meshes instead of dense point clouds, which we show allows for better quality visualizations. The chosen representation of the data also allows for high compression ratios for transfer to remote sites. We demonstrate the accuracy and speed of our results on a variety of benchmarks.

Original languageEnglish (US)
Title of host publication2010 IEEE International Conference on Multimedia and Expo, ICME 2010
Pages1208-1213
Number of pages6
DOIs
StatePublished - Nov 22 2010
Event2010 IEEE International Conference on Multimedia and Expo, ICME 2010 - Singapore, Singapore
Duration: Jul 19 2010Jul 23 2010

Publication series

Name2010 IEEE International Conference on Multimedia and Expo, ICME 2010

Other

Other2010 IEEE International Conference on Multimedia and Expo, ICME 2010
CountrySingapore
CitySingapore
Period7/19/107/23/10

Fingerprint

Stereo vision
Visualization

Keywords

  • 3D video
  • Compression
  • Real time
  • Teleimmersion

ASJC Scopus subject areas

  • Human-Computer Interaction
  • Software

Cite this

Vasudevan, R., Zhou, Z., Kurillo, G., Lobaton, E., Bajcsy, R., & Nahrstedt, K. (2010). Real-time stereo-vision system for 3D teleimmersive collaboration. In 2010 IEEE International Conference on Multimedia and Expo, ICME 2010 (pp. 1208-1213). [5582538] (2010 IEEE International Conference on Multimedia and Expo, ICME 2010). https://doi.org/10.1109/ICME.2010.5582538

Real-time stereo-vision system for 3D teleimmersive collaboration. / Vasudevan, Ram; Zhou, Zhong; Kurillo, Gregorij; Lobaton, Edgar; Bajcsy, Ruzena; Nahrstedt, Klara.

2010 IEEE International Conference on Multimedia and Expo, ICME 2010. 2010. p. 1208-1213 5582538 (2010 IEEE International Conference on Multimedia and Expo, ICME 2010).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Vasudevan, R, Zhou, Z, Kurillo, G, Lobaton, E, Bajcsy, R & Nahrstedt, K 2010, Real-time stereo-vision system for 3D teleimmersive collaboration. in 2010 IEEE International Conference on Multimedia and Expo, ICME 2010., 5582538, 2010 IEEE International Conference on Multimedia and Expo, ICME 2010, pp. 1208-1213, 2010 IEEE International Conference on Multimedia and Expo, ICME 2010, Singapore, Singapore, 7/19/10. https://doi.org/10.1109/ICME.2010.5582538
Vasudevan R, Zhou Z, Kurillo G, Lobaton E, Bajcsy R, Nahrstedt K. Real-time stereo-vision system for 3D teleimmersive collaboration. In 2010 IEEE International Conference on Multimedia and Expo, ICME 2010. 2010. p. 1208-1213. 5582538. (2010 IEEE International Conference on Multimedia and Expo, ICME 2010). https://doi.org/10.1109/ICME.2010.5582538
Vasudevan, Ram ; Zhou, Zhong ; Kurillo, Gregorij ; Lobaton, Edgar ; Bajcsy, Ruzena ; Nahrstedt, Klara. / Real-time stereo-vision system for 3D teleimmersive collaboration. 2010 IEEE International Conference on Multimedia and Expo, ICME 2010. 2010. pp. 1208-1213 (2010 IEEE International Conference on Multimedia and Expo, ICME 2010).
@inproceedings{51e708cb5fa84993b76c1eaa3726df13,
title = "Real-time stereo-vision system for 3D teleimmersive collaboration",
abstract = "Though the variety of desktop real time stereo vision systems has grown considerably in the past several years, few make any verifiable claims about the accuracy of the algorithms used to construct 3D data or describe how the data generated by such systems, which is large in size, can be effectively distributed. In this paper, we describe a system that creates an accurate (on the order of a centimeter), 3D reconstruction of an environment in real time (under 30 ms) that also allows for remote interaction between users. This paper addresses how to reconstruct, compress, and visualize the 3D environment. In contrast to most commercial desktop real time stereo vision systems our algorithm produces 3D meshes instead of dense point clouds, which we show allows for better quality visualizations. The chosen representation of the data also allows for high compression ratios for transfer to remote sites. We demonstrate the accuracy and speed of our results on a variety of benchmarks.",
keywords = "3D video, Compression, Real time, Teleimmersion",
author = "Ram Vasudevan and Zhong Zhou and Gregorij Kurillo and Edgar Lobaton and Ruzena Bajcsy and Klara Nahrstedt",
year = "2010",
month = "11",
day = "22",
doi = "10.1109/ICME.2010.5582538",
language = "English (US)",
isbn = "9781424474912",
series = "2010 IEEE International Conference on Multimedia and Expo, ICME 2010",
pages = "1208--1213",
booktitle = "2010 IEEE International Conference on Multimedia and Expo, ICME 2010",

}

TY - GEN

T1 - Real-time stereo-vision system for 3D teleimmersive collaboration

AU - Vasudevan, Ram

AU - Zhou, Zhong

AU - Kurillo, Gregorij

AU - Lobaton, Edgar

AU - Bajcsy, Ruzena

AU - Nahrstedt, Klara

PY - 2010/11/22

Y1 - 2010/11/22

N2 - Though the variety of desktop real time stereo vision systems has grown considerably in the past several years, few make any verifiable claims about the accuracy of the algorithms used to construct 3D data or describe how the data generated by such systems, which is large in size, can be effectively distributed. In this paper, we describe a system that creates an accurate (on the order of a centimeter), 3D reconstruction of an environment in real time (under 30 ms) that also allows for remote interaction between users. This paper addresses how to reconstruct, compress, and visualize the 3D environment. In contrast to most commercial desktop real time stereo vision systems our algorithm produces 3D meshes instead of dense point clouds, which we show allows for better quality visualizations. The chosen representation of the data also allows for high compression ratios for transfer to remote sites. We demonstrate the accuracy and speed of our results on a variety of benchmarks.

AB - Though the variety of desktop real time stereo vision systems has grown considerably in the past several years, few make any verifiable claims about the accuracy of the algorithms used to construct 3D data or describe how the data generated by such systems, which is large in size, can be effectively distributed. In this paper, we describe a system that creates an accurate (on the order of a centimeter), 3D reconstruction of an environment in real time (under 30 ms) that also allows for remote interaction between users. This paper addresses how to reconstruct, compress, and visualize the 3D environment. In contrast to most commercial desktop real time stereo vision systems our algorithm produces 3D meshes instead of dense point clouds, which we show allows for better quality visualizations. The chosen representation of the data also allows for high compression ratios for transfer to remote sites. We demonstrate the accuracy and speed of our results on a variety of benchmarks.

KW - 3D video

KW - Compression

KW - Real time

KW - Teleimmersion

UR - http://www.scopus.com/inward/record.url?scp=78349289608&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=78349289608&partnerID=8YFLogxK

U2 - 10.1109/ICME.2010.5582538

DO - 10.1109/ICME.2010.5582538

M3 - Conference contribution

AN - SCOPUS:78349289608

SN - 9781424474912

T3 - 2010 IEEE International Conference on Multimedia and Expo, ICME 2010

SP - 1208

EP - 1213

BT - 2010 IEEE International Conference on Multimedia and Expo, ICME 2010

ER -