TY - GEN
T1 - A methodology for remote virtual interaction in teleimmersive environments
AU - Vasudevan, Ram
AU - Lobaton, Edgar
AU - Kurillo, Gregorij
AU - Bajcsy, Ruzena
AU - Bernardin, Tony
AU - Hamann, Bernd
AU - Nahrstedt, Klara
PY - 2010
Y1 - 2010
N2 - Though the quality of imaging devices, the accuracy of algorithms that construct 3D data, and the hardware available to render such data have all improved, the algorithms available to calibrate, reconstruct, and then visualize such data are difficult to use, extremely noise sensitive, and unreasonably slow. In this paper, we describe a multi-camera system that creates a highly accurate (on the order of a centimeter), 3D reconstruction of an environment in real time (under 30 ms) that allows for remote interaction between users. The paper addresses the aforementioned deficiencies by featuring an overview of the technology and algorithms used to calibrate, reconstruct, and render objects in the system. The algorithm produces partial 3D meshes, instead of dense point clouds, which are combined on the renderer to create a unified model of the environment. The chosen representation of the data allows for high compression ratios for transfer to remote sites. We demonstrate the accuracy and speed of our results on a variety of benchmarks and data collected from our own system.
AB - Though the quality of imaging devices, the accuracy of algorithms that construct 3D data, and the hardware available to render such data have all improved, the algorithms available to calibrate, reconstruct, and then visualize such data are difficult to use, extremely noise sensitive, and unreasonably slow. In this paper, we describe a multi-camera system that creates a highly accurate (on the order of a centimeter), 3D reconstruction of an environment in real time (under 30 ms) that allows for remote interaction between users. The paper addresses the aforementioned deficiencies by featuring an overview of the technology and algorithms used to calibrate, reconstruct, and render objects in the system. The algorithm produces partial 3D meshes, instead of dense point clouds, which are combined on the renderer to create a unified model of the environment. The chosen representation of the data allows for high compression ratios for transfer to remote sites. We demonstrate the accuracy and speed of our results on a variety of benchmarks and data collected from our own system.
KW - 3D teleimmersion
KW - 3D video
KW - Human-computer interaction
KW - Real time
KW - Stereo reconstruction
KW - Virtual reality
KW - Visualization
UR - http://www.scopus.com/inward/record.url?scp=77951269465&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=77951269465&partnerID=8YFLogxK
U2 - 10.1145/1730836.1730871
DO - 10.1145/1730836.1730871
M3 - Conference contribution
AN - SCOPUS:77951269465
SN - 9781605589145
T3 - MMSys'10 - Proceedings of the 2010 ACM SIGMM Conference on Multimedia Systems
SP - 281
EP - 291
BT - MMSys'10 - Proceedings of the 2010 ACM SIGMM Conference on Multimedia Systems
T2 - 2010 ACM SIGMM Conference on Multimedia Systems, MMSys'10
Y2 - 22 February 2010 through 23 February 2010
ER -