A methodology for remote virtual interaction in teleimmersive environments

Ram Vasudevan, Edgar Lobaton, Gregorij Kurillo, Ruzena Bajcsy, Tony Bernardin, Bernd Hamann, Klara Nahrstedt

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Though the quality of imaging devices, the accuracy of algorithms that construct 3D data, and the hardware available to render such data have all improved, the algorithms available to calibrate, reconstruct, and then visualize such data are difficult to use, extremely noise sensitive, and unreasonably slow. In this paper, we describe a multi-camera system that creates a highly accurate (on the order of a centimeter), 3D reconstruction of an environment in real time (under 30 ms) that allows for remote interaction between users. The paper addresses the aforementioned deficiencies by featuring an overview of the technology and algorithms used to calibrate, reconstruct, and render objects in the system. The algorithm produces partial 3D meshes, instead of dense point clouds, which are combined on the renderer to create a unified model of the environment. The chosen representation of the data allows for high compression ratios for transfer to remote sites. We demonstrate the accuracy and speed of our results on a variety of benchmarks and data collected from our own system.

Original languageEnglish (US)
Title of host publicationMMSys'10 - Proceedings of the 2010 ACM SIGMM Conference on Multimedia Systems
Pages281-291
Number of pages11
DOIs
StatePublished - Apr 29 2010
Event2010 ACM SIGMM Conference on Multimedia Systems, MMSys'10 - Phoenix, AZ, United States
Duration: Feb 22 2010Feb 23 2010

Publication series

NameMMSys'10 - Proceedings of the 2010 ACM SIGMM Conference on Multimedia Systems

Other

Other2010 ACM SIGMM Conference on Multimedia Systems, MMSys'10
CountryUnited States
CityPhoenix, AZ
Period2/22/102/23/10

Fingerprint

Cameras
Hardware
Imaging techniques

Keywords

  • 3D teleimmersion
  • 3D video
  • Human-computer interaction
  • Real time
  • Stereo reconstruction
  • Virtual reality
  • Visualization

ASJC Scopus subject areas

  • Computer Graphics and Computer-Aided Design
  • Software

Cite this

Vasudevan, R., Lobaton, E., Kurillo, G., Bajcsy, R., Bernardin, T., Hamann, B., & Nahrstedt, K. (2010). A methodology for remote virtual interaction in teleimmersive environments. In MMSys'10 - Proceedings of the 2010 ACM SIGMM Conference on Multimedia Systems (pp. 281-291). (MMSys'10 - Proceedings of the 2010 ACM SIGMM Conference on Multimedia Systems). https://doi.org/10.1145/1730836.1730871

A methodology for remote virtual interaction in teleimmersive environments. / Vasudevan, Ram; Lobaton, Edgar; Kurillo, Gregorij; Bajcsy, Ruzena; Bernardin, Tony; Hamann, Bernd; Nahrstedt, Klara.

MMSys'10 - Proceedings of the 2010 ACM SIGMM Conference on Multimedia Systems. 2010. p. 281-291 (MMSys'10 - Proceedings of the 2010 ACM SIGMM Conference on Multimedia Systems).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Vasudevan, R, Lobaton, E, Kurillo, G, Bajcsy, R, Bernardin, T, Hamann, B & Nahrstedt, K 2010, A methodology for remote virtual interaction in teleimmersive environments. in MMSys'10 - Proceedings of the 2010 ACM SIGMM Conference on Multimedia Systems. MMSys'10 - Proceedings of the 2010 ACM SIGMM Conference on Multimedia Systems, pp. 281-291, 2010 ACM SIGMM Conference on Multimedia Systems, MMSys'10, Phoenix, AZ, United States, 2/22/10. https://doi.org/10.1145/1730836.1730871
Vasudevan R, Lobaton E, Kurillo G, Bajcsy R, Bernardin T, Hamann B et al. A methodology for remote virtual interaction in teleimmersive environments. In MMSys'10 - Proceedings of the 2010 ACM SIGMM Conference on Multimedia Systems. 2010. p. 281-291. (MMSys'10 - Proceedings of the 2010 ACM SIGMM Conference on Multimedia Systems). https://doi.org/10.1145/1730836.1730871
Vasudevan, Ram ; Lobaton, Edgar ; Kurillo, Gregorij ; Bajcsy, Ruzena ; Bernardin, Tony ; Hamann, Bernd ; Nahrstedt, Klara. / A methodology for remote virtual interaction in teleimmersive environments. MMSys'10 - Proceedings of the 2010 ACM SIGMM Conference on Multimedia Systems. 2010. pp. 281-291 (MMSys'10 - Proceedings of the 2010 ACM SIGMM Conference on Multimedia Systems).
@inproceedings{57f056d9de5f42f0a5af5f5007f95fb5,
title = "A methodology for remote virtual interaction in teleimmersive environments",
abstract = "Though the quality of imaging devices, the accuracy of algorithms that construct 3D data, and the hardware available to render such data have all improved, the algorithms available to calibrate, reconstruct, and then visualize such data are difficult to use, extremely noise sensitive, and unreasonably slow. In this paper, we describe a multi-camera system that creates a highly accurate (on the order of a centimeter), 3D reconstruction of an environment in real time (under 30 ms) that allows for remote interaction between users. The paper addresses the aforementioned deficiencies by featuring an overview of the technology and algorithms used to calibrate, reconstruct, and render objects in the system. The algorithm produces partial 3D meshes, instead of dense point clouds, which are combined on the renderer to create a unified model of the environment. The chosen representation of the data allows for high compression ratios for transfer to remote sites. We demonstrate the accuracy and speed of our results on a variety of benchmarks and data collected from our own system.",
keywords = "3D teleimmersion, 3D video, Human-computer interaction, Real time, Stereo reconstruction, Virtual reality, Visualization",
author = "Ram Vasudevan and Edgar Lobaton and Gregorij Kurillo and Ruzena Bajcsy and Tony Bernardin and Bernd Hamann and Klara Nahrstedt",
year = "2010",
month = "4",
day = "29",
doi = "10.1145/1730836.1730871",
language = "English (US)",
isbn = "9781605589145",
series = "MMSys'10 - Proceedings of the 2010 ACM SIGMM Conference on Multimedia Systems",
pages = "281--291",
booktitle = "MMSys'10 - Proceedings of the 2010 ACM SIGMM Conference on Multimedia Systems",

}

TY - GEN

T1 - A methodology for remote virtual interaction in teleimmersive environments

AU - Vasudevan, Ram

AU - Lobaton, Edgar

AU - Kurillo, Gregorij

AU - Bajcsy, Ruzena

AU - Bernardin, Tony

AU - Hamann, Bernd

AU - Nahrstedt, Klara

PY - 2010/4/29

Y1 - 2010/4/29

N2 - Though the quality of imaging devices, the accuracy of algorithms that construct 3D data, and the hardware available to render such data have all improved, the algorithms available to calibrate, reconstruct, and then visualize such data are difficult to use, extremely noise sensitive, and unreasonably slow. In this paper, we describe a multi-camera system that creates a highly accurate (on the order of a centimeter), 3D reconstruction of an environment in real time (under 30 ms) that allows for remote interaction between users. The paper addresses the aforementioned deficiencies by featuring an overview of the technology and algorithms used to calibrate, reconstruct, and render objects in the system. The algorithm produces partial 3D meshes, instead of dense point clouds, which are combined on the renderer to create a unified model of the environment. The chosen representation of the data allows for high compression ratios for transfer to remote sites. We demonstrate the accuracy and speed of our results on a variety of benchmarks and data collected from our own system.

AB - Though the quality of imaging devices, the accuracy of algorithms that construct 3D data, and the hardware available to render such data have all improved, the algorithms available to calibrate, reconstruct, and then visualize such data are difficult to use, extremely noise sensitive, and unreasonably slow. In this paper, we describe a multi-camera system that creates a highly accurate (on the order of a centimeter), 3D reconstruction of an environment in real time (under 30 ms) that allows for remote interaction between users. The paper addresses the aforementioned deficiencies by featuring an overview of the technology and algorithms used to calibrate, reconstruct, and render objects in the system. The algorithm produces partial 3D meshes, instead of dense point clouds, which are combined on the renderer to create a unified model of the environment. The chosen representation of the data allows for high compression ratios for transfer to remote sites. We demonstrate the accuracy and speed of our results on a variety of benchmarks and data collected from our own system.

KW - 3D teleimmersion

KW - 3D video

KW - Human-computer interaction

KW - Real time

KW - Stereo reconstruction

KW - Virtual reality

KW - Visualization

UR - http://www.scopus.com/inward/record.url?scp=77951269465&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=77951269465&partnerID=8YFLogxK

U2 - 10.1145/1730836.1730871

DO - 10.1145/1730836.1730871

M3 - Conference contribution

AN - SCOPUS:77951269465

SN - 9781605589145

T3 - MMSys'10 - Proceedings of the 2010 ACM SIGMM Conference on Multimedia Systems

SP - 281

EP - 291

BT - MMSys'10 - Proceedings of the 2010 ACM SIGMM Conference on Multimedia Systems

ER -