A methodology for remote virtual interaction in teleimmersive environments

Ram Vasudevan, Edgar Lobaton, Gregorij Kurillo, Ruzena Bajcsy, Tony Bernardin, Bernd Hamann, Klara Nahrstedt

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Though the quality of imaging devices, the accuracy of algorithms that construct 3D data, and the hardware available to render such data have all improved, the algorithms available to calibrate, reconstruct, and then visualize such data are difficult to use, extremely noise sensitive, and unreasonably slow. In this paper, we describe a multi-camera system that creates a highly accurate (on the order of a centimeter), 3D reconstruction of an environment in real time (under 30 ms) that allows for remote interaction between users. The paper addresses the aforementioned deficiencies by featuring an overview of the technology and algorithms used to calibrate, reconstruct, and render objects in the system. The algorithm produces partial 3D meshes, instead of dense point clouds, which are combined on the renderer to create a unified model of the environment. The chosen representation of the data allows for high compression ratios for transfer to remote sites. We demonstrate the accuracy and speed of our results on a variety of benchmarks and data collected from our own system.

Original languageEnglish (US)
Title of host publicationMMSys'10 - Proceedings of the 2010 ACM SIGMM Conference on Multimedia Systems
Pages281-291
Number of pages11
DOIs
StatePublished - Apr 29 2010
Event2010 ACM SIGMM Conference on Multimedia Systems, MMSys'10 - Phoenix, AZ, United States
Duration: Feb 22 2010Feb 23 2010

Publication series

NameMMSys'10 - Proceedings of the 2010 ACM SIGMM Conference on Multimedia Systems

Other

Other2010 ACM SIGMM Conference on Multimedia Systems, MMSys'10
CountryUnited States
CityPhoenix, AZ
Period2/22/102/23/10

Keywords

  • 3D teleimmersion
  • 3D video
  • Human-computer interaction
  • Real time
  • Stereo reconstruction
  • Virtual reality
  • Visualization

ASJC Scopus subject areas

  • Computer Graphics and Computer-Aided Design
  • Software

Fingerprint Dive into the research topics of 'A methodology for remote virtual interaction in teleimmersive environments'. Together they form a unique fingerprint.

  • Cite this

    Vasudevan, R., Lobaton, E., Kurillo, G., Bajcsy, R., Bernardin, T., Hamann, B., & Nahrstedt, K. (2010). A methodology for remote virtual interaction in teleimmersive environments. In MMSys'10 - Proceedings of the 2010 ACM SIGMM Conference on Multimedia Systems (pp. 281-291). (MMSys'10 - Proceedings of the 2010 ACM SIGMM Conference on Multimedia Systems). https://doi.org/10.1145/1730836.1730871