High-quality visualization for geographically distributed 3-D teleimmersive applications

Ramanarayan Vasudevan, Gregorij Kurillo, Edgar Lobaton, Tony Bernardin, Oliver Kreylos, Ruzena Bajcsy, Klara Nahrstedt

Research output: Contribution to journalArticle

Abstract

The growing popularity of 3-D movies has led to the rapid development of numerous affordable consumer 3-D displays. In contrast, the development of technology to generate 3-D content has lagged behind considerably. In spite of significant improvements to the quality of imaging devices, the accuracy of the algorithms that generate 3-D data, and the hardware available to render such data, the algorithms available to calibrate, reconstruct, and then visualize such data remain difficult to use, extremely noise sensitive, and unreasonably slow. In this paper, we present a multi-camera system that creates a highly accurate (on the order of a centimeter), 3-D reconstruction of an environment in real-time (under 30 ms) that allows for remote interaction between users. This paper focuses on addressing the aforementioned deficiencies by describing algorithms to calibrate, reconstruct, and render objects in the system. We demonstrate the accuracy and speed of our results on a variety of benchmarks and data collected from our own system.

Original languageEnglish (US)
Article number5727958
Pages (from-to)573-584
Number of pages12
JournalIEEE Transactions on Multimedia
Volume13
Issue number3
DOIs
StatePublished - Jun 1 2011

Fingerprint

Visualization
Cameras
Display devices
Hardware
Imaging techniques

Keywords

  • 3-D teleimmersion
  • 3-D video
  • Human-computer interaction
  • real-time
  • stereo reconstruction
  • virtual reality
  • visualization

ASJC Scopus subject areas

  • Signal Processing
  • Media Technology
  • Computer Science Applications
  • Electrical and Electronic Engineering

Cite this

Vasudevan, R., Kurillo, G., Lobaton, E., Bernardin, T., Kreylos, O., Bajcsy, R., & Nahrstedt, K. (2011). High-quality visualization for geographically distributed 3-D teleimmersive applications. IEEE Transactions on Multimedia, 13(3), 573-584. [5727958]. https://doi.org/10.1109/TMM.2011.2123871

High-quality visualization for geographically distributed 3-D teleimmersive applications. / Vasudevan, Ramanarayan; Kurillo, Gregorij; Lobaton, Edgar; Bernardin, Tony; Kreylos, Oliver; Bajcsy, Ruzena; Nahrstedt, Klara.

In: IEEE Transactions on Multimedia, Vol. 13, No. 3, 5727958, 01.06.2011, p. 573-584.

Research output: Contribution to journalArticle

Vasudevan, R, Kurillo, G, Lobaton, E, Bernardin, T, Kreylos, O, Bajcsy, R & Nahrstedt, K 2011, 'High-quality visualization for geographically distributed 3-D teleimmersive applications', IEEE Transactions on Multimedia, vol. 13, no. 3, 5727958, pp. 573-584. https://doi.org/10.1109/TMM.2011.2123871
Vasudevan R, Kurillo G, Lobaton E, Bernardin T, Kreylos O, Bajcsy R et al. High-quality visualization for geographically distributed 3-D teleimmersive applications. IEEE Transactions on Multimedia. 2011 Jun 1;13(3):573-584. 5727958. https://doi.org/10.1109/TMM.2011.2123871
Vasudevan, Ramanarayan ; Kurillo, Gregorij ; Lobaton, Edgar ; Bernardin, Tony ; Kreylos, Oliver ; Bajcsy, Ruzena ; Nahrstedt, Klara. / High-quality visualization for geographically distributed 3-D teleimmersive applications. In: IEEE Transactions on Multimedia. 2011 ; Vol. 13, No. 3. pp. 573-584.
@article{d86373b1c5ba4e3895b68c816bf8e0ab,
title = "High-quality visualization for geographically distributed 3-D teleimmersive applications",
abstract = "The growing popularity of 3-D movies has led to the rapid development of numerous affordable consumer 3-D displays. In contrast, the development of technology to generate 3-D content has lagged behind considerably. In spite of significant improvements to the quality of imaging devices, the accuracy of the algorithms that generate 3-D data, and the hardware available to render such data, the algorithms available to calibrate, reconstruct, and then visualize such data remain difficult to use, extremely noise sensitive, and unreasonably slow. In this paper, we present a multi-camera system that creates a highly accurate (on the order of a centimeter), 3-D reconstruction of an environment in real-time (under 30 ms) that allows for remote interaction between users. This paper focuses on addressing the aforementioned deficiencies by describing algorithms to calibrate, reconstruct, and render objects in the system. We demonstrate the accuracy and speed of our results on a variety of benchmarks and data collected from our own system.",
keywords = "3-D teleimmersion, 3-D video, Human-computer interaction, real-time, stereo reconstruction, virtual reality, visualization",
author = "Ramanarayan Vasudevan and Gregorij Kurillo and Edgar Lobaton and Tony Bernardin and Oliver Kreylos and Ruzena Bajcsy and Klara Nahrstedt",
year = "2011",
month = "6",
day = "1",
doi = "10.1109/TMM.2011.2123871",
language = "English (US)",
volume = "13",
pages = "573--584",
journal = "IEEE Transactions on Multimedia",
issn = "1520-9210",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
number = "3",

}

TY - JOUR

T1 - High-quality visualization for geographically distributed 3-D teleimmersive applications

AU - Vasudevan, Ramanarayan

AU - Kurillo, Gregorij

AU - Lobaton, Edgar

AU - Bernardin, Tony

AU - Kreylos, Oliver

AU - Bajcsy, Ruzena

AU - Nahrstedt, Klara

PY - 2011/6/1

Y1 - 2011/6/1

N2 - The growing popularity of 3-D movies has led to the rapid development of numerous affordable consumer 3-D displays. In contrast, the development of technology to generate 3-D content has lagged behind considerably. In spite of significant improvements to the quality of imaging devices, the accuracy of the algorithms that generate 3-D data, and the hardware available to render such data, the algorithms available to calibrate, reconstruct, and then visualize such data remain difficult to use, extremely noise sensitive, and unreasonably slow. In this paper, we present a multi-camera system that creates a highly accurate (on the order of a centimeter), 3-D reconstruction of an environment in real-time (under 30 ms) that allows for remote interaction between users. This paper focuses on addressing the aforementioned deficiencies by describing algorithms to calibrate, reconstruct, and render objects in the system. We demonstrate the accuracy and speed of our results on a variety of benchmarks and data collected from our own system.

AB - The growing popularity of 3-D movies has led to the rapid development of numerous affordable consumer 3-D displays. In contrast, the development of technology to generate 3-D content has lagged behind considerably. In spite of significant improvements to the quality of imaging devices, the accuracy of the algorithms that generate 3-D data, and the hardware available to render such data, the algorithms available to calibrate, reconstruct, and then visualize such data remain difficult to use, extremely noise sensitive, and unreasonably slow. In this paper, we present a multi-camera system that creates a highly accurate (on the order of a centimeter), 3-D reconstruction of an environment in real-time (under 30 ms) that allows for remote interaction between users. This paper focuses on addressing the aforementioned deficiencies by describing algorithms to calibrate, reconstruct, and render objects in the system. We demonstrate the accuracy and speed of our results on a variety of benchmarks and data collected from our own system.

KW - 3-D teleimmersion

KW - 3-D video

KW - Human-computer interaction

KW - real-time

KW - stereo reconstruction

KW - virtual reality

KW - visualization

UR - http://www.scopus.com/inward/record.url?scp=79957488992&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=79957488992&partnerID=8YFLogxK

U2 - 10.1109/TMM.2011.2123871

DO - 10.1109/TMM.2011.2123871

M3 - Article

AN - SCOPUS:79957488992

VL - 13

SP - 573

EP - 584

JO - IEEE Transactions on Multimedia

JF - IEEE Transactions on Multimedia

SN - 1520-9210

IS - 3

M1 - 5727958

ER -