Real time localization and 3D depth estimation across disparate sensing systems: Toward hazard aware and tele-immersive spaces

Peter Bajcsy, Miles Johnson, Suk Kyu Lee, Rob Kooper

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

This paper addresses the problems of real-time localization and 3D depth estimation across disparate sensing systems. The sensing systems include wireless micro-electro-mechanical systems (MEMS) sensor networks, such as MICA sensors by Crossbow Inc., Radio Frequency Identification (RFID) tags and cameras that capture a variety of spectra. Some of the sensing is adaptive in time and space by using a remotely controlled robot for the sensor deployment. The motivation for integrating and analyzing multiple sensing systems and spectral modalities comes from the fact that in many applications a single sensing system or modality does not lead to robust and accurate performance. In this work we design systems for localization using Radio Frequency Identification (RFID) tags and real time 3D depth estimation from stereo vision in order to incorporate power constraints imposed on deployment of battery-operated wireless MICA sensors. The resulting methods are applied to the development of (a) hazard aware spaces (HAS) to alert people in events of Are, and (b) tele-immersive spaces (TEEVE) to enable remote collaborations, training and art performances. The novelty of our work lies in the power efficient deployment of wireless sensors for location aware applications by combining multiple sensors with advanced signal and image processing algorithms.

Original languageEnglish (US)
Title of host publicationProceedings of IWSSIP 2008 - 15th International Conference on Systems, Signals and Image Processing
Pages261-264
Number of pages4
DOIs
StatePublished - Oct 6 2008
Event15th International Conference on Systems, Signals and Image Processing, IWSSIP 2008 - Bratislava, Slovakia
Duration: Jun 25 2008Jun 28 2008

Publication series

NameProceedings of IWSSIP 2008 - 15th International Conference on Systems, Signals and Image Processing

Other

Other15th International Conference on Systems, Signals and Image Processing, IWSSIP 2008
CountrySlovakia
CityBratislava
Period6/25/086/28/08

Keywords

  • Signal processing and systems
  • Video streaming and videoconferencing

ASJC Scopus subject areas

  • Computer Vision and Pattern Recognition
  • Signal Processing
  • Control and Systems Engineering

Fingerprint Dive into the research topics of 'Real time localization and 3D depth estimation across disparate sensing systems: Toward hazard aware and tele-immersive spaces'. Together they form a unique fingerprint.

Cite this