Physical Relationship Description for cyber-physical multi-modal sensory environments

Tarek Elgamal, Shannon Chen, Klara Nahrstedt

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

This paper presents Physical Representation Description (PRD), a method for representing the spatial relationship between sources of multimedia streams in physical environments. PRD is an extension for the most widely used video streaming standard DASH. DASH supports the delivery of multiple synchronized streams (e.g., video, audio and sensor data) from a server to multiple clients, however DASH does not provide information about how the multi-modal sensory sources were actually located relative to each other when the data was captured. PRD extends DASH streaming standard by describing how the sources of multi-modal sensory streams are located relative to each other in the physical environment. This enables DASH clients to understand how the scene was captured in a physical space, and use this information to (1) differentiate and prioritize sensory streams according to their physical location, (2) enhance viewing experience, and (3) assist in easier spatial mapping from physical to virtual cyber space and vice versa. In this paper we describe the need for PRD in an example application called CyPhy, representing a multi-modal sensory cyberphysical environment for tele-physiotherapy in patients' homes. We then describe PRD and show how it can improve DASH streaming standard in delivering enhanced viewing experience under different network, and viewing conditions using physical spatial information of sensory sources.

Original languageEnglish (US)
Title of host publicationProceedings - 2016 IEEE International Symposium on Multimedia, ISM 2016
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages158-162
Number of pages5
ISBN (Electronic)9781509045709
DOIs
StatePublished - Jan 18 2017
Event18th IEEE International Symposium on Multimedia, ISM 2016 - San Jose, United States
Duration: Dec 11 2016Dec 13 2016

Publication series

NameProceedings - 2016 IEEE International Symposium on Multimedia, ISM 2016

Other

Other18th IEEE International Symposium on Multimedia, ISM 2016
CountryUnited States
CitySan Jose
Period12/11/1612/13/16

ASJC Scopus subject areas

  • Artificial Intelligence
  • Computer Networks and Communications
  • Media Technology
  • Computer Science Applications

Fingerprint Dive into the research topics of 'Physical Relationship Description for cyber-physical multi-modal sensory environments'. Together they form a unique fingerprint.

  • Cite this

    Elgamal, T., Chen, S., & Nahrstedt, K. (2017). Physical Relationship Description for cyber-physical multi-modal sensory environments. In Proceedings - 2016 IEEE International Symposium on Multimedia, ISM 2016 (pp. 158-162). [7823605] (Proceedings - 2016 IEEE International Symposium on Multimedia, ISM 2016). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/ISM.2016.19