Multimodal archiving, real-time annotation and information visualization in a biofeedback system for stroke patient rehabilitation

Weiwei Xu, Yinpeng Chen, Hari Sundaram, Thanassis Rikakis

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

In this paper we present our work on a system to support real-time multimodal archiving, collaborative annotation and offline information visualization for a biofeedback stroke-rehabilitation application. Our archiving / annotation / visualization system can play a critical role in the long-term biofeedback stroke therapy by supporting cooperative data analysis and media feedback as well as by providing the therapist with insight into computing-supported therapy. There are three contributions of this paper: (a) the design of a robust archiving system that archives in real time parametric model data (motion capture, motion analysis and audio / visual synthesis parameters) as well as audio / video from the biofeedback environment. (b) a web-based annotation tool designed with low cognitive load (c) a hierarchical information visualization tool that enables the therapist and other team members to examine quantitative motion analysis of subject performance with the context of media feedback, thus enabling collaborative insights. Our user studies indicate that the system performs well.

Original languageEnglish (US)
Title of host publicationProceedings of the 3rd ACM Workshop on Capture, Archival and Retrieval of Personal Experiences, CARPE 2006
Pages3-12
Number of pages10
DOIs
StatePublished - 2006
Externally publishedYes
Event3rd ACM Workshop on Capture, Archival and Retrieval of Personal Experiences, CARPE 2006, co-located with the 2006 ACM International Multimedia Conference - Santa Barbara, CA, United States
Duration: Oct 28 2006Oct 28 2006

Publication series

NameProceedings of the ACM International Multimedia Conference and Exhibition

Conference

Conference3rd ACM Workshop on Capture, Archival and Retrieval of Personal Experiences, CARPE 2006, co-located with the 2006 ACM International Multimedia Conference
Country/TerritoryUnited States
CitySanta Barbara, CA
Period10/28/0610/28/06

Keywords

  • Analysis
  • Annotation
  • Archiving
  • Biofeedback
  • Information visualization

ASJC Scopus subject areas

  • General Computer Science

Fingerprint

Dive into the research topics of 'Multimodal archiving, real-time annotation and information visualization in a biofeedback system for stroke patient rehabilitation'. Together they form a unique fingerprint.

Cite this