Adaptive mixed reality stroke rehabilitation: System architecture and evaluation metrics

Yinpeng Chen, Nicole Lehrer, Hari Sundaram, Thanassis Rikakis

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

This paper presents a novel system architecture and evaluation metrics for an Adaptive Mixed Reality Rehabilitation (AMRR) system for stroke patient. This system provides a purposeful, engaging, hybrid (visual, auditory and physical) scene that encourages patients to improve their performance of a reaching and grasping task and promotes learning of generalizable movement strategies. This system is adaptive in that it provides assistive adaptation tools to help the rehabilitation team customize the training strategy. Our key insight is to combine the patients, rehabilitation team, multimodal hybrid environments and adaptation tools together as an adaptive experiential mixed reality system. There are three major contributions in this paper: (a) developing a computational deficit index for evaluating the patient's kinematic performance and a deficit-training-improvement (DTI) correlation for evaluating adaptive training strategy, (b) integrating assistive adaptation tools that help the rehabilitation team understand the relationship between the patient's performance and training and customize the training strategy, and (c) combining the interactive multimedia environment and physical environment together to encourage patients to transfer movement knowledge from media space to physical space. Our system has been used by two stroke patients for one-month mediated therapy. They have significant improvement in their reaching and grasping performance (+48.84% and +39.29%) compared to other two stroke patients who experienced traditional therapy (-18.31% and -8.06%).

Original languageEnglish (US)
Title of host publicationMMSys'10 - Proceedings of the 2010 ACM SIGMM Conference on Multimedia Systems
Pages293-304
Number of pages12
DOIs
StatePublished - Apr 29 2010
Externally publishedYes
Event2010 ACM SIGMM Conference on Multimedia Systems, MMSys'10 - Phoenix, AZ, United States
Duration: Feb 22 2010Feb 23 2010

Publication series

NameMMSys'10 - Proceedings of the 2010 ACM SIGMM Conference on Multimedia Systems

Other

Other2010 ACM SIGMM Conference on Multimedia Systems, MMSys'10
CountryUnited States
CityPhoenix, AZ
Period2/22/102/23/10

Keywords

  • Adaptation
  • Evaluation
  • Kinematic deficit index
  • Mixed reality rehabilitation
  • Multimedia feedback

ASJC Scopus subject areas

  • Computer Graphics and Computer-Aided Design
  • Software

Fingerprint Dive into the research topics of 'Adaptive mixed reality stroke rehabilitation: System architecture and evaluation metrics'. Together they form a unique fingerprint.

Cite this