H-TIME: Haptic-enabled tele-immersive musculoskeletal examination

Yuan Tian, Suraj Raghuraman, Thiru Annaswamy, Aleksander Borresenr, Klara Nahrstedt, Balakrishnan Prabhakaran

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

The current state-of-the-art tele-medicine applications only allow audiovisual communication between a doctor and the patient, necessitating a clinician to physically examine the patient. The doctor relies on the physical examination performed by the clinician, along with the audiovisual dialogue with the patient. In this paper, a Haptic-enabled Tele-Immersive Musculoskeletal Examination (H-TIME) system is introduced, that allows doctors to physically examine musculoskeletal conditions of the patients remotely, by looking at the 3D reconstructed model of the patient in the virtual world, and physically feeling the patient's range of mobility using a haptic device. The proposed bidirectional haptic rendering in H-TIME can allow the doctor to evaluate a patient who suffers from problems in their upper extremities, such as the shoulder, elbow, wrist, etc., and evaluate them remotely. Real world user study was performed, between the doctors and the patients, and it highlighted the potential of the proposed system. The study indicated a high degree of correlation between the in-person and H-TIME evaluations of the patient. Both the doctors and patients involved in the study, felt that the system could potentially replace in-person consultations, someday.

LanguageEnglish (US)
Title of host publicationMM 2017 - Proceedings of the 2017 ACM Multimedia Conference
PublisherAssociation for Computing Machinery, Inc
Pages137-145
Number of pages9
ISBN (Electronic)9781450349062
DOIs
StatePublished - Oct 23 2017
Event25th ACM International Conference on Multimedia, MM 2017 - Mountain View, United States
Duration: Oct 23 2017Oct 27 2017

Other

Other25th ACM International Conference on Multimedia, MM 2017
CountryUnited States
CityMountain View
Period10/23/1710/27/17

Fingerprint

Telemedicine
Communication

Keywords

  • 3D tele-immersion
  • Haptics
  • Mixed reality
  • Physiotherapy
  • Tele-medicine

ASJC Scopus subject areas

  • Computer Graphics and Computer-Aided Design
  • Media Technology
  • Computer Vision and Pattern Recognition
  • Software

Cite this

Tian, Y., Raghuraman, S., Annaswamy, T., Borresenr, A., Nahrstedt, K., & Prabhakaran, B. (2017). H-TIME: Haptic-enabled tele-immersive musculoskeletal examination. In MM 2017 - Proceedings of the 2017 ACM Multimedia Conference (pp. 137-145). Association for Computing Machinery, Inc. https://doi.org/10.1145/3123266.3123395

H-TIME : Haptic-enabled tele-immersive musculoskeletal examination. / Tian, Yuan; Raghuraman, Suraj; Annaswamy, Thiru; Borresenr, Aleksander; Nahrstedt, Klara; Prabhakaran, Balakrishnan.

MM 2017 - Proceedings of the 2017 ACM Multimedia Conference. Association for Computing Machinery, Inc, 2017. p. 137-145.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Tian, Y, Raghuraman, S, Annaswamy, T, Borresenr, A, Nahrstedt, K & Prabhakaran, B 2017, H-TIME: Haptic-enabled tele-immersive musculoskeletal examination. in MM 2017 - Proceedings of the 2017 ACM Multimedia Conference. Association for Computing Machinery, Inc, pp. 137-145, 25th ACM International Conference on Multimedia, MM 2017, Mountain View, United States, 10/23/17. https://doi.org/10.1145/3123266.3123395
Tian Y, Raghuraman S, Annaswamy T, Borresenr A, Nahrstedt K, Prabhakaran B. H-TIME: Haptic-enabled tele-immersive musculoskeletal examination. In MM 2017 - Proceedings of the 2017 ACM Multimedia Conference. Association for Computing Machinery, Inc. 2017. p. 137-145 https://doi.org/10.1145/3123266.3123395
Tian, Yuan ; Raghuraman, Suraj ; Annaswamy, Thiru ; Borresenr, Aleksander ; Nahrstedt, Klara ; Prabhakaran, Balakrishnan. / H-TIME : Haptic-enabled tele-immersive musculoskeletal examination. MM 2017 - Proceedings of the 2017 ACM Multimedia Conference. Association for Computing Machinery, Inc, 2017. pp. 137-145
@inproceedings{6cf72c1d7ffa4c0680c786852ebe55e6,
title = "H-TIME: Haptic-enabled tele-immersive musculoskeletal examination",
abstract = "The current state-of-the-art tele-medicine applications only allow audiovisual communication between a doctor and the patient, necessitating a clinician to physically examine the patient. The doctor relies on the physical examination performed by the clinician, along with the audiovisual dialogue with the patient. In this paper, a Haptic-enabled Tele-Immersive Musculoskeletal Examination (H-TIME) system is introduced, that allows doctors to physically examine musculoskeletal conditions of the patients remotely, by looking at the 3D reconstructed model of the patient in the virtual world, and physically feeling the patient's range of mobility using a haptic device. The proposed bidirectional haptic rendering in H-TIME can allow the doctor to evaluate a patient who suffers from problems in their upper extremities, such as the shoulder, elbow, wrist, etc., and evaluate them remotely. Real world user study was performed, between the doctors and the patients, and it highlighted the potential of the proposed system. The study indicated a high degree of correlation between the in-person and H-TIME evaluations of the patient. Both the doctors and patients involved in the study, felt that the system could potentially replace in-person consultations, someday.",
keywords = "3D tele-immersion, Haptics, Mixed reality, Physiotherapy, Tele-medicine",
author = "Yuan Tian and Suraj Raghuraman and Thiru Annaswamy and Aleksander Borresenr and Klara Nahrstedt and Balakrishnan Prabhakaran",
year = "2017",
month = "10",
day = "23",
doi = "10.1145/3123266.3123395",
language = "English (US)",
pages = "137--145",
booktitle = "MM 2017 - Proceedings of the 2017 ACM Multimedia Conference",
publisher = "Association for Computing Machinery, Inc",

}

TY - GEN

T1 - H-TIME

T2 - Haptic-enabled tele-immersive musculoskeletal examination

AU - Tian, Yuan

AU - Raghuraman, Suraj

AU - Annaswamy, Thiru

AU - Borresenr, Aleksander

AU - Nahrstedt, Klara

AU - Prabhakaran, Balakrishnan

PY - 2017/10/23

Y1 - 2017/10/23

N2 - The current state-of-the-art tele-medicine applications only allow audiovisual communication between a doctor and the patient, necessitating a clinician to physically examine the patient. The doctor relies on the physical examination performed by the clinician, along with the audiovisual dialogue with the patient. In this paper, a Haptic-enabled Tele-Immersive Musculoskeletal Examination (H-TIME) system is introduced, that allows doctors to physically examine musculoskeletal conditions of the patients remotely, by looking at the 3D reconstructed model of the patient in the virtual world, and physically feeling the patient's range of mobility using a haptic device. The proposed bidirectional haptic rendering in H-TIME can allow the doctor to evaluate a patient who suffers from problems in their upper extremities, such as the shoulder, elbow, wrist, etc., and evaluate them remotely. Real world user study was performed, between the doctors and the patients, and it highlighted the potential of the proposed system. The study indicated a high degree of correlation between the in-person and H-TIME evaluations of the patient. Both the doctors and patients involved in the study, felt that the system could potentially replace in-person consultations, someday.

AB - The current state-of-the-art tele-medicine applications only allow audiovisual communication between a doctor and the patient, necessitating a clinician to physically examine the patient. The doctor relies on the physical examination performed by the clinician, along with the audiovisual dialogue with the patient. In this paper, a Haptic-enabled Tele-Immersive Musculoskeletal Examination (H-TIME) system is introduced, that allows doctors to physically examine musculoskeletal conditions of the patients remotely, by looking at the 3D reconstructed model of the patient in the virtual world, and physically feeling the patient's range of mobility using a haptic device. The proposed bidirectional haptic rendering in H-TIME can allow the doctor to evaluate a patient who suffers from problems in their upper extremities, such as the shoulder, elbow, wrist, etc., and evaluate them remotely. Real world user study was performed, between the doctors and the patients, and it highlighted the potential of the proposed system. The study indicated a high degree of correlation between the in-person and H-TIME evaluations of the patient. Both the doctors and patients involved in the study, felt that the system could potentially replace in-person consultations, someday.

KW - 3D tele-immersion

KW - Haptics

KW - Mixed reality

KW - Physiotherapy

KW - Tele-medicine

UR - http://www.scopus.com/inward/record.url?scp=85035220605&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85035220605&partnerID=8YFLogxK

U2 - 10.1145/3123266.3123395

DO - 10.1145/3123266.3123395

M3 - Conference contribution

SP - 137

EP - 145

BT - MM 2017 - Proceedings of the 2017 ACM Multimedia Conference

PB - Association for Computing Machinery, Inc

ER -