Immersive multiplayer tennis with microsoft kinect and body sensor networks

Suraj Raghuraman, Karthik Venkatraman, Zhanyu Wang, Jian Wu, Jacob Clements, Reza Lotfian, Balakrishnan Prabhakaran, Xiaohu Guo, Roozbeh Jafari, Klara Nahrstedt

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

We present an immersive gaming demonstration using the minimum amount of wearable sensors. The game demonstrated is two-player tennis. We combine a virtual environment with real 3D representations of physical objects like the players and the tennis racquet (if available). The main objective of the game is to provide as real an experience of tennis as possible, while also being as less intrusive as possible. The game is played across a network, and this opens the possibility of two remote players playing a game together on a single virtual tennis pitch. The Microsoft Kinect sensors are used to obtain a 3D point cloud and a skeletal map representation of the player. This 3D point cloud is mapped on to the virtual tennis pitch. We also use a wireless wearable Attitude and Heading Reference System (AHRS) mote, which is strapped onto the wrist of the players. This mote gives us precise information about the movement (swing, rotation etc.) of the playing arm. This information along with the skeletal map is used to implement the physics of the game. Using this game we demonstrate our solutions for simultaneous data acquisition, 3D point-cloud mapping in a virtual space, use of the Kinect and AHRS sensors to calibrate real and virtual objects and for interaction of virtual objects with a 3D point cloud.

Original languageEnglish (US)
Title of host publicationMM 2012 - Proceedings of the 20th ACM International Conference on Multimedia
Pages1481-1484
Number of pages4
DOIs
StatePublished - Dec 26 2012
Event20th ACM International Conference on Multimedia, MM 2012 - Nara, Japan
Duration: Oct 29 2012Nov 2 2012

Publication series

NameMM 2012 - Proceedings of the 20th ACM International Conference on Multimedia

Other

Other20th ACM International Conference on Multimedia, MM 2012
CountryJapan
CityNara
Period10/29/1211/2/12

Keywords

  • gaming
  • tele-immersion
  • virtual reality
  • wireless sensor networks

ASJC Scopus subject areas

  • Computer Graphics and Computer-Aided Design
  • Human-Computer Interaction
  • Software

Fingerprint Dive into the research topics of 'Immersive multiplayer tennis with microsoft kinect and body sensor networks'. Together they form a unique fingerprint.

  • Cite this

    Raghuraman, S., Venkatraman, K., Wang, Z., Wu, J., Clements, J., Lotfian, R., Prabhakaran, B., Guo, X., Jafari, R., & Nahrstedt, K. (2012). Immersive multiplayer tennis with microsoft kinect and body sensor networks. In MM 2012 - Proceedings of the 20th ACM International Conference on Multimedia (pp. 1481-1484). (MM 2012 - Proceedings of the 20th ACM International Conference on Multimedia). https://doi.org/10.1145/2393347.2396526