Express it! An interactive system for visualizing expressiveness of conductor's gestures

Kyungho Lee, Donna J Cox, Guy E Garnett, Michael J. Junokas

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

A conductor provides a single unified vision of how to interpret and perform music. However, perceiving a conductor's musical intention and expression is quite challenging as they convey information to performers with subtle, nuanced, and highly individualized gestures. This artwork visualizes the conductor's gestures in order to give the audience a better understanding of its expressivity. To represent the expressivity of the gestures, we created motion profiles over eight frames, at 30 frames per second, and compared them to previously modeled gestures using three motion factors, called Weight, Space and Time from related concepts in Laban Movement Analysis (LMA). Based on this, we have created a real-time, interactive visualization that is driven by the motion factor parameters. The visualization receives the input video stream, and it is transformed into a representation of the three motion factors extracted from the real-time conducting gestures.

Original languageEnglish (US)
Title of host publicationC and C 2015 - Proceedings of the 2015 ACM SIGCHI Conference on Creativity and Cognition
PublisherAssociation for Computing Machinery, Inc
Pages141-150
Number of pages10
ISBN (Electronic)9781450335980
DOIs
StatePublished - Jun 22 2015
EventACM SIGCHI Conference on Creativity and Cognition, C and C 2015 - Glasgow, United Kingdom
Duration: Jun 22 2015Jun 25 2015

Publication series

NameC and C 2015 - Proceedings of the 2015 ACM SIGCHI Conference on Creativity and Cognition

Other

OtherACM SIGCHI Conference on Creativity and Cognition, C and C 2015
CountryUnited Kingdom
CityGlasgow
Period6/22/156/25/15

Keywords

  • Conductor's gestures
  • Expressivity
  • Gesture recognition
  • Music
  • Visualization

ASJC Scopus subject areas

  • Software

Fingerprint Dive into the research topics of 'Express it! An interactive system for visualizing expressiveness of conductor's gestures'. Together they form a unique fingerprint.

Cite this