Exploring Gestural Agency in Collaborative and Embodied Rates of Change Simulations

James Planey, Robb Lindgren

Research output: Chapter in Book/Report/Conference proceedingChapter

Abstract

This chapter describes the theories, design, and analysis applied to a pair of collaborative mixed-reality simulations addressing different scientific content but linked by the crosscutting concept of “rates of change”. Body tracking technologies allowed users to interact with these simulations using one of two conventions: through gestures chosen by participants, or a prescribed gesture representing the slope of a line using one’s arms. The two simulations explore the relationship between inputs and outputs in the context of population ecology and climate change systems. Participant pairs were randomly assigned to one of 4 treatment groups for gestural convention (learner-defined or prescribed) and simulation order (population ecology or climate change first). Knowledge and engagement surveys found a significant overall increase in individual knowledge, but no significant difference across the four treatments. This motivated deeper analysis of the dialog and actions of the participant pairs as they engaged with the system, where it was found that the order of simulation exposure produced a shift in the ratio between collaborative directives and simulation behavior dialog. In addition, the gestures recorded in the learner-defined gesture group were also leveraged in un-expected ways, such as in facilitating synchronization between partners.
Original languageEnglish (US)
Title of host publicationMixed Reality for Education
EditorsYiyu Cai, Eleni Mangina, Sui Lin Goei
Place of PublicationSingapore
PublisherSpringer
Pages265-280
Number of pages16
ISBN (Electronic)978-981-99-4958-8
ISBN (Print)978-981-99-4957-1, 978-981-99-4960-1
DOIs
StatePublished - 2023

Publication series

NameGaming Media and Social Effects
ISSN (Print)2197-9685
ISSN (Electronic)2197-9693

Fingerprint

Dive into the research topics of 'Exploring Gestural Agency in Collaborative and Embodied Rates of Change Simulations'. Together they form a unique fingerprint.

Cite this