Gesture's Role in Collaborative Problem Solving With Augmented Reality

James Planey, Robin Jephthah Rajarathinam, Emma Mary Mercier, Robb Lindgren, Rachel Zhou

Research output: Chapter in Book/Report/Conference proceedingConference contribution


Headset-based augmented reality (AR) unlocks unique opportunities to integrate gestures into collaborative problem-solving activities. This paper documents a collaborative astronomy sky simulation across AR and tablet technologies. Two groups of students were identified from a larger data corpus based on the amount of interactions within the AR headset. These groups were coded for episodes of on-task problem solving and instances of collaboration involving gestures. Gesture interaction analysis assisted in identifying collections of interactions facilitating exploration, orientation, perspective-sharing and communication of mental models. These patterns of interactions suggest productive use of AR technologies to collaborate and problem solve through the use of gestures.

Original languageEnglish (US)
Title of host publication15th International Conference on Computer-Supported Collaborative Learning
Subtitle of host publicationInternational Collaboration Toward Educational Innovation for All: Overarching Research, Development, and Practices, CSCL 2022 - Proceedings, part of the 2nd Annual Meeting of the International Society of the Learning Sciences, ISLS 2022
EditorsArmin Weinberger, Wenli Chen, Davinia Hernandez-Leo, Bodong Chen
PublisherInternational Society of the Learning Sciences (ISLS)
Number of pages4
ISBN (Electronic)9781737330646
StatePublished - 2022
Event15th International Conference on Computer-Supported Collaborative Learning, CSCL 2022 - Hiroshima, Japan
Duration: Jun 6 2022Jun 10 2022

Publication series

NameComputer-Supported Collaborative Learning Conference, CSCL
ISSN (Print)1573-4552


Conference15th International Conference on Computer-Supported Collaborative Learning, CSCL 2022

ASJC Scopus subject areas

  • Human-Computer Interaction
  • Education


Dive into the research topics of 'Gesture's Role in Collaborative Problem Solving With Augmented Reality'. Together they form a unique fingerprint.

Cite this