Tracking Individuals in Classroom Videos via Post-processing OpenPose Data

Paul Hur, Nigel Bosch

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Analyzing classroom video data provides valuable insights about the interactions between students and teachers, albeit often through time-consuming qualitative coding or the use of bespoke sensors to record individual movement information. We explore measuring classroom posture and movement in secondary classroom video data through computer vision methods (especially OpenPose), and introduce a simple but effective approach to automatically track movement via post-processing of OpenPose output data. Analysis of 67 videos of mathematics classes from middle school and high school levels highlighted the challenges associated with analyzing movement in typical classroom videos: occlusion from low camera angles, difficulty detecting lower body movement due to sitting, and the close proximity of students to one another and their teachers. Despite these challenges, our approach tracked person IDs across classroom videos for 93.0% of detected individuals. The tracking results were manually verified through randomly sampling 240 instances, which revealed notable OpenPose tracking inconsistencies. Finally, we discuss the implications for supporting more scalability of video data classroom movement analysis, and future potential explorations.

Original languageEnglish (US)
Title of host publicationLAK 2022 - Conference Proceedings
Subtitle of host publicationLearning Analytics for Transition, Disruption and Social Change - 12th International Conference on Learning Analytics and Knowledge
PublisherAssociation for Computing Machinery
Pages465-471
Number of pages7
ISBN (Electronic)9781450395731
DOIs
StatePublished - Mar 21 2022
Event12th International Conference on Learning Analytics and Knowledge: Learning Analytics for Transition, Disruption and Social Change, LAK 2022 - Virtual, Online, United States
Duration: Mar 21 2022Mar 25 2022

Publication series

NameACM International Conference Proceeding Series

Conference

Conference12th International Conference on Learning Analytics and Knowledge: Learning Analytics for Transition, Disruption and Social Change, LAK 2022
Country/TerritoryUnited States
CityVirtual, Online
Period3/21/223/25/22

Keywords

  • classroom video
  • movement
  • posture
  • video analysis

ASJC Scopus subject areas

  • Software
  • Human-Computer Interaction
  • Computer Vision and Pattern Recognition
  • Computer Networks and Communications

Fingerprint

Dive into the research topics of 'Tracking Individuals in Classroom Videos via Post-processing OpenPose Data'. Together they form a unique fingerprint.

Cite this