Mining and Assessing Anomalies in Students’ Online Learning Activities with Self-supervised Machine Learning

Lan Jiang, Nigel Bosch

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Two students in the same course working toward the same learning objectives may have very different strategies. However, on average, there are likely to be some patterns of student actions that are more common than others, especially when students are implementing typical self-regulated learning strategies. In this paper, we focus on distinguishing between students’ typical actions and unusual, anomalous sequences of actions. We define anomalous activities as unexpected activities given a student’s preceding activities. We distinguish these anomalies by training a self-supervised neural network to determine how predictable activities happen (the complement of which are anomalies). A random forest model trained to predict course grades from anomaly-based features showed that anomalous actions were significant predictors of course grade (mean Pearson’s r = .399 across 7 courses). We also explore whether humans regard the anomalous activities labeled by the model as anomalies by asking people to label 20 example sequences. We further discuss the implications of our method and how detecting and understanding anomalies could potentially help improve students’ learning experiences.

Original languageEnglish (US)
Title of host publicationProceedings of the 15th International Conference on Educational Data Mining, EDM 2022
PublisherInternational Educational Data Mining Society
ISBN (Electronic)9781733673631
DOIs
StatePublished - 2022
Event15th International Conference on Educational Data Mining, EDM 2022 - Hybrid, Durham, United Kingdom
Duration: Jul 24 2022Jul 27 2022

Publication series

NameProceedings of the 15th International Conference on Educational Data Mining, EDM 2022

Conference

Conference15th International Conference on Educational Data Mining, EDM 2022
Country/TerritoryUnited Kingdom
CityHybrid, Durham
Period7/24/227/27/22

Keywords

  • Anomalies
  • Human understanding of anomalies
  • Log activities

ASJC Scopus subject areas

  • Computer Science Applications
  • Information Systems

Fingerprint

Dive into the research topics of 'Mining and Assessing Anomalies in Students’ Online Learning Activities with Self-supervised Machine Learning'. Together they form a unique fingerprint.

Cite this