Cross-system transfer of machine learned and knowledge engineered models of gaming the system

Luc Paquette, Ryan S. Baker, Adriana de Carvalho, Jaclyn Ocumpaugh

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Replicable research on the behavior known as gaming the system, in which students try to succeed by exploiting the functionalities of a learning environment instead of learning the material, has shown it is negatively correlated with learning outcomes. As such, many have developed models that can automatically detect gaming behaviors, towards deploying them in online learning environments. Both machine learning and knowledge engineering approaches have been used to create models for a variety of software systems, but the development of these models is often quite time consuming. In this paper, we investigate how well different kinds of models generalize across learning environments, specifically studying how effectively four gaming models previously created for the Cognitive Tutor Algebra tutoring system function when applied to data from two alternate learning environments: the scatterplot lesson of Cognitive Tutor Middle School and ASSISTments. Our results suggest that the similarity between the systems our model are transferred between and the nature of the approach used to create the model impact transfer to new systems.

Original languageEnglish (US)
Title of host publicationUser Modeling, Adaptation and Personalization - 23rd International Conference, UMAP 2015, Proceedings
EditorsKalina Bontcheva, Francesco Ricci, Owen Conlan, Séamus Lawless
PublisherSpringer
Pages189-194
Number of pages6
ISBN (Electronic)9783319202662
DOIs
StatePublished - 2015
Externally publishedYes
Event23rd International Conference on User Modeling, Adaptation and Personalization, UMAP 2015 - Dublin, Ireland
Duration: Jun 29 2015Jul 3 2015

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume9146
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Other

Other23rd International Conference on User Modeling, Adaptation and Personalization, UMAP 2015
Country/TerritoryIreland
CityDublin
Period6/29/157/3/15

Keywords

  • ASSISTments
  • Cognitive modeling
  • Cognitive tutors
  • Cross-system transfer
  • Gaming the system
  • Machine Learning

ASJC Scopus subject areas

  • Theoretical Computer Science
  • General Computer Science

Fingerprint

Dive into the research topics of 'Cross-system transfer of machine learned and knowledge engineered models of gaming the system'. Together they form a unique fingerprint.

Cite this