Automatic assessment of comment quality in active video watching

Negar Mohammadhassan, Antonija Mitrovic, Kourosh Neshatian, Jonathan Dunn

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Active Video Watching (AVW-Space) is an online platform for video-based learning which supports engagement via note-taking and personalized nudges. In this paper, we focus on the quality of the comments students write. We propose two schemes for assessing the quality of comments. Then, we evaluate these schemes by computing the inter-coder agreement. We also evaluate various machine learning classifiers to automate the assessment of comments. The selected cost-sensitive classifier shows that the quality of comments can be assessed with high weighted-F1 scores. This study contributes to the automation of comment quality assessment and the development of personalized educational support for engagement in video-based learning through commenting.

Original languageEnglish (US)
Title of host publicationICCE 2020 - 28th International Conference on Computers in Education, Proceedings
EditorsHyo-Jeong So, Ma. Mercedes Rodrigo, Jon Mason, Antonija Mitrovic, Daniel Bodemer, Weichao Chen, Zhi-Hong Chen, Brendan Flanagan, Marc Jansen, Roger Nkambou, Longkai Wu
PublisherAsia-Pacific Society for Computers in Education
Pages1-10
Number of pages10
ISBN (Electronic)9789869721455
StatePublished - Nov 23 2020
Externally publishedYes
Event28th International Conference on Computers in Education, ICCE 2020 - Virtual, Online
Duration: Nov 23 2020Nov 27 2020

Conference

Conference28th International Conference on Computers in Education, ICCE 2020
CityVirtual, Online
Period11/23/2011/27/20

Keywords

  • Applied Machine Learning
  • Learning Analytics
  • Text Classification
  • Video-based Learning

ASJC Scopus subject areas

  • Computer Science (miscellaneous)
  • Computer Science Applications
  • Education

Fingerprint

Dive into the research topics of 'Automatic assessment of comment quality in active video watching'. Together they form a unique fingerprint.

Cite this