TY - GEN
T1 - It's written on your face
T2 - 12th International Conference on Intelligent Tutoring Systems, ITS 2014
AU - Bosch, Nigel
AU - Chen, Yuxuan
AU - D'Mello, Sidney
PY - 2014
Y1 - 2014
N2 - We built detectors capable of automatically recognizing affective states of novice computer programmers from student-annotated videos of their faces recorded during an introductory programming tutoring session. We used the Computer Expression Recognition Toolbox (CERT) to track facial features based on the Facial Action Coding System, and machine learning techniques to build classification models. Confusion/Uncertainty and Frustration were distinguished from all other affective states in a student-independent fashion at levels above chance (Cohen's kappa =.22 and.23, respectively), but detection accuracies for Boredom, Flow/Engagement, and Neutral were lower (kappas =.04,.11, and.07). We discuss the differences between detection of spontaneous versus fixed (polled) judgments as well as the features used in the models.
AB - We built detectors capable of automatically recognizing affective states of novice computer programmers from student-annotated videos of their faces recorded during an introductory programming tutoring session. We used the Computer Expression Recognition Toolbox (CERT) to track facial features based on the Facial Action Coding System, and machine learning techniques to build classification models. Confusion/Uncertainty and Frustration were distinguished from all other affective states in a student-independent fashion at levels above chance (Cohen's kappa =.22 and.23, respectively), but detection accuracies for Boredom, Flow/Engagement, and Neutral were lower (kappas =.04,.11, and.07). We discuss the differences between detection of spontaneous versus fixed (polled) judgments as well as the features used in the models.
UR - http://www.scopus.com/inward/record.url?scp=84958530004&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=84958530004&partnerID=8YFLogxK
U2 - 10.1007/978-3-319-07221-0_5
DO - 10.1007/978-3-319-07221-0_5
M3 - Conference contribution
AN - SCOPUS:84958530004
SN - 9783319072203
T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
SP - 39
EP - 44
BT - Intelligent Tutoring Systems - 12th International Conference, ITS 2014, Proceedings
PB - Springer
Y2 - 5 June 2014 through 9 June 2014
ER -