A system for monitoring the engagement of remote online students using eye gaze estimation

Pooya Khorrami, Vuong Le, John C Hart, Thomas S Huang

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

We present a system for monitoring the engagement of remote students in an online educational environment. We introduce a novel gaze estimation system that uses a client-side video-based 3D face tracking algorithm, and expands it to estimate the head pose, and intersects this pose-based gaze line of sight with the screen (coplanar with the camera) to estimate the screen position currently viewed. Our preliminary experiments indicate this approach can accurately determine the coarse location of a student's gaze and use it as a cue for engagement estimation. Our system operates in real-time and achieves comparable performance to state-of-the-art gaze estimation techniques that account for free head motion.

Original languageEnglish (US)
Title of host publication2014 IEEE International Conference on Multimedia and Expo Workshops, ICMEW 2014
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9781479947171
DOIs
StatePublished - Sep 3 2014
Event2014 IEEE International Conference on Multimedia and Expo Workshops, ICMEW 2014 - Chengdu, China
Duration: Jul 14 2014Jul 18 2014

Publication series

Name2014 IEEE International Conference on Multimedia and Expo Workshops, ICMEW 2014

Other

Other2014 IEEE International Conference on Multimedia and Expo Workshops, ICMEW 2014
CountryChina
CityChengdu
Period7/14/147/18/14

Fingerprint

Students
Monitoring
Cameras
Experiments

Keywords

  • Face Tracking
  • Gaze Estimation
  • Head Pose Estimation
  • Student Monitoring System

ASJC Scopus subject areas

  • Computer Graphics and Computer-Aided Design
  • Computer Vision and Pattern Recognition
  • Human-Computer Interaction

Cite this

Khorrami, P., Le, V., Hart, J. C., & Huang, T. S. (2014). A system for monitoring the engagement of remote online students using eye gaze estimation. In 2014 IEEE International Conference on Multimedia and Expo Workshops, ICMEW 2014 [6890573] (2014 IEEE International Conference on Multimedia and Expo Workshops, ICMEW 2014). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/ICMEW.2014.6890573

A system for monitoring the engagement of remote online students using eye gaze estimation. / Khorrami, Pooya; Le, Vuong; Hart, John C; Huang, Thomas S.

2014 IEEE International Conference on Multimedia and Expo Workshops, ICMEW 2014. Institute of Electrical and Electronics Engineers Inc., 2014. 6890573 (2014 IEEE International Conference on Multimedia and Expo Workshops, ICMEW 2014).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Khorrami, P, Le, V, Hart, JC & Huang, TS 2014, A system for monitoring the engagement of remote online students using eye gaze estimation. in 2014 IEEE International Conference on Multimedia and Expo Workshops, ICMEW 2014., 6890573, 2014 IEEE International Conference on Multimedia and Expo Workshops, ICMEW 2014, Institute of Electrical and Electronics Engineers Inc., 2014 IEEE International Conference on Multimedia and Expo Workshops, ICMEW 2014, Chengdu, China, 7/14/14. https://doi.org/10.1109/ICMEW.2014.6890573
Khorrami P, Le V, Hart JC, Huang TS. A system for monitoring the engagement of remote online students using eye gaze estimation. In 2014 IEEE International Conference on Multimedia and Expo Workshops, ICMEW 2014. Institute of Electrical and Electronics Engineers Inc. 2014. 6890573. (2014 IEEE International Conference on Multimedia and Expo Workshops, ICMEW 2014). https://doi.org/10.1109/ICMEW.2014.6890573
Khorrami, Pooya ; Le, Vuong ; Hart, John C ; Huang, Thomas S. / A system for monitoring the engagement of remote online students using eye gaze estimation. 2014 IEEE International Conference on Multimedia and Expo Workshops, ICMEW 2014. Institute of Electrical and Electronics Engineers Inc., 2014. (2014 IEEE International Conference on Multimedia and Expo Workshops, ICMEW 2014).
@inproceedings{eee0791f85c04e74bcb38941223d8a32,
title = "A system for monitoring the engagement of remote online students using eye gaze estimation",
abstract = "We present a system for monitoring the engagement of remote students in an online educational environment. We introduce a novel gaze estimation system that uses a client-side video-based 3D face tracking algorithm, and expands it to estimate the head pose, and intersects this pose-based gaze line of sight with the screen (coplanar with the camera) to estimate the screen position currently viewed. Our preliminary experiments indicate this approach can accurately determine the coarse location of a student's gaze and use it as a cue for engagement estimation. Our system operates in real-time and achieves comparable performance to state-of-the-art gaze estimation techniques that account for free head motion.",
keywords = "Face Tracking, Gaze Estimation, Head Pose Estimation, Student Monitoring System",
author = "Pooya Khorrami and Vuong Le and Hart, {John C} and Huang, {Thomas S}",
year = "2014",
month = "9",
day = "3",
doi = "10.1109/ICMEW.2014.6890573",
language = "English (US)",
series = "2014 IEEE International Conference on Multimedia and Expo Workshops, ICMEW 2014",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
booktitle = "2014 IEEE International Conference on Multimedia and Expo Workshops, ICMEW 2014",
address = "United States",

}

TY - GEN

T1 - A system for monitoring the engagement of remote online students using eye gaze estimation

AU - Khorrami, Pooya

AU - Le, Vuong

AU - Hart, John C

AU - Huang, Thomas S

PY - 2014/9/3

Y1 - 2014/9/3

N2 - We present a system for monitoring the engagement of remote students in an online educational environment. We introduce a novel gaze estimation system that uses a client-side video-based 3D face tracking algorithm, and expands it to estimate the head pose, and intersects this pose-based gaze line of sight with the screen (coplanar with the camera) to estimate the screen position currently viewed. Our preliminary experiments indicate this approach can accurately determine the coarse location of a student's gaze and use it as a cue for engagement estimation. Our system operates in real-time and achieves comparable performance to state-of-the-art gaze estimation techniques that account for free head motion.

AB - We present a system for monitoring the engagement of remote students in an online educational environment. We introduce a novel gaze estimation system that uses a client-side video-based 3D face tracking algorithm, and expands it to estimate the head pose, and intersects this pose-based gaze line of sight with the screen (coplanar with the camera) to estimate the screen position currently viewed. Our preliminary experiments indicate this approach can accurately determine the coarse location of a student's gaze and use it as a cue for engagement estimation. Our system operates in real-time and achieves comparable performance to state-of-the-art gaze estimation techniques that account for free head motion.

KW - Face Tracking

KW - Gaze Estimation

KW - Head Pose Estimation

KW - Student Monitoring System

UR - http://www.scopus.com/inward/record.url?scp=84937124426&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84937124426&partnerID=8YFLogxK

U2 - 10.1109/ICMEW.2014.6890573

DO - 10.1109/ICMEW.2014.6890573

M3 - Conference contribution

AN - SCOPUS:84937124426

T3 - 2014 IEEE International Conference on Multimedia and Expo Workshops, ICMEW 2014

BT - 2014 IEEE International Conference on Multimedia and Expo Workshops, ICMEW 2014

PB - Institute of Electrical and Electronics Engineers Inc.

ER -