TY - JOUR
T1 - Investigating the suitability of online eye tracking for psychological research
T2 - Evidence from comparisons with in-person data using emotion–attention interaction tasks
AU - Bogdan, Paul C.
AU - Dolcos, Sanda
AU - Buetti, Simona
AU - Lleras, Alejandro
AU - Dolcos, Florin
N1 - This research was carried out in part at the University of Illinois\u2019 Beckman Institute for Advanced Science & Technology. During the preparation of this manuscript, P.C.B. was supported by a Predoctoral Fellowship provided by the Beckman Foundation and a Dissertation Completion Fellowship provided by the University of Illinois, and F.D. was supported by an Emanuel Donchin Professorial Scholarship in Psychology from the University of Illinois. The authors thank Margaret O\u2019Brien, Anna Madison, and Chen Shen for their assistance with data collection for the in-person versions of the tasks. The authors also thank Dolcos Lab members for their help with stimulus creation.
This research was carried out in part at the University of Illinois\u2019 Beckman Institute for Advanced Science & Technology. During the preparation of this manuscript, P.C.B. was supported by a Predoctoral Fellowship provided by the Beckman Foundation\u00A0and a Dissertation Completion Fellowship provided by the University of Illinois, and F.D.\u00A0was supported by an Emanuel Donchin Professorial Scholarship in Psychology from the University of Illinois. The authors thank Margaret O\u2019Brien, Anna Madison, and Chen Shen for their assistance with data collection for the in-person versions of the tasks. The authors also thank Dolcos Lab members for their help with stimulus creation. The analysis code has been deposited\u00A0in a public GitHub repository, alongside the data (https://github.com/paulcbogdan/Suitability_Online_ET).
PY - 2024/3
Y1 - 2024/3
N2 - The future is bound to bring rapid methodological changes to psychological research. One such promising candidate is the use of webcam-based eye tracking. Earlier research investigating the quality of online eye-tracking data has found increased spatial and temporal error compared to infrared recordings. Our studies expand on this work by investigating how this spatial error impacts researchers’ abilities to study psychological phenomena. We carried out two studies involving emotion–attention interaction tasks, using four participant samples. In each study, one sample involved typical in-person collection of infrared eye-tracking data, and the other involved online collection of webcam-based data. We had two main findings: First, we found that the online data replicated seven of eight in-person results, although the effect sizes were just 52% [42%, 62%] the size of those seen in-person. Second, explaining the lack of replication in one result, we show how online eye tracking is biased toward recording more gaze points near the center of participants’ screen, which can interfere with comparisons if left unchecked. Overall, our results suggest that well-powered online eye-tracking research is highly feasible, although researchers must exercise caution, collecting more participants and potentially adjusting their stimulus designs or analytic procedures.
AB - The future is bound to bring rapid methodological changes to psychological research. One such promising candidate is the use of webcam-based eye tracking. Earlier research investigating the quality of online eye-tracking data has found increased spatial and temporal error compared to infrared recordings. Our studies expand on this work by investigating how this spatial error impacts researchers’ abilities to study psychological phenomena. We carried out two studies involving emotion–attention interaction tasks, using four participant samples. In each study, one sample involved typical in-person collection of infrared eye-tracking data, and the other involved online collection of webcam-based data. We had two main findings: First, we found that the online data replicated seven of eight in-person results, although the effect sizes were just 52% [42%, 62%] the size of those seen in-person. Second, explaining the lack of replication in one result, we show how online eye tracking is biased toward recording more gaze points near the center of participants’ screen, which can interfere with comparisons if left unchecked. Overall, our results suggest that well-powered online eye-tracking research is highly feasible, although researchers must exercise caution, collecting more participants and potentially adjusting their stimulus designs or analytic procedures.
KW - Affect
KW - Emotion regulation
KW - Emotion-cognition interaction
KW - Gaze
KW - Perception
UR - http://www.scopus.com/inward/record.url?scp=85162239252&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85162239252&partnerID=8YFLogxK
U2 - 10.3758/s13428-023-02143-z
DO - 10.3758/s13428-023-02143-z
M3 - Article
C2 - 37340240
AN - SCOPUS:85162239252
SN - 1554-351X
VL - 56
SP - 2213
EP - 2226
JO - Behavior Research Methods
JF - Behavior Research Methods
IS - 3
ER -