TY - JOUR
T1 - Distributing epistemic functions and tasks—A framework for augmenting human analytic power with machine learning in science education research
AU - Kubsch, Marcus
AU - Krist, Christina
AU - Rosenberg, Joshua M.
N1 - Publisher Copyright:
© 2022 The Authors. Journal of Research in Science Teaching published by Wiley Periodicals LLC on behalf of National Association for Research in Science Teaching.
PY - 2023/2
Y1 - 2023/2
N2 - Machine learning (ML) has become commonplace in educational research and science education research, especially to support assessment efforts. Such applications of machine learning have shown their promise in replicating and scaling human-driven codes of students' work. Despite this promise, we and other scholars argue that machine learning has not yet achieved its transformational potential. We argue that this is because our field is currently lacking frameworks for supporting creative, principled, and critical endeavors to use machine learning in science education research. To offer considerations for science education researchers' use of ML, we present a framework, Distributing Epistemic Functions and Tasks (DEFT), that highlights the functions and tasks that pertain to generating knowledge that can be carried out by either trained researchers or machine learning algorithms. Such considerations are critical decisions that should occur alongside those about, for instance, the type of data or algorithm used. We apply this framework to two cases, one that exemplifies the cutting-edge use of machine learning in science education research and another that offers a wholly different means of using machine learning and human-driven inquiry together. We conclude with strategies for researchers to adopt machine learning and call for the field to rethink how we prepare science education researchers in an era of great advances in computational power and access to machine learning methods.
AB - Machine learning (ML) has become commonplace in educational research and science education research, especially to support assessment efforts. Such applications of machine learning have shown their promise in replicating and scaling human-driven codes of students' work. Despite this promise, we and other scholars argue that machine learning has not yet achieved its transformational potential. We argue that this is because our field is currently lacking frameworks for supporting creative, principled, and critical endeavors to use machine learning in science education research. To offer considerations for science education researchers' use of ML, we present a framework, Distributing Epistemic Functions and Tasks (DEFT), that highlights the functions and tasks that pertain to generating knowledge that can be carried out by either trained researchers or machine learning algorithms. Such considerations are critical decisions that should occur alongside those about, for instance, the type of data or algorithm used. We apply this framework to two cases, one that exemplifies the cutting-edge use of machine learning in science education research and another that offers a wholly different means of using machine learning and human-driven inquiry together. We conclude with strategies for researchers to adopt machine learning and call for the field to rethink how we prepare science education researchers in an era of great advances in computational power and access to machine learning methods.
KW - evaluation and theory
KW - science education
KW - validity/reliability
UR - http://www.scopus.com/inward/record.url?scp=85146705751&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85146705751&partnerID=8YFLogxK
U2 - 10.1002/tea.21803
DO - 10.1002/tea.21803
M3 - Article
AN - SCOPUS:85146705751
SN - 0022-4308
VL - 60
SP - 423
EP - 447
JO - Journal of Research in Science Teaching
JF - Journal of Research in Science Teaching
IS - 2
ER -