TY - JOUR
T1 - The Role of Context in Educational RCT Findings
T2 - A Call to Redefine “Evidence-Based Practice”
AU - Kaplan, Avi
AU - Cromley, Jennifer
AU - Perez, Tony
AU - Dai, Ting
AU - Mara, Kyle
AU - Balsai, Michael
N1 - Publisher Copyright:
© 2020 AERA.
PY - 2020/5/1
Y1 - 2020/5/1
N2 - In this commentary, we complement other constructive critiques of educational randomized control trials (RCTs) by calling attention to the commonly ignored role of context in causal mechanisms undergirding educational phenomena. We argue that evidence for the central role of context in causal mechanisms challenges the assumption that RCT findings can be uncritically generalized across settings. Anchoring our argument with an example from our own multistudy RCT project, we argue that the scientific pursuit of causal explanation should involve the rich description of contextualized causal effects. We further call for incorporating the evidence of the integral role of context in causal mechanisms into the meaning of “evidence-based practice,” with the implication that effective implementation of practice in a new setting must involve context-oriented, evidence-focused, design-based research that attends to the emergent, complex, and dynamic nature of educational contexts.
AB - In this commentary, we complement other constructive critiques of educational randomized control trials (RCTs) by calling attention to the commonly ignored role of context in causal mechanisms undergirding educational phenomena. We argue that evidence for the central role of context in causal mechanisms challenges the assumption that RCT findings can be uncritically generalized across settings. Anchoring our argument with an example from our own multistudy RCT project, we argue that the scientific pursuit of causal explanation should involve the rich description of contextualized causal effects. We further call for incorporating the evidence of the integral role of context in causal mechanisms into the meaning of “evidence-based practice,” with the implication that effective implementation of practice in a new setting must involve context-oriented, evidence-focused, design-based research that attends to the emergent, complex, and dynamic nature of educational contexts.
KW - classroom research
KW - experimental research
KW - learning environments
KW - research utilization
UR - http://www.scopus.com/inward/record.url?scp=85085192213&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85085192213&partnerID=8YFLogxK
U2 - 10.3102/0013189X20921862
DO - 10.3102/0013189X20921862
M3 - Comment/debate
AN - SCOPUS:85085192213
SN - 0013-189X
VL - 49
SP - 285
EP - 288
JO - Educational Researcher
JF - Educational Researcher
IS - 4
ER -