TY - JOUR
T1 - Technology-Enhanced Items in Grades 1–12 English Language Proficiency Assessments
AU - Kim, Ahyoung Alicia
AU - Tywoniw, Rurik L.
AU - Chapman, Mark
N1 - Publisher Copyright:
© 2022 Taylor & Francis.
PY - 2022
Y1 - 2022
N2 - Technology-enhanced items (TEIs) are innovative, computer-delivered test items that allow test takers to better interact with the test environment compared to traditional multiple-choice items (MCIs). The interactive nature of TEIs offer improved construct coverage compared with MCIs but little research exists regarding students’ performance on TEIs versus MCIs in English language proficiency (ELP) assessments. This study examines the performance of Grades 1–12 English learners (ELs) on TEIs and MCIs in an online reading test. The test included TEI and MCI content-matched pairs that shared the same reading input but differed in response mode. We analyzed 1.2 million ELs’ scores across five different grade-level clusters: 1, 2–3, 4–5, 6–8, and 9–12. Items were evaluated for difficulty, discrimination, and information using Item Response Theory. Additionally, efficiency was investigated using the amount of information provided and item duration. TEIs were slightly more difficult than MCIs, but they did not differ in discriminative power. Notably, TEIs were more informative for ELs at higher grade or reading proficiency levels. TEIs generally had longer item durations than MCIs, making them less efficient, except for at Grades 6–8. Results provide insights for developing TEIs for ELP reading assessments.
AB - Technology-enhanced items (TEIs) are innovative, computer-delivered test items that allow test takers to better interact with the test environment compared to traditional multiple-choice items (MCIs). The interactive nature of TEIs offer improved construct coverage compared with MCIs but little research exists regarding students’ performance on TEIs versus MCIs in English language proficiency (ELP) assessments. This study examines the performance of Grades 1–12 English learners (ELs) on TEIs and MCIs in an online reading test. The test included TEI and MCI content-matched pairs that shared the same reading input but differed in response mode. We analyzed 1.2 million ELs’ scores across five different grade-level clusters: 1, 2–3, 4–5, 6–8, and 9–12. Items were evaluated for difficulty, discrimination, and information using Item Response Theory. Additionally, efficiency was investigated using the amount of information provided and item duration. TEIs were slightly more difficult than MCIs, but they did not differ in discriminative power. Notably, TEIs were more informative for ELs at higher grade or reading proficiency levels. TEIs generally had longer item durations than MCIs, making them less efficient, except for at Grades 6–8. Results provide insights for developing TEIs for ELP reading assessments.
UR - http://www.scopus.com/inward/record.url?scp=85126670234&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85126670234&partnerID=8YFLogxK
U2 - 10.1080/15434303.2022.2039659
DO - 10.1080/15434303.2022.2039659
M3 - Article
AN - SCOPUS:85126670234
SN - 1543-4303
VL - 19
SP - 343
EP - 367
JO - Language Assessment Quarterly
JF - Language Assessment Quarterly
IS - 4
ER -