Utilizing Response Time in On-the-Fly Multistage Adaptive Testing

Yang Du, Anqi Li, Hua Hua Chang

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

On-the-fly multistage adaptive testing (OMST), which integrates computerized adaptive testing (CAT) and multistage testing (MST), has recently gained popularity. While CAT selects each item on-the-fly and MST bundles items to pre-assembled modules, OMST assembles modules on-the-fly after the first stage. Since item selection algorithms play a crucial role in latent trait estimation and test security in CAT designs, given the availability of response time (RT) in the current testing era, researchers have been actively striving to incorporate RT into item selection algorithms. However, most such algorithms were only applied to CAT whereas little is known about RT’s role in the domain of OMST. Building upon previous research on RT-oriented item selection procedures, this research intends to apply RT-oriented item selection algorithms to OMST. This study found that the relative performance of RT-oriented item selection methods in OMST was consistent with CAT. But the underlying item bank structure and test design features can make a huge difference with respect to estimation accuracy and test security.

Original languageEnglish (US)
Title of host publicationQuantitative Psychology - 83rd Annual Meeting of the Psychometric Society, 2018
EditorsMarie Wiberg, Dylan Molenaar, Jorge González, Steven Culpepper, Rianne Janssen
PublisherSpringer New York LLC
Pages107-117
Number of pages11
ISBN (Print)9783030013097
DOIs
StatePublished - 2019
Externally publishedYes
Event83rd Annual meeting of the Psychometric Society, 2018 - New York, United States
Duration: Jul 9 2018Jul 13 2018

Publication series

NameSpringer Proceedings in Mathematics and Statistics
Volume265
ISSN (Print)2194-1009
ISSN (Electronic)2194-1017

Conference

Conference83rd Annual meeting of the Psychometric Society, 2018
CountryUnited States
CityNew York
Period7/9/187/13/18

Keywords

  • CAT
  • Item bank usage
  • On-the-fly multistage tests
  • Response time
  • Test security

ASJC Scopus subject areas

  • Mathematics(all)

Fingerprint Dive into the research topics of 'Utilizing Response Time in On-the-Fly Multistage Adaptive Testing'. Together they form a unique fingerprint.

Cite this