Utilizing Response Time in On-the-Fly Multistage Adaptive Testing

Yang Du, Anqi Li, Hua Hua Chang

Research output: Chapter in Book/Report/Conference proceedingConference contribution


On-the-fly multistage adaptive testing (OMST), which integrates computerized adaptive testing (CAT) and multistage testing (MST), has recently gained popularity. While CAT selects each item on-the-fly and MST bundles items to pre-assembled modules, OMST assembles modules on-the-fly after the first stage. Since item selection algorithms play a crucial role in latent trait estimation and test security in CAT designs, given the availability of response time (RT) in the current testing era, researchers have been actively striving to incorporate RT into item selection algorithms. However, most such algorithms were only applied to CAT whereas little is known about RT’s role in the domain of OMST. Building upon previous research on RT-oriented item selection procedures, this research intends to apply RT-oriented item selection algorithms to OMST. This study found that the relative performance of RT-oriented item selection methods in OMST was consistent with CAT. But the underlying item bank structure and test design features can make a huge difference with respect to estimation accuracy and test security.

Original languageEnglish (US)
Title of host publicationQuantitative Psychology - 83rd Annual Meeting of the Psychometric Society, 2018
EditorsMarie Wiberg, Dylan Molenaar, Jorge González, Steven Culpepper, Rianne Janssen
Number of pages11
ISBN (Print)9783030013097
StatePublished - 2019
Externally publishedYes
Event83rd Annual meeting of the Psychometric Society, 2018 - New York, United States
Duration: Jul 9 2018Jul 13 2018

Publication series

NameSpringer Proceedings in Mathematics and Statistics
ISSN (Print)2194-1009
ISSN (Electronic)2194-1017


Conference83rd Annual meeting of the Psychometric Society, 2018
Country/TerritoryUnited States
CityNew York


  • CAT
  • Item bank usage
  • On-the-fly multistage tests
  • Response time
  • Test security

ASJC Scopus subject areas

  • General Mathematics


Dive into the research topics of 'Utilizing Response Time in On-the-Fly Multistage Adaptive Testing'. Together they form a unique fingerprint.

Cite this