Computerized adaptive testing under nonparametric IRT models

Xueli Xu, Jeff Douglas

Research output: Contribution to journalArticlepeer-review

Abstract

Nonparametric item response models have been developed as alternatives to the relatively inflexible parametric item response models. An open question is whether it is possible and practical to administer computerized adaptive testing with nonparametric models. This paper explores the possibility of computerized adaptive testing when using nonparametric item response models. A central issue is that the derivatives of item characteristic Curves may not be estimated well, which eliminates the availability of the standard maximum Fisher information criterion. As alternatives, procedures based on Shannon entropy and Kullback-Leibler information are proposed. For a long test, these procedures, which do not require the derivatives of the item characteristic eurves, become equivalent to the maximum Fisher information criterion. A simulation study is conducted to study the behavior of these two procedures, compared with random item selection. The study shows that the procedures based on Shannon entropy and Kullback-Leibler information perform similarly in terms of root mean square error, and perform much better than random item selection. The study also shows that item exposure rates need to be addressed for these methods to be practical.

Original languageEnglish (US)
Pages (from-to)121-137
Number of pages17
JournalPsychometrika
Volume71
Issue number1
DOIs
StatePublished - Mar 1 2006

Keywords

  • Item response theory
  • Kullback-Leibler information
  • Nonparametric item response models
  • Shannon entropy

ASJC Scopus subject areas

  • Mathematics (miscellaneous)
  • Psychology(all)
  • Psychology (miscellaneous)
  • Social Sciences (miscellaneous)

Fingerprint Dive into the research topics of 'Computerized adaptive testing under nonparametric IRT models'. Together they form a unique fingerprint.

Cite this