A comparison of item selection techniques and exposure control mechanisms in CATs using the generalized partial credit model

Dena A. Pastor, Barbara G. Dodd, Hua Hua Chang

Research output: Contribution to journalArticlepeer-review

Abstract

The use of more performance items in large-scale testing has led to an increase in the research investigating the use of polytomously scored items in computer adaptive testing (CAT). Because this research has yet to be complimented with information pertaining to exposure control, the present research investigated the impact of using five different exposure control algorithms in two sized item pools calibrated using the generalized partial credit model. The results of the simulation study indicated that the a-stratified design, in comparison to a no-exposure control condition, could be used to reduce item exposure and overlap, increase pool utilization, and only minorly degrade measurement precision. Use of the more restrictive exposure control algorithms, such as the Sympson-Hetter and conditional Sympson-Hetter, controlled exposure to a greater extent but at the cost of measurement precision. Because convergence of the exposure control parameters was problematic for some of the more restrictive exposure control algorithms, use of the more simplistic exposure control mechanisms, particularly when the test length to item pool size ratio is large, is recommended.

Original languageEnglish (US)
Pages (from-to)147-163
Number of pages17
JournalApplied Psychological Measurement
Volume26
Issue number2
DOIs
StatePublished - Jun 2002
Externally publishedYes

Keywords

  • A-stratified design
  • Computerized adaptive testing
  • Exposure control
  • Polytomous items
  • Test security

ASJC Scopus subject areas

  • Psychology(all)
  • Psychology (miscellaneous)
  • Social Sciences (miscellaneous)

Fingerprint Dive into the research topics of 'A comparison of item selection techniques and exposure control mechanisms in CATs using the generalized partial credit model'. Together they form a unique fingerprint.

Cite this