Constraint-weighted a-stratification for computerized adaptive testing with nonstatistical constraints: Balancing measurement efficiency and exposure control

Ying Cheng, Hua Hua Chang, Jeffrey Douglas, Guo Fanmin Guo

Research output: Contribution to journalArticlepeer-review

Abstract

a-stratification is a method that utilizes items with small discrimination (a) parameters early in an exam and those with higher a values when more is learned about the ability parameter. It can achieve much better item usage than the maximum information criterion (MIC). To make a-stratification more practical and more widely applicable, a method for weighting the item selection process in a-stratification as a means of satisfying multiple test constraints is proposed. This method is studied in simulation against an analogous method without stratification as well as a-stratification using descending-rather than ascending-a procedures. In addition, a variation of a-stratification that allows for unbalanced usage of a parameters is included in the study to examine the trade-off between efficiency and exposure control. Finally, MIC and randomized item selection are included as baseline measures. Results indicate that the weighting mechanism successfully addresses the constraints, that stratification helps to a great extent balancing exposure rates, and that the ascending-a design improves measurement precision.

Original languageEnglish (US)
Pages (from-to)35-49
Number of pages15
JournalEducational and Psychological Measurement
Volume69
Issue number1
DOIs
StatePublished - Feb 2009

Keywords

  • CAT
  • Constraint-weighted a-stratification
  • Efficiency
  • Exposure control

ASJC Scopus subject areas

  • Algebra and Number Theory
  • Psychology(all)
  • Developmental and Educational Psychology
  • Psychology (miscellaneous)
  • Education

Fingerprint Dive into the research topics of 'Constraint-weighted a-stratification for computerized adaptive testing with nonstatistical constraints: Balancing measurement efficiency and exposure control'. Together they form a unique fingerprint.

Cite this