Abstract
Computerized adaptive testing is becoming increasingly popular due to advancement of modern computer technology. It differs from the conventional standardized testing in that the selection of test items is tailored to individual examinee's ability level. Arising from this selection strategy is a nonlinear sequential design problem. We study, in this paper, the sequential design problem in the context of the logistic item response theory models.We show that the adaptive design obtained by maximizing the item information leads to a consistent and asymptotically normal ability estimator in the case of the Rasch model. Modifications to the maximum information approach are proposed for the two- and three-parameter logistic models. Similar asymptotic properties are established for the modified designs and the resulting estimator. Examples are also given in the case of the two-parameter logistic model to show that without such modifications, the maximum likelihood estimator of the ability parameter may not be consistent.
Original language | English (US) |
---|---|
Pages (from-to) | 1466-1488 |
Number of pages | 23 |
Journal | Annals of Statistics |
Volume | 37 |
Issue number | 3 |
DOIs | |
State | Published - Jun 2009 |
Keywords
- Asymptotic normality
- Computerized adaptive testing
- Consistency
- Fisher information
- Item response theory
- Local convergence
- Logistic models
- Martingale
- Maximum likelihood recursion
- Rasch model
- Sequential design
ASJC Scopus subject areas
- Statistics and Probability
- Statistics, Probability and Uncertainty
Fingerprint
Dive into the research topics of 'Nonlinear sequential designs for logistic item response theory models with applications to computerized adaptive tests1'. Together they form a unique fingerprint.Prizes
-
AERA Division D Award for Significant Contribution to Educational Measurement and Research Methodology
Chang, H.-H. (Recipient), 2011
Prize: Prize/Award