Hypergeometric family and item overlap rates in computerized adaptive testing

Research output: Contribution to journalArticle

Abstract

A computerized adaptive test (CAT) is usually administered to small groups of examinees at frequent time intervals. It is often the case that examinees who take the test earlier share information with examinees who will take the test later, thus increasing the risk that many items may become known. Item overlap rate for a group of examinees refers to the number of overlapping items encountered by these examinees divided by the test length. For a specific item pool, different item selection algorithms may yield different item overlap rates. An important issue in designing a good CAT item selection algorithm is to keep item overlap rate below a preset level. In doing so, it is important to investigate what the lowest rate could be for all possible item selection algorithms. In this paper we rigorously prove that if every item has an equal possibility to be selected from the pool in a fixed-length CAT, the number of overlapping items among any α randomly sampled examinees follows the hypergeometric distribution family for α ≥ 1. Thus, the expected values of the number of overlapping items among any randomly sampled ce examinees can be calculated precisely. These values may serve as benchmarks in controlling item overlap rates for fixed-length adaptive tests.

Original languageEnglish (US)
Pages (from-to)387-398
Number of pages12
JournalPsychometrika
Volume67
Issue number3
DOIs
StatePublished - Sep 2002

Keywords

  • Computerized adaptive testing
  • Hypergeometric distribution
  • Item exposure rate
  • Item overlap rate
  • Item selection
  • Stratification
  • Sympson-Hetter method
  • Test security

ASJC Scopus subject areas

  • Mathematics (miscellaneous)
  • Psychology(all)
  • Psychology (miscellaneous)
  • Social Sciences (miscellaneous)

Fingerprint Dive into the research topics of 'Hypergeometric family and item overlap rates in computerized adaptive testing'. Together they form a unique fingerprint.

  • Cite this