A Procedure for Dimensionality Analyses of Response Data from Various Test Designs

Research output: Contribution to journalArticlepeer-review

Abstract

In some popular test designs (including computerized adaptive testing and multistage testing), many item pairs are not administered to any test takers, which may result in some complications during dimensionality analyses. In this paper, a modified DETECT index is proposed in order to perform dimensionality analyses for response data from such designs. It is proven in this paper that under certain conditions, the modified DETECT can successfully find the dimensionality-based partition of items. Furthermore, the modified DETECT index is decomposed into two parts, which can serve as indices of the reliability of results from the DETECT procedure when response data are judged to be multidimensional. A simulation study shows that the modified DETECT can successfully recover the dimensional structure of response data under reasonable specifications. Finally, the modified DETECT procedure is applied to real response data from two-stage tests to demonstrate how to utilize these indices and interpret their values in dimensionality analyses.

Original languageEnglish (US)
Pages (from-to)37-58
Number of pages22
JournalPsychometrika
Volume78
Issue number1
DOIs
StatePublished - Jan 2013

Keywords

  • DETECT
  • dimensionality
  • item response theory (IRT)
  • multidimensional
  • multistage testing
  • two-stage testing

ASJC Scopus subject areas

  • Psychology(all)
  • Applied Mathematics

Fingerprint Dive into the research topics of 'A Procedure for Dimensionality Analyses of Response Data from Various Test Designs'. Together they form a unique fingerprint.

Cite this