Asymptotically Normally Distributed Person Fit Indices for Detecting Spuriously High Scores on Difficult Items

Yan Xia, Yi Zheng

Research output: Contribution to journalArticle

Abstract

Snijders developed a family of person fit indices that asymptotically follow the standard normal distribution, when the ability parameter is estimated. So far, l*z, U*, W*, ECI2*z, and ECI4*z from this family have been proposed in previous literature. One common property shared by l*z, U*, and W* (also ECI2*z, and ECI4*z in some specific conditions) is that they employ symmetric weight functions and thus identify spurious scores on both easy and difficult items in the same manner. However, when the purpose is to detect only the spuriously high scores on difficult items, such as cheating, guessing, and having item preknowledge, using symmetric weight functions may jeopardize the detection rates of the target aberrant response patterns. By specifying two types of asymmetric weight functions, this study proposes SHa(λ)* (λ = 1/2 or 1) and SHb(β)* (β = 2 or 3) based on Snijders’s framework to specifically detect spuriously high scores on difficult items. Two simulation studies were carried out to investigate the Type I error rates and empirical power of SHa(λ)* and SHb(β)*, compared with l*z, U*, W*, ECI2*z, and ECI4*z. The empirical results demonstrated satisfactory performance of the proposed indices. Recommendations were also made on the choice of different person fit indices based on specific purposes.

Original languageEnglish (US)
Pages (from-to)343-358
Number of pages16
JournalApplied Psychological Measurement
Volume42
Issue number5
DOIs
StatePublished - Jul 1 2018
Externally publishedYes

Keywords

  • asymptotically standard normal distribution
  • item response theory
  • person fit statistic

ASJC Scopus subject areas

  • Social Sciences (miscellaneous)
  • Psychology (miscellaneous)

Fingerprint Dive into the research topics of 'Asymptotically Normally Distributed Person Fit Indices for Detecting Spuriously High Scores on Difficult Items'. Together they form a unique fingerprint.

Cite this