Model evaluation and multiple strategies in cognitive diagnosis: An analysis of fraction subtraction data

Jimmy De La Torre, Jeffrey A. Douglas

Research output: Contribution to journalArticlepeer-review

Abstract

This paper studies three models for cognitive diagnosis, each illustrated with an application to fraction subtraction data. The objective of each of these models is to classify examinees according to their mastery of skills assumed to be required for fraction subtraction. We consider the DINA model, the NIDA model, and a new model that extends the DINA model to allow for multiple strategies of problem solving. For each of these models the joint distribution of the indicators of skill mastery is modeled using a single continuous higher-order latent trait, to explain the dependence in the mastery of distinct skills. This approach stems from viewing the skills as the specific states of knowledge required for exam performance, and viewing these skills as arising from a broadly defined latent trait resembling the θ of item response models. We discuss several techniques for comparing models and assessing goodness of fit. We then implement these methods using the fraction subtraction data with the aim of selecting the best of the three models for this application. We employ Markov chain Monte Carlo algorithms to fit the models, and we present simulation results to examine the performance of these algorithms.

Original languageEnglish (US)
Pages (from-to)595-624
Number of pages30
JournalPsychometrika
Volume73
Issue number4
DOIs
StatePublished - Dec 2008

Keywords

  • Cognitive diagnosis
  • Goodness-of-fit
  • Item response theory
  • Latent class model
  • Markov chain Monte Carlo

ASJC Scopus subject areas

  • General Psychology
  • Applied Mathematics

Fingerprint

Dive into the research topics of 'Model evaluation and multiple strategies in cognitive diagnosis: An analysis of fraction subtraction data'. Together they form a unique fingerprint.

Cite this