Assessing the Dimensionality of the Latent Attribute Space in Cognitive Diagnosis Through Testing for Conditional Independence

Youn Seon Lim, Fritz Drasgow

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Cognitive diagnosis seeks to assess an examinee’s mastery of a set of cognitive skills called (latent) attributes. The entire set of attributes characterizing a particular ability domain is often referred to as the latent attribute space. The correct specification of the latent attribute space is essential in cognitive diagnosis because misspecifications of the latent attribute space result in inaccurate parameter estimates, and ultimately, in the incorrect assessment of examinees’ ability. Misspecifications of the latent attribute space typically lead to violations of conditional independence. In this article, the Mantel-Haenszel statistic (Lim & Drasgow in J Classif, 2019) is implemented to detect possible misspecifications of the latent attribute space by checking for conditional independence of the items of a test with parametric cognitive diagnosis models. The performance of the Mantel-Haenszel statistic is evaluated in simulation studies based on its Type-I-error rate and power.

Original languageEnglish (US)
Title of host publicationQuantitative Psychology - 83rd Annual Meeting of the Psychometric Society, 2018
EditorsMarie Wiberg, Steven Culpepper, Rianne Janssen, Dylan Molenaar, Jorge González
PublisherSpringer New York LLC
Pages183-194
Number of pages12
ISBN (Print)9783030013097
DOIs
StatePublished - Jan 1 2019
Event83rd Annual meeting of the Psychometric Society, 2018 - New York, United States
Duration: Jul 9 2018Jul 13 2018

Publication series

NameSpringer Proceedings in Mathematics and Statistics
Volume265
ISSN (Print)2194-1009
ISSN (Electronic)2194-1017

Conference

Conference83rd Annual meeting of the Psychometric Society, 2018
CountryUnited States
CityNew York
Period7/9/187/13/18

Fingerprint

Conditional Independence
Dimensionality
Attribute
Testing
Misspecification
Statistic
Type I Error Rate
Inaccurate
Simulation Study
Entire
Specification
Estimate

Keywords

  • Cognitive diagnosis model
  • Dimensionality
  • Mantel-haenszel statistic

ASJC Scopus subject areas

  • Mathematics(all)

Cite this

Lim, Y. S., & Drasgow, F. (2019). Assessing the Dimensionality of the Latent Attribute Space in Cognitive Diagnosis Through Testing for Conditional Independence. In M. Wiberg, S. Culpepper, R. Janssen, D. Molenaar, & J. González (Eds.), Quantitative Psychology - 83rd Annual Meeting of the Psychometric Society, 2018 (pp. 183-194). (Springer Proceedings in Mathematics and Statistics; Vol. 265). Springer New York LLC. https://doi.org/10.1007/978-3-030-01310-3_17

Assessing the Dimensionality of the Latent Attribute Space in Cognitive Diagnosis Through Testing for Conditional Independence. / Lim, Youn Seon; Drasgow, Fritz.

Quantitative Psychology - 83rd Annual Meeting of the Psychometric Society, 2018. ed. / Marie Wiberg; Steven Culpepper; Rianne Janssen; Dylan Molenaar; Jorge González. Springer New York LLC, 2019. p. 183-194 (Springer Proceedings in Mathematics and Statistics; Vol. 265).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Lim, YS & Drasgow, F 2019, Assessing the Dimensionality of the Latent Attribute Space in Cognitive Diagnosis Through Testing for Conditional Independence. in M Wiberg, S Culpepper, R Janssen, D Molenaar & J González (eds), Quantitative Psychology - 83rd Annual Meeting of the Psychometric Society, 2018. Springer Proceedings in Mathematics and Statistics, vol. 265, Springer New York LLC, pp. 183-194, 83rd Annual meeting of the Psychometric Society, 2018, New York, United States, 7/9/18. https://doi.org/10.1007/978-3-030-01310-3_17
Lim YS, Drasgow F. Assessing the Dimensionality of the Latent Attribute Space in Cognitive Diagnosis Through Testing for Conditional Independence. In Wiberg M, Culpepper S, Janssen R, Molenaar D, González J, editors, Quantitative Psychology - 83rd Annual Meeting of the Psychometric Society, 2018. Springer New York LLC. 2019. p. 183-194. (Springer Proceedings in Mathematics and Statistics). https://doi.org/10.1007/978-3-030-01310-3_17
Lim, Youn Seon ; Drasgow, Fritz. / Assessing the Dimensionality of the Latent Attribute Space in Cognitive Diagnosis Through Testing for Conditional Independence. Quantitative Psychology - 83rd Annual Meeting of the Psychometric Society, 2018. editor / Marie Wiberg ; Steven Culpepper ; Rianne Janssen ; Dylan Molenaar ; Jorge González. Springer New York LLC, 2019. pp. 183-194 (Springer Proceedings in Mathematics and Statistics).
@inproceedings{e8064d2f55ba4a96bd01c9183db97003,
title = "Assessing the Dimensionality of the Latent Attribute Space in Cognitive Diagnosis Through Testing for Conditional Independence",
abstract = "Cognitive diagnosis seeks to assess an examinee’s mastery of a set of cognitive skills called (latent) attributes. The entire set of attributes characterizing a particular ability domain is often referred to as the latent attribute space. The correct specification of the latent attribute space is essential in cognitive diagnosis because misspecifications of the latent attribute space result in inaccurate parameter estimates, and ultimately, in the incorrect assessment of examinees’ ability. Misspecifications of the latent attribute space typically lead to violations of conditional independence. In this article, the Mantel-Haenszel statistic (Lim & Drasgow in J Classif, 2019) is implemented to detect possible misspecifications of the latent attribute space by checking for conditional independence of the items of a test with parametric cognitive diagnosis models. The performance of the Mantel-Haenszel statistic is evaluated in simulation studies based on its Type-I-error rate and power.",
keywords = "Cognitive diagnosis model, Dimensionality, Mantel-haenszel statistic",
author = "Lim, {Youn Seon} and Fritz Drasgow",
year = "2019",
month = "1",
day = "1",
doi = "10.1007/978-3-030-01310-3_17",
language = "English (US)",
isbn = "9783030013097",
series = "Springer Proceedings in Mathematics and Statistics",
publisher = "Springer New York LLC",
pages = "183--194",
editor = "Marie Wiberg and Steven Culpepper and Rianne Janssen and Dylan Molenaar and Jorge Gonz{\'a}lez",
booktitle = "Quantitative Psychology - 83rd Annual Meeting of the Psychometric Society, 2018",

}

TY - GEN

T1 - Assessing the Dimensionality of the Latent Attribute Space in Cognitive Diagnosis Through Testing for Conditional Independence

AU - Lim, Youn Seon

AU - Drasgow, Fritz

PY - 2019/1/1

Y1 - 2019/1/1

N2 - Cognitive diagnosis seeks to assess an examinee’s mastery of a set of cognitive skills called (latent) attributes. The entire set of attributes characterizing a particular ability domain is often referred to as the latent attribute space. The correct specification of the latent attribute space is essential in cognitive diagnosis because misspecifications of the latent attribute space result in inaccurate parameter estimates, and ultimately, in the incorrect assessment of examinees’ ability. Misspecifications of the latent attribute space typically lead to violations of conditional independence. In this article, the Mantel-Haenszel statistic (Lim & Drasgow in J Classif, 2019) is implemented to detect possible misspecifications of the latent attribute space by checking for conditional independence of the items of a test with parametric cognitive diagnosis models. The performance of the Mantel-Haenszel statistic is evaluated in simulation studies based on its Type-I-error rate and power.

AB - Cognitive diagnosis seeks to assess an examinee’s mastery of a set of cognitive skills called (latent) attributes. The entire set of attributes characterizing a particular ability domain is often referred to as the latent attribute space. The correct specification of the latent attribute space is essential in cognitive diagnosis because misspecifications of the latent attribute space result in inaccurate parameter estimates, and ultimately, in the incorrect assessment of examinees’ ability. Misspecifications of the latent attribute space typically lead to violations of conditional independence. In this article, the Mantel-Haenszel statistic (Lim & Drasgow in J Classif, 2019) is implemented to detect possible misspecifications of the latent attribute space by checking for conditional independence of the items of a test with parametric cognitive diagnosis models. The performance of the Mantel-Haenszel statistic is evaluated in simulation studies based on its Type-I-error rate and power.

KW - Cognitive diagnosis model

KW - Dimensionality

KW - Mantel-haenszel statistic

UR - http://www.scopus.com/inward/record.url?scp=85066110760&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85066110760&partnerID=8YFLogxK

U2 - 10.1007/978-3-030-01310-3_17

DO - 10.1007/978-3-030-01310-3_17

M3 - Conference contribution

SN - 9783030013097

T3 - Springer Proceedings in Mathematics and Statistics

SP - 183

EP - 194

BT - Quantitative Psychology - 83rd Annual Meeting of the Psychometric Society, 2018

A2 - Wiberg, Marie

A2 - Culpepper, Steven

A2 - Janssen, Rianne

A2 - Molenaar, Dylan

A2 - González, Jorge

PB - Springer New York LLC

ER -