Assessing the Dimensionality of the Latent Attribute Space in Cognitive Diagnosis Through Testing for Conditional Independence

Youn Seon Lim; Fritz Drasgow

doi:10.1007/978-3-030-01310-3_17

Assessing the Dimensionality of the Latent Attribute Space in Cognitive Diagnosis Through Testing for Conditional Independence

Youn Seon Lim, Fritz Drasgow

School of Labor and Employment Relations

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Abstract

Cognitive diagnosis seeks to assess an examinee’s mastery of a set of cognitive skills called (latent) attributes. The entire set of attributes characterizing a particular ability domain is often referred to as the latent attribute space. The correct specification of the latent attribute space is essential in cognitive diagnosis because misspecifications of the latent attribute space result in inaccurate parameter estimates, and ultimately, in the incorrect assessment of examinees’ ability. Misspecifications of the latent attribute space typically lead to violations of conditional independence. In this article, the Mantel-Haenszel statistic (Lim & Drasgow in J Classif, 2019) is implemented to detect possible misspecifications of the latent attribute space by checking for conditional independence of the items of a test with parametric cognitive diagnosis models. The performance of the Mantel-Haenszel statistic is evaluated in simulation studies based on its Type-I-error rate and power.

Original language	English (US)
Title of host publication	Quantitative Psychology - 83rd Annual Meeting of the Psychometric Society, 2018
Editors	Marie Wiberg, Steven Culpepper, Rianne Janssen, Dylan Molenaar, Jorge González
Publisher	Springer
Pages	183-194
Number of pages	12
ISBN (Print)	9783030013097
DOIs	https://doi.org/10.1007/978-3-030-01310-3_17
State	Published - 2019
Event	83rd Annual meeting of the Psychometric Society, 2018 - New York, United States Duration: Jul 9 2018 → Jul 13 2018

Publication series

Name	Springer Proceedings in Mathematics and Statistics
Volume	265
ISSN (Print)	2194-1009
ISSN (Electronic)	2194-1017

Conference

Conference	83rd Annual meeting of the Psychometric Society, 2018
Country/Territory	United States
City	New York
Period	7/9/18 → 7/13/18

Keywords

Cognitive diagnosis model
Dimensionality
Mantel-haenszel statistic

ASJC Scopus subject areas

General Mathematics

Online availability

10.1007/978-3-030-01310-3_17

Library availability

Discover UIUC Full Text

Cite this

Lim, Y. S., & Drasgow, F. (2019). Assessing the Dimensionality of the Latent Attribute Space in Cognitive Diagnosis Through Testing for Conditional Independence. In M. Wiberg, S. Culpepper, R. Janssen, D. Molenaar, & J. González (Eds.), Quantitative Psychology - 83rd Annual Meeting of the Psychometric Society, 2018 (pp. 183-194). (Springer Proceedings in Mathematics and Statistics; Vol. 265). Springer. https://doi.org/10.1007/978-3-030-01310-3_17

Assessing the Dimensionality of the Latent Attribute Space in Cognitive Diagnosis Through Testing for Conditional Independence. / Lim, Youn Seon; Drasgow, Fritz.
Quantitative Psychology - 83rd Annual Meeting of the Psychometric Society, 2018. ed. / Marie Wiberg; Steven Culpepper; Rianne Janssen; Dylan Molenaar; Jorge González. Springer, 2019. p. 183-194 (Springer Proceedings in Mathematics and Statistics; Vol. 265).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Lim, YS & Drasgow, F 2019, Assessing the Dimensionality of the Latent Attribute Space in Cognitive Diagnosis Through Testing for Conditional Independence. in M Wiberg, S Culpepper, R Janssen, D Molenaar & J González (eds), Quantitative Psychology - 83rd Annual Meeting of the Psychometric Society, 2018. Springer Proceedings in Mathematics and Statistics, vol. 265, Springer, pp. 183-194, 83rd Annual meeting of the Psychometric Society, 2018, New York, United States, 7/9/18. https://doi.org/10.1007/978-3-030-01310-3_17

Lim YS, Drasgow F. Assessing the Dimensionality of the Latent Attribute Space in Cognitive Diagnosis Through Testing for Conditional Independence. In Wiberg M, Culpepper S, Janssen R, Molenaar D, González J, editors, Quantitative Psychology - 83rd Annual Meeting of the Psychometric Society, 2018. Springer. 2019. p. 183-194. (Springer Proceedings in Mathematics and Statistics). doi: 10.1007/978-3-030-01310-3_17

Lim, Youn Seon ; Drasgow, Fritz. / Assessing the Dimensionality of the Latent Attribute Space in Cognitive Diagnosis Through Testing for Conditional Independence. Quantitative Psychology - 83rd Annual Meeting of the Psychometric Society, 2018. editor / Marie Wiberg ; Steven Culpepper ; Rianne Janssen ; Dylan Molenaar ; Jorge González. Springer, 2019. pp. 183-194 (Springer Proceedings in Mathematics and Statistics).

@inproceedings{e8064d2f55ba4a96bd01c9183db97003,

title = "Assessing the Dimensionality of the Latent Attribute Space in Cognitive Diagnosis Through Testing for Conditional Independence",

abstract = "Cognitive diagnosis seeks to assess an examinee{\textquoteright}s mastery of a set of cognitive skills called (latent) attributes. The entire set of attributes characterizing a particular ability domain is often referred to as the latent attribute space. The correct specification of the latent attribute space is essential in cognitive diagnosis because misspecifications of the latent attribute space result in inaccurate parameter estimates, and ultimately, in the incorrect assessment of examinees{\textquoteright} ability. Misspecifications of the latent attribute space typically lead to violations of conditional independence. In this article, the Mantel-Haenszel statistic (Lim & Drasgow in J Classif, 2019) is implemented to detect possible misspecifications of the latent attribute space by checking for conditional independence of the items of a test with parametric cognitive diagnosis models. The performance of the Mantel-Haenszel statistic is evaluated in simulation studies based on its Type-I-error rate and power.",

keywords = "Cognitive diagnosis model, Dimensionality, Mantel-haenszel statistic",

author = "Lim, {Youn Seon} and Fritz Drasgow",

note = "Publisher Copyright: {\textcopyright} 2019, Springer Nature Switzerland AG.; 83rd Annual meeting of the Psychometric Society, 2018 ; Conference date: 09-07-2018 Through 13-07-2018",

year = "2019",

doi = "10.1007/978-3-030-01310-3_17",

language = "English (US)",

isbn = "9783030013097",

series = "Springer Proceedings in Mathematics and Statistics",

publisher = "Springer",

pages = "183--194",

editor = "Marie Wiberg and Steven Culpepper and Rianne Janssen and Dylan Molenaar and Jorge Gonz{\'a}lez",

booktitle = "Quantitative Psychology - 83rd Annual Meeting of the Psychometric Society, 2018",

address = "Germany",

}

TY - GEN

T1 - Assessing the Dimensionality of the Latent Attribute Space in Cognitive Diagnosis Through Testing for Conditional Independence

AU - Lim, Youn Seon

AU - Drasgow, Fritz

PY - 2019

Y1 - 2019

N2 - Cognitive diagnosis seeks to assess an examinee’s mastery of a set of cognitive skills called (latent) attributes. The entire set of attributes characterizing a particular ability domain is often referred to as the latent attribute space. The correct specification of the latent attribute space is essential in cognitive diagnosis because misspecifications of the latent attribute space result in inaccurate parameter estimates, and ultimately, in the incorrect assessment of examinees’ ability. Misspecifications of the latent attribute space typically lead to violations of conditional independence. In this article, the Mantel-Haenszel statistic (Lim & Drasgow in J Classif, 2019) is implemented to detect possible misspecifications of the latent attribute space by checking for conditional independence of the items of a test with parametric cognitive diagnosis models. The performance of the Mantel-Haenszel statistic is evaluated in simulation studies based on its Type-I-error rate and power.

AB - Cognitive diagnosis seeks to assess an examinee’s mastery of a set of cognitive skills called (latent) attributes. The entire set of attributes characterizing a particular ability domain is often referred to as the latent attribute space. The correct specification of the latent attribute space is essential in cognitive diagnosis because misspecifications of the latent attribute space result in inaccurate parameter estimates, and ultimately, in the incorrect assessment of examinees’ ability. Misspecifications of the latent attribute space typically lead to violations of conditional independence. In this article, the Mantel-Haenszel statistic (Lim & Drasgow in J Classif, 2019) is implemented to detect possible misspecifications of the latent attribute space by checking for conditional independence of the items of a test with parametric cognitive diagnosis models. The performance of the Mantel-Haenszel statistic is evaluated in simulation studies based on its Type-I-error rate and power.

KW - Cognitive diagnosis model

KW - Dimensionality

KW - Mantel-haenszel statistic

UR - http://www.scopus.com/inward/record.url?scp=85066110760&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85066110760&partnerID=8YFLogxK

U2 - 10.1007/978-3-030-01310-3_17

DO - 10.1007/978-3-030-01310-3_17

M3 - Conference contribution

AN - SCOPUS:85066110760

SN - 9783030013097

T3 - Springer Proceedings in Mathematics and Statistics

SP - 183

EP - 194

BT - Quantitative Psychology - 83rd Annual Meeting of the Psychometric Society, 2018

A2 - Wiberg, Marie

A2 - Culpepper, Steven

A2 - Janssen, Rianne

A2 - Molenaar, Dylan

A2 - González, Jorge

PB - Springer

T2 - 83rd Annual meeting of the Psychometric Society, 2018

Y2 - 9 July 2018 through 13 July 2018

ER -

Assessing the Dimensionality of the Latent Attribute Space in Cognitive Diagnosis Through Testing for Conditional Independence

Abstract

Publication series

Conference

Keywords

ASJC Scopus subject areas

Online availability

Library availability

Related links

Fingerprint

Quantitative Psychology: 83rd Annual Meeting of the Psychometric Society, New York, NY 2018

Cite this