The comparison of two input statistics for heuristic cognitive diagnosis

Hans Friedrich Koehn, Chia Yi Chiu, Michael J. Brusco

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Cognitive diagnosis models of educational test performance decompose ability in a domain into a set of specific binary skills called attributes. (Non-)mastery of attributes documents an examinee’s strengths and weaknesses in the domain as a profile of mental aptitude. Distinct attribute profiles define classes of intellectual proficiency to which examinees can be assigned. Nonparametric, model-free classification methods have been proposed as heuristic or approximate alternatives to maximum likelihood estimation procedures for assigning examinees to proficiency classes. These classification techniques use as input a statistic obtained by aggregating each examinee’s test item scores into a profile of attribute sum-scores. This study demonstrates that clustering examinees into proficiency classes based on their item scores rather than on their attribute sum-score profiles results in a more accurate classification of examinees.

Original languageEnglish (US)
Title of host publicationNew Developments in Quantitative Psychology - Presentations from the 77th Annual Psychometric Society Meeting
EditorsL. Andries van der Ark, Roger E. Millsap, Daniel M. Bolt, Carol M. Woods
PublisherSpringer New York LLC
Pages335-343
Number of pages9
ISBN (Print)9781461493471
DOIs
StatePublished - Jan 1 2013
Event77th Annual Meeting of the Psychometric Society, 2012 - Lincoln, United States
Duration: Jul 9 2012Jul 12 2012

Publication series

NameSpringer Proceedings in Mathematics and Statistics
Volume66
ISSN (Print)2194-1009
ISSN (Electronic)2194-1017

Other

Other77th Annual Meeting of the Psychometric Society, 2012
CountryUnited States
CityLincoln
Period7/9/127/12/12

Fingerprint

Attribute
Heuristics
Statistics
Performance Test
Nonparametric Model
Maximum Likelihood Estimation
Statistic
Clustering
Binary
Distinct
Decompose
Profile
Alternatives
Demonstrate
Class
Model

ASJC Scopus subject areas

  • Mathematics(all)

Cite this

Koehn, H. F., Chiu, C. Y., & Brusco, M. J. (2013). The comparison of two input statistics for heuristic cognitive diagnosis. In L. A. van der Ark, R. E. Millsap, D. M. Bolt, & C. M. Woods (Eds.), New Developments in Quantitative Psychology - Presentations from the 77th Annual Psychometric Society Meeting (pp. 335-343). (Springer Proceedings in Mathematics and Statistics; Vol. 66). Springer New York LLC. https://doi.org/10.1007/978-1-4614-9348-8_21

The comparison of two input statistics for heuristic cognitive diagnosis. / Koehn, Hans Friedrich; Chiu, Chia Yi; Brusco, Michael J.

New Developments in Quantitative Psychology - Presentations from the 77th Annual Psychometric Society Meeting. ed. / L. Andries van der Ark; Roger E. Millsap; Daniel M. Bolt; Carol M. Woods. Springer New York LLC, 2013. p. 335-343 (Springer Proceedings in Mathematics and Statistics; Vol. 66).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Koehn, HF, Chiu, CY & Brusco, MJ 2013, The comparison of two input statistics for heuristic cognitive diagnosis. in LA van der Ark, RE Millsap, DM Bolt & CM Woods (eds), New Developments in Quantitative Psychology - Presentations from the 77th Annual Psychometric Society Meeting. Springer Proceedings in Mathematics and Statistics, vol. 66, Springer New York LLC, pp. 335-343, 77th Annual Meeting of the Psychometric Society, 2012, Lincoln, United States, 7/9/12. https://doi.org/10.1007/978-1-4614-9348-8_21
Koehn HF, Chiu CY, Brusco MJ. The comparison of two input statistics for heuristic cognitive diagnosis. In van der Ark LA, Millsap RE, Bolt DM, Woods CM, editors, New Developments in Quantitative Psychology - Presentations from the 77th Annual Psychometric Society Meeting. Springer New York LLC. 2013. p. 335-343. (Springer Proceedings in Mathematics and Statistics). https://doi.org/10.1007/978-1-4614-9348-8_21
Koehn, Hans Friedrich ; Chiu, Chia Yi ; Brusco, Michael J. / The comparison of two input statistics for heuristic cognitive diagnosis. New Developments in Quantitative Psychology - Presentations from the 77th Annual Psychometric Society Meeting. editor / L. Andries van der Ark ; Roger E. Millsap ; Daniel M. Bolt ; Carol M. Woods. Springer New York LLC, 2013. pp. 335-343 (Springer Proceedings in Mathematics and Statistics).
@inproceedings{79fc0d65873a4380b46546908908fd6a,
title = "The comparison of two input statistics for heuristic cognitive diagnosis",
abstract = "Cognitive diagnosis models of educational test performance decompose ability in a domain into a set of specific binary skills called attributes. (Non-)mastery of attributes documents an examinee’s strengths and weaknesses in the domain as a profile of mental aptitude. Distinct attribute profiles define classes of intellectual proficiency to which examinees can be assigned. Nonparametric, model-free classification methods have been proposed as heuristic or approximate alternatives to maximum likelihood estimation procedures for assigning examinees to proficiency classes. These classification techniques use as input a statistic obtained by aggregating each examinee’s test item scores into a profile of attribute sum-scores. This study demonstrates that clustering examinees into proficiency classes based on their item scores rather than on their attribute sum-score profiles results in a more accurate classification of examinees.",
author = "Koehn, {Hans Friedrich} and Chiu, {Chia Yi} and Brusco, {Michael J.}",
year = "2013",
month = "1",
day = "1",
doi = "10.1007/978-1-4614-9348-8_21",
language = "English (US)",
isbn = "9781461493471",
series = "Springer Proceedings in Mathematics and Statistics",
publisher = "Springer New York LLC",
pages = "335--343",
editor = "{van der Ark}, {L. Andries} and Millsap, {Roger E.} and Bolt, {Daniel M.} and Woods, {Carol M.}",
booktitle = "New Developments in Quantitative Psychology - Presentations from the 77th Annual Psychometric Society Meeting",

}

TY - GEN

T1 - The comparison of two input statistics for heuristic cognitive diagnosis

AU - Koehn, Hans Friedrich

AU - Chiu, Chia Yi

AU - Brusco, Michael J.

PY - 2013/1/1

Y1 - 2013/1/1

N2 - Cognitive diagnosis models of educational test performance decompose ability in a domain into a set of specific binary skills called attributes. (Non-)mastery of attributes documents an examinee’s strengths and weaknesses in the domain as a profile of mental aptitude. Distinct attribute profiles define classes of intellectual proficiency to which examinees can be assigned. Nonparametric, model-free classification methods have been proposed as heuristic or approximate alternatives to maximum likelihood estimation procedures for assigning examinees to proficiency classes. These classification techniques use as input a statistic obtained by aggregating each examinee’s test item scores into a profile of attribute sum-scores. This study demonstrates that clustering examinees into proficiency classes based on their item scores rather than on their attribute sum-score profiles results in a more accurate classification of examinees.

AB - Cognitive diagnosis models of educational test performance decompose ability in a domain into a set of specific binary skills called attributes. (Non-)mastery of attributes documents an examinee’s strengths and weaknesses in the domain as a profile of mental aptitude. Distinct attribute profiles define classes of intellectual proficiency to which examinees can be assigned. Nonparametric, model-free classification methods have been proposed as heuristic or approximate alternatives to maximum likelihood estimation procedures for assigning examinees to proficiency classes. These classification techniques use as input a statistic obtained by aggregating each examinee’s test item scores into a profile of attribute sum-scores. This study demonstrates that clustering examinees into proficiency classes based on their item scores rather than on their attribute sum-score profiles results in a more accurate classification of examinees.

UR - http://www.scopus.com/inward/record.url?scp=85033450911&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85033450911&partnerID=8YFLogxK

U2 - 10.1007/978-1-4614-9348-8_21

DO - 10.1007/978-1-4614-9348-8_21

M3 - Conference contribution

AN - SCOPUS:85033450911

SN - 9781461493471

T3 - Springer Proceedings in Mathematics and Statistics

SP - 335

EP - 343

BT - New Developments in Quantitative Psychology - Presentations from the 77th Annual Psychometric Society Meeting

A2 - van der Ark, L. Andries

A2 - Millsap, Roger E.

A2 - Bolt, Daniel M.

A2 - Woods, Carol M.

PB - Springer New York LLC

ER -