Item-Weighted Likelihood Method for Ability Estimation in Tests Composed of Both Dichotomous and Polytomous Items

Jian Tao; Ning Zhong Shi; Hua Hua Chang

doi:10.3102/1076998610393969

Item-Weighted Likelihood Method for Ability Estimation in Tests Composed of Both Dichotomous and Polytomous Items

Jian Tao, Ning Zhong Shi, Hua Hua Chang

Research output: Contribution to journal › Article › peer-review

Abstract

For mixed-type tests composed of both dichotomous and polytomous items, polytomous items often yield more information than dichotomous ones. To reflect the difference between the two types of items, polytomous items are usually pre-assigned with larger weights. We propose an item-weighted likelihood method to better assess examinees' ability levels. Simulation results show that the estimated ability based on the new procedure is more consistent with examinee's true ability than the usual maximum likelihood method.

Original language	English (US)
Pages (from-to)	298-315
Number of pages	18
Journal	Journal of Educational and Behavioral Statistics
Volume	37
Issue number	2
DOIs	https://doi.org/10.3102/1076998610393969
State	Published - Apr 2012

Keywords

bias
dichotomous response
generalized partial credit model
item-weighted likelihood
mixed-type test
polytomous response

ASJC Scopus subject areas

Education
Social Sciences (miscellaneous)

Online availability

10.3102/1076998610393969

Library availability

Discover UIUC Full Text

Cite this

@article{e3270d7df94a43858d87007179df7134,

title = "Item-Weighted Likelihood Method for Ability Estimation in Tests Composed of Both Dichotomous and Polytomous Items",

abstract = "For mixed-type tests composed of both dichotomous and polytomous items, polytomous items often yield more information than dichotomous ones. To reflect the difference between the two types of items, polytomous items are usually pre-assigned with larger weights. We propose an item-weighted likelihood method to better assess examinees' ability levels. Simulation results show that the estimated ability based on the new procedure is more consistent with examinee's true ability than the usual maximum likelihood method.",

keywords = "bias, dichotomous response, generalized partial credit model, item-weighted likelihood, mixed-type test, polytomous response",

author = "Jian Tao and Shi, {Ning Zhong} and Chang, {Hua Hua}",

note = "Funding Information: This research was partially supported by the Fundamental Research Funds for the Central Universities (10JCXK007), the Natural Science Foundation of Jilin Province (201115005), the Training Fund of NENU'S Scientific Innovation Project (NENU-STC07002) and National Natural Science and Social Science Foundations of China (Grant Nos. 10931002, 10828102, 10871037, and 07JZD0031). The authors gratefully acknowledge the helpful comments of the two anonymous reviewers and the Editor.",

year = "2012",

month = apr,

doi = "10.3102/1076998610393969",

language = "English (US)",

volume = "37",

pages = "298--315",

journal = "Journal of Educational and Behavioral Statistics",

issn = "1076-9986",

publisher = "SAGE Publications Inc.",

number = "2",

}

TY - JOUR

T1 - Item-Weighted Likelihood Method for Ability Estimation in Tests Composed of Both Dichotomous and Polytomous Items

AU - Tao, Jian

AU - Shi, Ning Zhong

AU - Chang, Hua Hua

N1 - Funding Information: This research was partially supported by the Fundamental Research Funds for the Central Universities (10JCXK007), the Natural Science Foundation of Jilin Province (201115005), the Training Fund of NENU'S Scientific Innovation Project (NENU-STC07002) and National Natural Science and Social Science Foundations of China (Grant Nos. 10931002, 10828102, 10871037, and 07JZD0031). The authors gratefully acknowledge the helpful comments of the two anonymous reviewers and the Editor.

PY - 2012/4

Y1 - 2012/4

N2 - For mixed-type tests composed of both dichotomous and polytomous items, polytomous items often yield more information than dichotomous ones. To reflect the difference between the two types of items, polytomous items are usually pre-assigned with larger weights. We propose an item-weighted likelihood method to better assess examinees' ability levels. Simulation results show that the estimated ability based on the new procedure is more consistent with examinee's true ability than the usual maximum likelihood method.

AB - For mixed-type tests composed of both dichotomous and polytomous items, polytomous items often yield more information than dichotomous ones. To reflect the difference between the two types of items, polytomous items are usually pre-assigned with larger weights. We propose an item-weighted likelihood method to better assess examinees' ability levels. Simulation results show that the estimated ability based on the new procedure is more consistent with examinee's true ability than the usual maximum likelihood method.

KW - bias

KW - dichotomous response

KW - generalized partial credit model

KW - item-weighted likelihood

KW - mixed-type test

KW - polytomous response

UR - http://www.scopus.com/inward/record.url?scp=84859411759&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84859411759&partnerID=8YFLogxK

U2 - 10.3102/1076998610393969

DO - 10.3102/1076998610393969

M3 - Article

AN - SCOPUS:84859411759

SN - 1076-9986

VL - 37

SP - 298

EP - 315

JO - Journal of Educational and Behavioral Statistics

JF - Journal of Educational and Behavioral Statistics

IS - 2

ER -

Item-Weighted Likelihood Method for Ability Estimation in Tests Composed of Both Dichotomous and Polytomous Items

Abstract

Keywords

ASJC Scopus subject areas

Online availability

Library availability

Related links

Fingerprint

Cite this