TY - JOUR
T1 - The Generalized Thurstonian Unfolding Model (GTUM)
T2 - Advancing the Modeling of Forced-Choice Data
AU - Zhang, Bo
AU - Tu, Naidan
AU - Angrave, Lawrence
AU - Zhang, Susu
AU - Sun, Tianjun
AU - Tay, Louis
AU - Li, Jian
N1 - Publisher Copyright:
© The Author(s) 2023.
PY - 2024/10
Y1 - 2024/10
N2 - Forced-choice (FC) measurement has become increasingly popular due to its robustness to various response biases and reduced susceptibility to faking. Although several current Item Response Theory (IRT) models can extract normative person scores from FC responses, each has its limitations. This study proposes the Generalized Thurstonian Unfolding Model (GTUM) as a more flexible IRT model for FC measures to overcome these limitations. The GTUM (1) adheres to the unfolding response process, (2) accommodates FC scales of any block size, and (3) manages both dichotomous and graded responses. Monte Carlo simulation studies consistently demonstrated that the GTUM exhibited good statistical properties under most realistic conditions. Particularly noteworthy findings include (1) the GTUM's ability to handle FC scales with or without intermediate statements, (2) the consistently superior performance of graded responses over dichotomous responses in person score recovery, and (3) the sufficiency of 10 mixed pairs to ensure robust psychometric performance. Two empirical examples, one with 1,033 responses to a static version of the Tailored Adaptive Personality Assessment System and the other with 759 responses to a graded version of the Forced-Choice Five-Factor Markers, demonstrated the feasibility of the GTUM to handle different types of FC scales. To aid in the practical use of the GTUM, we also developed the R package “fcscoring.”
AB - Forced-choice (FC) measurement has become increasingly popular due to its robustness to various response biases and reduced susceptibility to faking. Although several current Item Response Theory (IRT) models can extract normative person scores from FC responses, each has its limitations. This study proposes the Generalized Thurstonian Unfolding Model (GTUM) as a more flexible IRT model for FC measures to overcome these limitations. The GTUM (1) adheres to the unfolding response process, (2) accommodates FC scales of any block size, and (3) manages both dichotomous and graded responses. Monte Carlo simulation studies consistently demonstrated that the GTUM exhibited good statistical properties under most realistic conditions. Particularly noteworthy findings include (1) the GTUM's ability to handle FC scales with or without intermediate statements, (2) the consistently superior performance of graded responses over dichotomous responses in person score recovery, and (3) the sufficiency of 10 mixed pairs to ensure robust psychometric performance. Two empirical examples, one with 1,033 responses to a static version of the Tailored Adaptive Personality Assessment System and the other with 759 responses to a graded version of the Forced-Choice Five-Factor Markers, demonstrated the feasibility of the GTUM to handle different types of FC scales. To aid in the practical use of the GTUM, we also developed the R package “fcscoring.”
KW - GTUM
KW - Item Response Theory
KW - forced-choice
KW - unfolding response process
UR - http://www.scopus.com/inward/record.url?scp=85175721059&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85175721059&partnerID=8YFLogxK
U2 - 10.1177/10944281231210481
DO - 10.1177/10944281231210481
M3 - Article
AN - SCOPUS:85175721059
SN - 1094-4281
VL - 27
SP - 713
EP - 747
JO - Organizational Research Methods
JF - Organizational Research Methods
IS - 4
ER -