TY - JOUR
T1 - The More Contextualized, the More Valid
T2 - Effects of Contextualization Strategies on Forced-choice Measurement
AU - Li, Lingyue
AU - Zhang, Bo
AU - Sun, Tianjun
AU - Drasgow, Fritz
N1 - Publisher Copyright:
© The Author(s), under exclusive licence to Springer Science+Business Media, LLC, part of Springer Nature 2024.
PY - 2024
Y1 - 2024
N2 - Previous studies have shown that contextualization can improve the reliability and criterion-related validity of single-statement personality measures. However, it is unknown whether contextualization has similar effects on forced-choice measures of personality. If so, what type of contextualization is the most effective? The present study provides the first empirical examination of the effects of three types of contextualization on the reliability and criterion-related validity of forced-choice personality measures. Employing an experimental design, we obtained and cross-validated results using two forced-choice personality measures. Results showed that while contextualization has no systematic effect on the reliability of forced-choice scores, it improves their criterion-related validity substantially. Specifically, contextualization of both the statements and instructions yielded the highest levels of criterion-related validity for work-related outcomes, with an average validity coefficient of.18 and an average multiple correlation coefficient of.40 across two measures, followed by statement contextualization only (Mr =.18, MmultipleR =.35) and then by instruction contextualization only (Mr =.14, MmultipleR =.31). The original scales with no contextualization showed the lowest levels of criterion-related validity (Mr =.10, MmultipleR =.27). Contextualization also increased the intercorrelations of personality dimensions. These patterns were well replicated across the two forced-choice scales.
AB - Previous studies have shown that contextualization can improve the reliability and criterion-related validity of single-statement personality measures. However, it is unknown whether contextualization has similar effects on forced-choice measures of personality. If so, what type of contextualization is the most effective? The present study provides the first empirical examination of the effects of three types of contextualization on the reliability and criterion-related validity of forced-choice personality measures. Employing an experimental design, we obtained and cross-validated results using two forced-choice personality measures. Results showed that while contextualization has no systematic effect on the reliability of forced-choice scores, it improves their criterion-related validity substantially. Specifically, contextualization of both the statements and instructions yielded the highest levels of criterion-related validity for work-related outcomes, with an average validity coefficient of.18 and an average multiple correlation coefficient of.40 across two measures, followed by statement contextualization only (Mr =.18, MmultipleR =.35) and then by instruction contextualization only (Mr =.14, MmultipleR =.31). The original scales with no contextualization showed the lowest levels of criterion-related validity (Mr =.10, MmultipleR =.27). Contextualization also increased the intercorrelations of personality dimensions. These patterns were well replicated across the two forced-choice scales.
KW - Contextualization
KW - Forced-choice
KW - Measurement
KW - Personality
KW - Validity
UR - http://www.scopus.com/inward/record.url?scp=85202954854&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85202954854&partnerID=8YFLogxK
U2 - 10.1007/s10869-024-09983-2
DO - 10.1007/s10869-024-09983-2
M3 - Article
AN - SCOPUS:85202954854
SN - 0889-3268
JO - Journal of Business and Psychology
JF - Journal of Business and Psychology
ER -