Scoring situational judgment tests

Once you get the data, your troubles begin

Mindy E. Bergman, Fritz Drasgow, Michelle A. Donovan, Jaime B. Henning, Suzanne E. Juraska

Research output: Contribution to journalReview article

Abstract

Although situational judgment tests (SJTs) have been in use for decades, consensus has not been reached on the best way to score these assessments or others (e.g., biodata) whose items do not have a single demonstrably correct answer. The purpose of this paper is to review and to demonstrate the scoring strategies that have been described in the literature. Implementation and relative merits of these strategies are described. Then, several of these methods are applied to create 11 different keys for a video-based SJT in order to demonstrate how to evaluate the quality of keys. Implications of scoring SJTs for theory and practice are discussed.

Original languageEnglish (US)
Pages (from-to)223-235
Number of pages13
JournalInternational Journal of Selection and Assessment
Volume14
Issue number3
DOIs
StatePublished - Sep 1 2006

Fingerprint

Consensus
Scoring
Biodata

ASJC Scopus subject areas

  • Business, Management and Accounting(all)
  • Applied Psychology
  • Psychology(all)
  • Strategy and Management
  • Management of Technology and Innovation

Cite this

Scoring situational judgment tests : Once you get the data, your troubles begin. / Bergman, Mindy E.; Drasgow, Fritz; Donovan, Michelle A.; Henning, Jaime B.; Juraska, Suzanne E.

In: International Journal of Selection and Assessment, Vol. 14, No. 3, 01.09.2006, p. 223-235.

Research output: Contribution to journalReview article

Bergman, Mindy E. ; Drasgow, Fritz ; Donovan, Michelle A. ; Henning, Jaime B. ; Juraska, Suzanne E. / Scoring situational judgment tests : Once you get the data, your troubles begin. In: International Journal of Selection and Assessment. 2006 ; Vol. 14, No. 3. pp. 223-235.
@article{a18babbb9ee14cd48dd2c85547371a5b,
title = "Scoring situational judgment tests: Once you get the data, your troubles begin",
abstract = "Although situational judgment tests (SJTs) have been in use for decades, consensus has not been reached on the best way to score these assessments or others (e.g., biodata) whose items do not have a single demonstrably correct answer. The purpose of this paper is to review and to demonstrate the scoring strategies that have been described in the literature. Implementation and relative merits of these strategies are described. Then, several of these methods are applied to create 11 different keys for a video-based SJT in order to demonstrate how to evaluate the quality of keys. Implications of scoring SJTs for theory and practice are discussed.",
author = "Bergman, {Mindy E.} and Fritz Drasgow and Donovan, {Michelle A.} and Henning, {Jaime B.} and Juraska, {Suzanne E.}",
year = "2006",
month = "9",
day = "1",
doi = "10.1111/j.1468-2389.2006.00345.x",
language = "English (US)",
volume = "14",
pages = "223--235",
journal = "International Journal of Selection and Assessment",
issn = "0965-075X",
publisher = "Wiley-Blackwell",
number = "3",

}

TY - JOUR

T1 - Scoring situational judgment tests

T2 - Once you get the data, your troubles begin

AU - Bergman, Mindy E.

AU - Drasgow, Fritz

AU - Donovan, Michelle A.

AU - Henning, Jaime B.

AU - Juraska, Suzanne E.

PY - 2006/9/1

Y1 - 2006/9/1

N2 - Although situational judgment tests (SJTs) have been in use for decades, consensus has not been reached on the best way to score these assessments or others (e.g., biodata) whose items do not have a single demonstrably correct answer. The purpose of this paper is to review and to demonstrate the scoring strategies that have been described in the literature. Implementation and relative merits of these strategies are described. Then, several of these methods are applied to create 11 different keys for a video-based SJT in order to demonstrate how to evaluate the quality of keys. Implications of scoring SJTs for theory and practice are discussed.

AB - Although situational judgment tests (SJTs) have been in use for decades, consensus has not been reached on the best way to score these assessments or others (e.g., biodata) whose items do not have a single demonstrably correct answer. The purpose of this paper is to review and to demonstrate the scoring strategies that have been described in the literature. Implementation and relative merits of these strategies are described. Then, several of these methods are applied to create 11 different keys for a video-based SJT in order to demonstrate how to evaluate the quality of keys. Implications of scoring SJTs for theory and practice are discussed.

UR - http://www.scopus.com/inward/record.url?scp=33845419000&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=33845419000&partnerID=8YFLogxK

U2 - 10.1111/j.1468-2389.2006.00345.x

DO - 10.1111/j.1468-2389.2006.00345.x

M3 - Review article

VL - 14

SP - 223

EP - 235

JO - International Journal of Selection and Assessment

JF - International Journal of Selection and Assessment

SN - 0965-075X

IS - 3

ER -