Validating a Holistic Rubric for Scoring Short Answer Reading Questions

Sara T. Cushing, Rurik Tywoniw

Research output: Chapter in Book/Report/Conference proceedingChapter


This study presents an investigation of the validity of a practical scoring procedure for short answer (sentence length) reading comprehension questions, using a holistic rubric for sets of responses rather than scoring individual responses, on a university-based English proficiency test. Thirty-three previously scored response sets were rescored by the researchers at the item level, with ratings for completion, fidelity to the source text, and overlap with source text language. Results confirm that holistic section-based scores are predicted by fidelity ratings only, providing evidence to support the scoring inference of the validity argument.
Original languageEnglish (US)
Title of host publicationAnother Generation of Fundamental Considerations in Language Assessment
Subtitle of host publicationA Festschrift in Honor of Lyle F. Bachman
EditorsGary J. Ockey, Brent A. Green
Number of pages16
ISBN (Electronic)9789811589522
ISBN (Print)9789811589515
StatePublished - Nov 24 2020


Dive into the research topics of 'Validating a Holistic Rubric for Scoring Short Answer Reading Questions'. Together they form a unique fingerprint.

Cite this