Abstract
This study presents an investigation of the validity of a practical scoring procedure for short answer (sentence length) reading comprehension questions, using a holistic rubric for sets of responses rather than scoring individual responses, on a university-based English proficiency test. Thirty-three previously scored response sets were rescored by the researchers at the item level, with ratings for completion, fidelity to the source text, and overlap with source text language. Results confirm that holistic section-based scores are predicted by fidelity ratings only, providing evidence to support the scoring inference of the validity argument.
| Original language | English (US) |
|---|---|
| Title of host publication | Another Generation of Fundamental Considerations in Language Assessment |
| Subtitle of host publication | A Festschrift in Honor of Lyle F. Bachman |
| Editors | Gary J. Ockey, Brent A. Green |
| Publisher | Springer |
| Chapter | 8 |
| Pages | 113-128 |
| Number of pages | 16 |
| ISBN (Electronic) | 9789811589522 |
| ISBN (Print) | 9789811589515 |
| DOIs | |
| State | Published - Nov 24 2020 |