An approach to measuring cognitive outcomes across higher education institutions

Stephen P. Klein, George D Kuh, Marc Chun, Laura Hamilton, Richard Shavelson

Research output: Contribution to journalArticle

Abstract

Over the past decade, state legislatures have experienced increasing pressure to hold higher education accountable for student learning. This pressure stems from several sources, such as increasing costs and decreasing graduation rates. To explore the feasibility of one approach to measuring student learning that emphasizes program improvement, we administered several open-ended tests to 1365 students from 14 diverse colleges. The strong correspondence between hand and computer assigned scores indicates the tests can be administered and graded cost effectively on a large scale. The scores were highly reliable, especially when the college is the unit of analysis; they were sensitive to years in college; and they correlated highly with college GPAs. We also found evidence of "value added" in that scores were significantly higher at some schools than at others after controlling on the school's mean SAT score. Finally, the students said the tasks were interesting and engaging.

Original languageEnglish (US)
Pages (from-to)251-276
Number of pages26
JournalResearch in Higher Education
Volume46
Issue number3
DOIs
StatePublished - May 2005

Fingerprint

education
student
costs
value added
school
learning
evidence

Keywords

  • Assessment
  • Measuring student outcomes
  • Value added

ASJC Scopus subject areas

  • Education

Cite this

An approach to measuring cognitive outcomes across higher education institutions. / Klein, Stephen P.; Kuh, George D; Chun, Marc; Hamilton, Laura; Shavelson, Richard.

In: Research in Higher Education, Vol. 46, No. 3, 05.2005, p. 251-276.

Research output: Contribution to journalArticle

Klein, Stephen P. ; Kuh, George D ; Chun, Marc ; Hamilton, Laura ; Shavelson, Richard. / An approach to measuring cognitive outcomes across higher education institutions. In: Research in Higher Education. 2005 ; Vol. 46, No. 3. pp. 251-276.
@article{e4c6d7c356c94d56b07ae9081af6c0c7,
title = "An approach to measuring cognitive outcomes across higher education institutions",
abstract = "Over the past decade, state legislatures have experienced increasing pressure to hold higher education accountable for student learning. This pressure stems from several sources, such as increasing costs and decreasing graduation rates. To explore the feasibility of one approach to measuring student learning that emphasizes program improvement, we administered several open-ended tests to 1365 students from 14 diverse colleges. The strong correspondence between hand and computer assigned scores indicates the tests can be administered and graded cost effectively on a large scale. The scores were highly reliable, especially when the college is the unit of analysis; they were sensitive to years in college; and they correlated highly with college GPAs. We also found evidence of {"}value added{"} in that scores were significantly higher at some schools than at others after controlling on the school's mean SAT score. Finally, the students said the tasks were interesting and engaging.",
keywords = "Assessment, Measuring student outcomes, Value added",
author = "Klein, {Stephen P.} and Kuh, {George D} and Marc Chun and Laura Hamilton and Richard Shavelson",
year = "2005",
month = "5",
doi = "10.1007/s11162-004-1640-3",
language = "English (US)",
volume = "46",
pages = "251--276",
journal = "Research in Higher Education",
issn = "0361-0365",
publisher = "Springer Netherlands",
number = "3",

}

TY - JOUR

T1 - An approach to measuring cognitive outcomes across higher education institutions

AU - Klein, Stephen P.

AU - Kuh, George D

AU - Chun, Marc

AU - Hamilton, Laura

AU - Shavelson, Richard

PY - 2005/5

Y1 - 2005/5

N2 - Over the past decade, state legislatures have experienced increasing pressure to hold higher education accountable for student learning. This pressure stems from several sources, such as increasing costs and decreasing graduation rates. To explore the feasibility of one approach to measuring student learning that emphasizes program improvement, we administered several open-ended tests to 1365 students from 14 diverse colleges. The strong correspondence between hand and computer assigned scores indicates the tests can be administered and graded cost effectively on a large scale. The scores were highly reliable, especially when the college is the unit of analysis; they were sensitive to years in college; and they correlated highly with college GPAs. We also found evidence of "value added" in that scores were significantly higher at some schools than at others after controlling on the school's mean SAT score. Finally, the students said the tasks were interesting and engaging.

AB - Over the past decade, state legislatures have experienced increasing pressure to hold higher education accountable for student learning. This pressure stems from several sources, such as increasing costs and decreasing graduation rates. To explore the feasibility of one approach to measuring student learning that emphasizes program improvement, we administered several open-ended tests to 1365 students from 14 diverse colleges. The strong correspondence between hand and computer assigned scores indicates the tests can be administered and graded cost effectively on a large scale. The scores were highly reliable, especially when the college is the unit of analysis; they were sensitive to years in college; and they correlated highly with college GPAs. We also found evidence of "value added" in that scores were significantly higher at some schools than at others after controlling on the school's mean SAT score. Finally, the students said the tasks were interesting and engaging.

KW - Assessment

KW - Measuring student outcomes

KW - Value added

UR - http://www.scopus.com/inward/record.url?scp=14944373897&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=14944373897&partnerID=8YFLogxK

U2 - 10.1007/s11162-004-1640-3

DO - 10.1007/s11162-004-1640-3

M3 - Article

AN - SCOPUS:14944373897

VL - 46

SP - 251

EP - 276

JO - Research in Higher Education

JF - Research in Higher Education

SN - 0361-0365

IS - 3

ER -