Opportunities for Gaming the System: How Data Collection Design Influences Program Assessment Outcomes

Jasmine D. Collins, David M. Rosch, Clinton M. Stephens

Research output: Contribution to journalArticle

Abstract

Opportunities for college students to develop their leadership capacity through participation in formal leadership programs have grown tremendously. As the assessment of such programs rises, educators must become knowledgeable about the potentially significant design effects on assessment results. Using a national leadership program as a case study, we quasi-experimentally examined the effects of data collection design on measured outcomes, and discovered surprisingly noteworthy differences in results. Our work suggests that collection design may be even more important to whether leadership programs seem to make a difference than the curriculum itself.

Original languageEnglish (US)
Pages (from-to)68-71
Number of pages4
JournalJournal of Leadership Studies
Volume12
Issue number2
DOIs
StatePublished - Jun 1 2018

Fingerprint

leadership
educator
curriculum
participation
student

ASJC Scopus subject areas

  • Education

Cite this

Opportunities for Gaming the System : How Data Collection Design Influences Program Assessment Outcomes. / Collins, Jasmine D.; Rosch, David M.; Stephens, Clinton M.

In: Journal of Leadership Studies, Vol. 12, No. 2, 01.06.2018, p. 68-71.

Research output: Contribution to journalArticle

@article{669a2d1dd1fe4b99b009d1d3ad93aa6d,
title = "Opportunities for Gaming the System: How Data Collection Design Influences Program Assessment Outcomes",
abstract = "Opportunities for college students to develop their leadership capacity through participation in formal leadership programs have grown tremendously. As the assessment of such programs rises, educators must become knowledgeable about the potentially significant design effects on assessment results. Using a national leadership program as a case study, we quasi-experimentally examined the effects of data collection design on measured outcomes, and discovered surprisingly noteworthy differences in results. Our work suggests that collection design may be even more important to whether leadership programs seem to make a difference than the curriculum itself.",
author = "Collins, {Jasmine D.} and Rosch, {David M.} and Stephens, {Clinton M.}",
year = "2018",
month = "6",
day = "1",
doi = "10.1002/jls.21581",
language = "English (US)",
volume = "12",
pages = "68--71",
journal = "Journal of Leadership Studies",
issn = "1935-2611",
publisher = "John Wiley and Sons Ltd",
number = "2",

}

TY - JOUR

T1 - Opportunities for Gaming the System

T2 - How Data Collection Design Influences Program Assessment Outcomes

AU - Collins, Jasmine D.

AU - Rosch, David M.

AU - Stephens, Clinton M.

PY - 2018/6/1

Y1 - 2018/6/1

N2 - Opportunities for college students to develop their leadership capacity through participation in formal leadership programs have grown tremendously. As the assessment of such programs rises, educators must become knowledgeable about the potentially significant design effects on assessment results. Using a national leadership program as a case study, we quasi-experimentally examined the effects of data collection design on measured outcomes, and discovered surprisingly noteworthy differences in results. Our work suggests that collection design may be even more important to whether leadership programs seem to make a difference than the curriculum itself.

AB - Opportunities for college students to develop their leadership capacity through participation in formal leadership programs have grown tremendously. As the assessment of such programs rises, educators must become knowledgeable about the potentially significant design effects on assessment results. Using a national leadership program as a case study, we quasi-experimentally examined the effects of data collection design on measured outcomes, and discovered surprisingly noteworthy differences in results. Our work suggests that collection design may be even more important to whether leadership programs seem to make a difference than the curriculum itself.

UR - http://www.scopus.com/inward/record.url?scp=85053907529&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85053907529&partnerID=8YFLogxK

U2 - 10.1002/jls.21581

DO - 10.1002/jls.21581

M3 - Article

AN - SCOPUS:85053907529

VL - 12

SP - 68

EP - 71

JO - Journal of Leadership Studies

JF - Journal of Leadership Studies

SN - 1935-2611

IS - 2

ER -