Abstract
As demand for design education increases, instructors are struggling to provide timely, personalized feedback for student projects. Gathering feedback from classroom peers and external crowds offer scalable approaches, but there is little evidence of how they compare. We report on a study in which students (n=127) created early- and late-stage prototypes as part of nine-week projects. At each stage, students received feedback from peers and external crowds: their own social networks, online communities, and a task market. We measured the quality, quantity and valence of the feedback and the actions taken on it, and categorized its content using a taxonomy of critique discourse. The study found that peers produced feedback that was of higher perceived quality, acted upon more, and longer compared to the crowds. However, crowd feedback was found to be a viable supplement to peer feedback and students preferred it for projects targeting specialized audiences. Feedback from all sources spanned only a subset of the critique categories. Instructors may fill this gap by further scaffolding feedback generation. The study contributes insights for how to best utilize different feedback sources in project-based courses.
| Original language | English (US) |
|---|---|
| Title of host publication | CHI 2017 - Proceedings of the 2017 ACM SIGCHI Conference on Human Factors in Computing Systems |
| Subtitle of host publication | Explore, Innovate, Inspire |
| Publisher | Association for Computing Machinery |
| Pages | 5580-5591 |
| Number of pages | 12 |
| ISBN (Electronic) | 9781450346559 |
| DOIs | |
| State | Published - May 2 2017 |
| Event | 2017 ACM SIGCHI Conference on Human Factors in Computing Systems, CHI 2017 - Denver, United States Duration: May 6 2017 → May 11 2017 |
Publication series
| Name | Conference on Human Factors in Computing Systems - Proceedings |
|---|---|
| Volume | 2017-May |
Other
| Other | 2017 ACM SIGCHI Conference on Human Factors in Computing Systems, CHI 2017 |
|---|---|
| Country | United States |
| City | Denver |
| Period | 5/6/17 → 5/11/17 |
Fingerprint
Keywords
- Crowdsourcing
- Design methods
- Feedback
- Learning
ASJC Scopus subject areas
- Software
- Human-Computer Interaction
- Computer Graphics and Computer-Aided Design
Cite this
From in the class or in the wild? Peers provide better design feedback than external crowds. / Wauck, Helen; Yen, Yu Chun; Fu, Wai-Tat; Gerber, Elizabeth; Dow, Steven P.; Bailey, Brian P.
CHI 2017 - Proceedings of the 2017 ACM SIGCHI Conference on Human Factors in Computing Systems: Explore, Innovate, Inspire. Association for Computing Machinery, 2017. p. 5580-5591 (Conference on Human Factors in Computing Systems - Proceedings; Vol. 2017-May).Research output: Chapter in Book/Report/Conference proceeding › Conference contribution
}
TY - GEN
T1 - From in the class or in the wild? Peers provide better design feedback than external crowds
AU - Wauck, Helen
AU - Yen, Yu Chun
AU - Fu, Wai-Tat
AU - Gerber, Elizabeth
AU - Dow, Steven P.
AU - Bailey, Brian P
PY - 2017/5/2
Y1 - 2017/5/2
N2 - As demand for design education increases, instructors are struggling to provide timely, personalized feedback for student projects. Gathering feedback from classroom peers and external crowds offer scalable approaches, but there is little evidence of how they compare. We report on a study in which students (n=127) created early- and late-stage prototypes as part of nine-week projects. At each stage, students received feedback from peers and external crowds: their own social networks, online communities, and a task market. We measured the quality, quantity and valence of the feedback and the actions taken on it, and categorized its content using a taxonomy of critique discourse. The study found that peers produced feedback that was of higher perceived quality, acted upon more, and longer compared to the crowds. However, crowd feedback was found to be a viable supplement to peer feedback and students preferred it for projects targeting specialized audiences. Feedback from all sources spanned only a subset of the critique categories. Instructors may fill this gap by further scaffolding feedback generation. The study contributes insights for how to best utilize different feedback sources in project-based courses.
AB - As demand for design education increases, instructors are struggling to provide timely, personalized feedback for student projects. Gathering feedback from classroom peers and external crowds offer scalable approaches, but there is little evidence of how they compare. We report on a study in which students (n=127) created early- and late-stage prototypes as part of nine-week projects. At each stage, students received feedback from peers and external crowds: their own social networks, online communities, and a task market. We measured the quality, quantity and valence of the feedback and the actions taken on it, and categorized its content using a taxonomy of critique discourse. The study found that peers produced feedback that was of higher perceived quality, acted upon more, and longer compared to the crowds. However, crowd feedback was found to be a viable supplement to peer feedback and students preferred it for projects targeting specialized audiences. Feedback from all sources spanned only a subset of the critique categories. Instructors may fill this gap by further scaffolding feedback generation. The study contributes insights for how to best utilize different feedback sources in project-based courses.
KW - Crowdsourcing
KW - Design methods
KW - Feedback
KW - Learning
UR - http://www.scopus.com/inward/record.url?scp=85044845401&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85044845401&partnerID=8YFLogxK
U2 - 10.1145/3025453.3025477
DO - 10.1145/3025453.3025477
M3 - Conference contribution
AN - SCOPUS:85044845401
T3 - Conference on Human Factors in Computing Systems - Proceedings
SP - 5580
EP - 5591
BT - CHI 2017 - Proceedings of the 2017 ACM SIGCHI Conference on Human Factors in Computing Systems
PB - Association for Computing Machinery
ER -