Increasing quality and involvement in online peer feedback exchange

Sneha R.Krishna Kumaran, Deana C McDonagh, Brian P Bailey

Research output: Contribution to journalArticle

Abstract

Design instructors are integrating the use of online peer review platforms to keep pace with growing class sizes. However, these platforms typically prioritize randomized peer assignment strategies and show only the current solution to peers when writing feedback. This can result in low quality feedback in project-based design courses. We report on an experiment in which students (N=59) worked on twelve-week design projects and both wrote and received online feedback at four stages. The experiment tested a novel assignment strategy of peer mentorship, where peers were assigned to give feedback to all stages of the same project, and tested showing the context from the preceding design stage when composing feedback. The results showed that displaying the context from the preceding design stage led to feedback with higher perceived quality at the late design stages (but not at earlier stages) and feedback from mentors prompts longer responses from the feedback recipients. Our work contributes deeper empirical understanding of how assignment strategies and showing additional context affects peer feedback and provides practical guidelines for instructors to implement these methods in design courses.

Original languageEnglish (US)
Article number63
JournalProceedings of the ACM on Human-Computer Interaction
Volume1
Issue numberCSCW
DOIs
StatePublished - Nov 2017

Fingerprint

Feedback
instructor
experiment
peer review
recipient
Experiments
Students
student

Keywords

  • Design
  • Iteration
  • Learning
  • Peer feedback
  • Peer mentorship

ASJC Scopus subject areas

  • Computer Networks and Communications
  • Human-Computer Interaction
  • Social Sciences (miscellaneous)

Cite this

Increasing quality and involvement in online peer feedback exchange. / Kumaran, Sneha R.Krishna; McDonagh, Deana C; Bailey, Brian P.

In: Proceedings of the ACM on Human-Computer Interaction, Vol. 1, No. CSCW, 63, 11.2017.

Research output: Contribution to journalArticle

@article{0fd3796b6f0c40cfa60659ca1f01ff3d,
title = "Increasing quality and involvement in online peer feedback exchange",
abstract = "Design instructors are integrating the use of online peer review platforms to keep pace with growing class sizes. However, these platforms typically prioritize randomized peer assignment strategies and show only the current solution to peers when writing feedback. This can result in low quality feedback in project-based design courses. We report on an experiment in which students (N=59) worked on twelve-week design projects and both wrote and received online feedback at four stages. The experiment tested a novel assignment strategy of peer mentorship, where peers were assigned to give feedback to all stages of the same project, and tested showing the context from the preceding design stage when composing feedback. The results showed that displaying the context from the preceding design stage led to feedback with higher perceived quality at the late design stages (but not at earlier stages) and feedback from mentors prompts longer responses from the feedback recipients. Our work contributes deeper empirical understanding of how assignment strategies and showing additional context affects peer feedback and provides practical guidelines for instructors to implement these methods in design courses.",
keywords = "Design, Iteration, Learning, Peer feedback, Peer mentorship",
author = "Kumaran, {Sneha R.Krishna} and McDonagh, {Deana C} and Bailey, {Brian P}",
year = "2017",
month = "11",
doi = "10.1145/3134698",
language = "English (US)",
volume = "1",
journal = "Proceedings of the ACM on Human-Computer Interaction",
issn = "2573-0142",
publisher = "Association for Computing Machinery (ACM)",
number = "CSCW",

}

TY - JOUR

T1 - Increasing quality and involvement in online peer feedback exchange

AU - Kumaran, Sneha R.Krishna

AU - McDonagh, Deana C

AU - Bailey, Brian P

PY - 2017/11

Y1 - 2017/11

N2 - Design instructors are integrating the use of online peer review platforms to keep pace with growing class sizes. However, these platforms typically prioritize randomized peer assignment strategies and show only the current solution to peers when writing feedback. This can result in low quality feedback in project-based design courses. We report on an experiment in which students (N=59) worked on twelve-week design projects and both wrote and received online feedback at four stages. The experiment tested a novel assignment strategy of peer mentorship, where peers were assigned to give feedback to all stages of the same project, and tested showing the context from the preceding design stage when composing feedback. The results showed that displaying the context from the preceding design stage led to feedback with higher perceived quality at the late design stages (but not at earlier stages) and feedback from mentors prompts longer responses from the feedback recipients. Our work contributes deeper empirical understanding of how assignment strategies and showing additional context affects peer feedback and provides practical guidelines for instructors to implement these methods in design courses.

AB - Design instructors are integrating the use of online peer review platforms to keep pace with growing class sizes. However, these platforms typically prioritize randomized peer assignment strategies and show only the current solution to peers when writing feedback. This can result in low quality feedback in project-based design courses. We report on an experiment in which students (N=59) worked on twelve-week design projects and both wrote and received online feedback at four stages. The experiment tested a novel assignment strategy of peer mentorship, where peers were assigned to give feedback to all stages of the same project, and tested showing the context from the preceding design stage when composing feedback. The results showed that displaying the context from the preceding design stage led to feedback with higher perceived quality at the late design stages (but not at earlier stages) and feedback from mentors prompts longer responses from the feedback recipients. Our work contributes deeper empirical understanding of how assignment strategies and showing additional context affects peer feedback and provides practical guidelines for instructors to implement these methods in design courses.

KW - Design

KW - Iteration

KW - Learning

KW - Peer feedback

KW - Peer mentorship

UR - http://www.scopus.com/inward/record.url?scp=85066420340&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85066420340&partnerID=8YFLogxK

U2 - 10.1145/3134698

DO - 10.1145/3134698

M3 - Article

AN - SCOPUS:85066420340

VL - 1

JO - Proceedings of the ACM on Human-Computer Interaction

JF - Proceedings of the ACM on Human-Computer Interaction

SN - 2573-0142

IS - CSCW

M1 - 63

ER -