A classroom study of using crowd feedback in the iterative design process

Anbang Xu, Huaming Rao, Steven P. Dow, Brian P. Bailey

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Crowd feedback systems offer designers an emerging approach for improving their designs, but there is little empirical evidence of the benefit of these systems. This paper reports the results of a study of using a crowd feedback system to iterate on visual designs. Users in an introductory visual design course created initial designs satisfying a design brief and received crowd feedback on the designs. Users revised the designs and the system was used to generate feedback again. This format enabled us to detect the changes between the initial and revised designs and how the feedback related to those changes. Further, we analyzed the value of crowd feedback by comparing it with expert evaluation and feedback generated via free-form prompts. Results showed that the crowd feedback system prompted deep and cosmetic changes and led to improved designs, the crowd recognized the design improvements, and structured workflows generated more interpretative, diverse and critical feedback than free-form prompts.

Original languageEnglish (US)
Title of host publicationCSCW 2015 - Proceedings of the 2015 ACM International Conference on Computer-Supported Cooperative Work and Social Computing
PublisherAssociation for Computing Machinery, Inc
Pages1637-1648
Number of pages12
ISBN (Electronic)9781450329224
DOIs
StatePublished - Feb 28 2015
Event18th ACM International Conference on Computer-Supported Cooperative Work and Social Computing, CSCW 2015 - BC, Canada
Duration: Mar 14 2015Mar 18 2015

Publication series

NameCSCW 2015 - Proceedings of the 2015 ACM International Conference on Computer-Supported Cooperative Work and Social Computing

Other

Other18th ACM International Conference on Computer-Supported Cooperative Work and Social Computing, CSCW 2015
Country/TerritoryCanada
CityBC
Period3/14/153/18/15

Keywords

  • Crowd feedback
  • creativity.
  • crowdsourcing
  • design iteration
  • visual design

ASJC Scopus subject areas

  • Computer Networks and Communications

Fingerprint

Dive into the research topics of 'A classroom study of using crowd feedback in the iterative design process'. Together they form a unique fingerprint.

Cite this