TY - GEN
T1 - To crowdsource or not to crowdsource?
AU - Ranade, Gireeja
AU - Varshney, Lav R.
PY - 2012
Y1 - 2012
N2 - Crowdsourcing contests - events to solicit solutions to problems via an open-call format for prizes - have gained ground as a mechanism for organizations to accomplish tasks. This paper uses game-theoretic models to develop design principles for crowdsourcing contests and answer the questions: what types of tasks should be crowdsourced? Under what circumstances? When a single task is to be completed, crowdsourcing can lead to higher quality outcomes than directed assignment if the pool of players is diverse, but can lead to suboptimal outcomes when workers have similar abilities. With multiple tasks, crowdsourcing can easily match players with diverse skill-sets to different tasks to achieve high aggregate performance. However, surprisingly, crowdsourcing is not always useful to find expert workers for highly specialized tasks.
AB - Crowdsourcing contests - events to solicit solutions to problems via an open-call format for prizes - have gained ground as a mechanism for organizations to accomplish tasks. This paper uses game-theoretic models to develop design principles for crowdsourcing contests and answer the questions: what types of tasks should be crowdsourced? Under what circumstances? When a single task is to be completed, crowdsourcing can lead to higher quality outcomes than directed assignment if the pool of players is diverse, but can lead to suboptimal outcomes when workers have similar abilities. With multiple tasks, crowdsourcing can easily match players with diverse skill-sets to different tasks to achieve high aggregate performance. However, surprisingly, crowdsourcing is not always useful to find expert workers for highly specialized tasks.
UR - http://www.scopus.com/inward/record.url?scp=84875743213&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=84875743213&partnerID=8YFLogxK
M3 - Conference contribution
AN - SCOPUS:84875743213
SN - 9781577355731
T3 - AAAI Workshop - Technical Report
SP - 150
EP - 156
BT - Human Computation - Papers from the 2012 AAAI Workshop, Technical Report
T2 - 2012 AAAI Workshop
Y2 - 23 July 2012 through 23 July 2012
ER -