Understanding workers, developing effective tasks, and enhancing marketplace dynamics: A study of a large crowdsourcing marketplace

Ayush Jain, Akash Das Sarma, Aditya Parameswaran, Jennifer Widom

Research output: Contribution to journalConference article

Abstract

We conduct an experimental analysis of a dataset comprising over 27 million microtasks performed by over 70,000 workers issued to a large crowdsourcing marketplace between 2012-2016. Using this data-never before analyzed in an academic context-we shed light on three crucial aspects of crowdsourcing: (1) Task design -helping requesters understand what constitutes an effective task, and how to go about designing one; (2) Marketplace dynamics - helping marketplace administrators and designers understand the interaction between tasks and workers, and the corresponding marketplace load; and (3) Worker behavior - understanding worker attention spans, lifetimes, and general behavior, for the improvement of the crowdsourcing ecosystem as a whole.

Original languageEnglish (US)
Pages (from-to)829-840
Number of pages12
JournalProceedings of the VLDB Endowment
Volume10
Issue number7
DOIs
StatePublished - Jan 1 2017
Event43rd International Conference on Very Large Data Bases, VLDB 2017 - Munich, Germany
Duration: Aug 28 2017Sep 1 2017

ASJC Scopus subject areas

  • Computer Science (miscellaneous)
  • Computer Science(all)

Fingerprint Dive into the research topics of 'Understanding workers, developing effective tasks, and enhancing marketplace dynamics: A study of a large crowdsourcing marketplace'. Together they form a unique fingerprint.

  • Cite this