Efficient and flexible crowdsourcing of specialized tasks with precedence constraints

Avhishek Chatterjee, Michael Borokhovich, Lav R Varshney, Sriram Vishwanath

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Many companies now use crowdsourcing to leverage external (as well as internal) crowds to perform specialized work, and so methods of improving efficiency are critical. Tasks in crowdsourcing systems with specialized work have multiple steps and each step requires multiple skills. Steps may have different flexibilities in terms of obtaining service from one or multiple agents, due to varying levels of dependency among parts of steps. Steps of a task may have precedence constraints among them. Moreover, there are variations in loads of different types of tasks requiring different skill-sets and availabilities of different types of agents with different skill-sets. Considering these constraints together necessitates the design of novel schemes to allocate steps to agents. In addition, large crowdsourcing systems require allocation schemes that are simple, fast, decentralized and offer customers (task requesters) the freedom to choose agents. In this work we study the performance limits of such crowdsourcing systems and propose efficient allocation schemes that provably meet the performance limits under these additional requirements. We demonstrate our algorithms on data from a crowdsourcing platform run by a non-profit company and show significant improvements over current practice.

Original languageEnglish (US)
Title of host publicationIEEE INFOCOM 2016 - 35th Annual IEEE International Conference on Computer Communications
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9781467399531
DOIs
StatePublished - Jul 27 2016
Event35th Annual IEEE International Conference on Computer Communications, IEEE INFOCOM 2016 - San Francisco, United States
Duration: Apr 10 2016Apr 14 2016

Publication series

NameProceedings - IEEE INFOCOM
Volume2016-July
ISSN (Print)0743-166X

Other

Other35th Annual IEEE International Conference on Computer Communications, IEEE INFOCOM 2016
CountryUnited States
CitySan Francisco
Period4/10/164/14/16

Fingerprint

Industry
Availability

ASJC Scopus subject areas

  • Computer Science(all)
  • Electrical and Electronic Engineering

Cite this

Chatterjee, A., Borokhovich, M., Varshney, L. R., & Vishwanath, S. (2016). Efficient and flexible crowdsourcing of specialized tasks with precedence constraints. In IEEE INFOCOM 2016 - 35th Annual IEEE International Conference on Computer Communications [7524615] (Proceedings - IEEE INFOCOM; Vol. 2016-July). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/INFOCOM.2016.7524615

Efficient and flexible crowdsourcing of specialized tasks with precedence constraints. / Chatterjee, Avhishek; Borokhovich, Michael; Varshney, Lav R; Vishwanath, Sriram.

IEEE INFOCOM 2016 - 35th Annual IEEE International Conference on Computer Communications. Institute of Electrical and Electronics Engineers Inc., 2016. 7524615 (Proceedings - IEEE INFOCOM; Vol. 2016-July).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Chatterjee, A, Borokhovich, M, Varshney, LR & Vishwanath, S 2016, Efficient and flexible crowdsourcing of specialized tasks with precedence constraints. in IEEE INFOCOM 2016 - 35th Annual IEEE International Conference on Computer Communications., 7524615, Proceedings - IEEE INFOCOM, vol. 2016-July, Institute of Electrical and Electronics Engineers Inc., 35th Annual IEEE International Conference on Computer Communications, IEEE INFOCOM 2016, San Francisco, United States, 4/10/16. https://doi.org/10.1109/INFOCOM.2016.7524615
Chatterjee A, Borokhovich M, Varshney LR, Vishwanath S. Efficient and flexible crowdsourcing of specialized tasks with precedence constraints. In IEEE INFOCOM 2016 - 35th Annual IEEE International Conference on Computer Communications. Institute of Electrical and Electronics Engineers Inc. 2016. 7524615. (Proceedings - IEEE INFOCOM). https://doi.org/10.1109/INFOCOM.2016.7524615
Chatterjee, Avhishek ; Borokhovich, Michael ; Varshney, Lav R ; Vishwanath, Sriram. / Efficient and flexible crowdsourcing of specialized tasks with precedence constraints. IEEE INFOCOM 2016 - 35th Annual IEEE International Conference on Computer Communications. Institute of Electrical and Electronics Engineers Inc., 2016. (Proceedings - IEEE INFOCOM).
@inproceedings{3d8d05a8912d40f0b51242fc6bf466c0,
title = "Efficient and flexible crowdsourcing of specialized tasks with precedence constraints",
abstract = "Many companies now use crowdsourcing to leverage external (as well as internal) crowds to perform specialized work, and so methods of improving efficiency are critical. Tasks in crowdsourcing systems with specialized work have multiple steps and each step requires multiple skills. Steps may have different flexibilities in terms of obtaining service from one or multiple agents, due to varying levels of dependency among parts of steps. Steps of a task may have precedence constraints among them. Moreover, there are variations in loads of different types of tasks requiring different skill-sets and availabilities of different types of agents with different skill-sets. Considering these constraints together necessitates the design of novel schemes to allocate steps to agents. In addition, large crowdsourcing systems require allocation schemes that are simple, fast, decentralized and offer customers (task requesters) the freedom to choose agents. In this work we study the performance limits of such crowdsourcing systems and propose efficient allocation schemes that provably meet the performance limits under these additional requirements. We demonstrate our algorithms on data from a crowdsourcing platform run by a non-profit company and show significant improvements over current practice.",
author = "Avhishek Chatterjee and Michael Borokhovich and Varshney, {Lav R} and Sriram Vishwanath",
year = "2016",
month = "7",
day = "27",
doi = "10.1109/INFOCOM.2016.7524615",
language = "English (US)",
series = "Proceedings - IEEE INFOCOM",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
booktitle = "IEEE INFOCOM 2016 - 35th Annual IEEE International Conference on Computer Communications",
address = "United States",

}

TY - GEN

T1 - Efficient and flexible crowdsourcing of specialized tasks with precedence constraints

AU - Chatterjee, Avhishek

AU - Borokhovich, Michael

AU - Varshney, Lav R

AU - Vishwanath, Sriram

PY - 2016/7/27

Y1 - 2016/7/27

N2 - Many companies now use crowdsourcing to leverage external (as well as internal) crowds to perform specialized work, and so methods of improving efficiency are critical. Tasks in crowdsourcing systems with specialized work have multiple steps and each step requires multiple skills. Steps may have different flexibilities in terms of obtaining service from one or multiple agents, due to varying levels of dependency among parts of steps. Steps of a task may have precedence constraints among them. Moreover, there are variations in loads of different types of tasks requiring different skill-sets and availabilities of different types of agents with different skill-sets. Considering these constraints together necessitates the design of novel schemes to allocate steps to agents. In addition, large crowdsourcing systems require allocation schemes that are simple, fast, decentralized and offer customers (task requesters) the freedom to choose agents. In this work we study the performance limits of such crowdsourcing systems and propose efficient allocation schemes that provably meet the performance limits under these additional requirements. We demonstrate our algorithms on data from a crowdsourcing platform run by a non-profit company and show significant improvements over current practice.

AB - Many companies now use crowdsourcing to leverage external (as well as internal) crowds to perform specialized work, and so methods of improving efficiency are critical. Tasks in crowdsourcing systems with specialized work have multiple steps and each step requires multiple skills. Steps may have different flexibilities in terms of obtaining service from one or multiple agents, due to varying levels of dependency among parts of steps. Steps of a task may have precedence constraints among them. Moreover, there are variations in loads of different types of tasks requiring different skill-sets and availabilities of different types of agents with different skill-sets. Considering these constraints together necessitates the design of novel schemes to allocate steps to agents. In addition, large crowdsourcing systems require allocation schemes that are simple, fast, decentralized and offer customers (task requesters) the freedom to choose agents. In this work we study the performance limits of such crowdsourcing systems and propose efficient allocation schemes that provably meet the performance limits under these additional requirements. We demonstrate our algorithms on data from a crowdsourcing platform run by a non-profit company and show significant improvements over current practice.

UR - http://www.scopus.com/inward/record.url?scp=84983371502&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84983371502&partnerID=8YFLogxK

U2 - 10.1109/INFOCOM.2016.7524615

DO - 10.1109/INFOCOM.2016.7524615

M3 - Conference contribution

AN - SCOPUS:84983371502

T3 - Proceedings - IEEE INFOCOM

BT - IEEE INFOCOM 2016 - 35th Annual IEEE International Conference on Computer Communications

PB - Institute of Electrical and Electronics Engineers Inc.

ER -