Assuring privacy and reliability in crowdsourcing with coding

Lav R Varshney, Aditya Vempaty, Pramod K. Varshney

Research output: Contribution to conferencePaper

Abstract

Crowd workers are often unreliable and anonymous. Hence there is a need to ensure reliable work delivery while preserving some level of privacy to the requester's data. For this purpose, we use a combination of random perturbation to mask the sensitive data and error-correcting codes for quality assurance. We also consider the possibility of collusion attacks by malicious crowd workers. We develop mathematical models to study the precise tradeoffs between task performance quality, level of privacy against collusion attacks, and cost of invoking a large crowd. Such a study provides design strategies and principles for crowd work. The use of classification codes may improve efficiency considerably. We also comment on the applicability of these techniques for scalable assessment in education via peer grading, e.g. for massive open online courses (MOOCs).

Original languageEnglish (US)
DOIs
StatePublished - Jan 1 2014
Event2014 IEEE Information Theory and Applications Workshop, ITA 2014 - San Diego, CA, United States
Duration: Feb 9 2014Feb 14 2014

Other

Other2014 IEEE Information Theory and Applications Workshop, ITA 2014
CountryUnited States
CitySan Diego, CA
Period2/9/142/14/14

Fingerprint

Quality assurance
Masks
Education
Mathematical models
Costs

ASJC Scopus subject areas

  • Computer Science Applications
  • Information Systems

Cite this

Varshney, L. R., Vempaty, A., & Varshney, P. K. (2014). Assuring privacy and reliability in crowdsourcing with coding. Paper presented at 2014 IEEE Information Theory and Applications Workshop, ITA 2014, San Diego, CA, United States. https://doi.org/10.1109/ITA.2014.6804213

Assuring privacy and reliability in crowdsourcing with coding. / Varshney, Lav R; Vempaty, Aditya; Varshney, Pramod K.

2014. Paper presented at 2014 IEEE Information Theory and Applications Workshop, ITA 2014, San Diego, CA, United States.

Research output: Contribution to conferencePaper

Varshney, LR, Vempaty, A & Varshney, PK 2014, 'Assuring privacy and reliability in crowdsourcing with coding' Paper presented at 2014 IEEE Information Theory and Applications Workshop, ITA 2014, San Diego, CA, United States, 2/9/14 - 2/14/14, . https://doi.org/10.1109/ITA.2014.6804213
Varshney LR, Vempaty A, Varshney PK. Assuring privacy and reliability in crowdsourcing with coding. 2014. Paper presented at 2014 IEEE Information Theory and Applications Workshop, ITA 2014, San Diego, CA, United States. https://doi.org/10.1109/ITA.2014.6804213
Varshney, Lav R ; Vempaty, Aditya ; Varshney, Pramod K. / Assuring privacy and reliability in crowdsourcing with coding. Paper presented at 2014 IEEE Information Theory and Applications Workshop, ITA 2014, San Diego, CA, United States.
@conference{ab4c54b7ffa94ff68aa60b52de59f873,
title = "Assuring privacy and reliability in crowdsourcing with coding",
abstract = "Crowd workers are often unreliable and anonymous. Hence there is a need to ensure reliable work delivery while preserving some level of privacy to the requester's data. For this purpose, we use a combination of random perturbation to mask the sensitive data and error-correcting codes for quality assurance. We also consider the possibility of collusion attacks by malicious crowd workers. We develop mathematical models to study the precise tradeoffs between task performance quality, level of privacy against collusion attacks, and cost of invoking a large crowd. Such a study provides design strategies and principles for crowd work. The use of classification codes may improve efficiency considerably. We also comment on the applicability of these techniques for scalable assessment in education via peer grading, e.g. for massive open online courses (MOOCs).",
author = "Varshney, {Lav R} and Aditya Vempaty and Varshney, {Pramod K.}",
year = "2014",
month = "1",
day = "1",
doi = "10.1109/ITA.2014.6804213",
language = "English (US)",
note = "2014 IEEE Information Theory and Applications Workshop, ITA 2014 ; Conference date: 09-02-2014 Through 14-02-2014",

}

TY - CONF

T1 - Assuring privacy and reliability in crowdsourcing with coding

AU - Varshney, Lav R

AU - Vempaty, Aditya

AU - Varshney, Pramod K.

PY - 2014/1/1

Y1 - 2014/1/1

N2 - Crowd workers are often unreliable and anonymous. Hence there is a need to ensure reliable work delivery while preserving some level of privacy to the requester's data. For this purpose, we use a combination of random perturbation to mask the sensitive data and error-correcting codes for quality assurance. We also consider the possibility of collusion attacks by malicious crowd workers. We develop mathematical models to study the precise tradeoffs between task performance quality, level of privacy against collusion attacks, and cost of invoking a large crowd. Such a study provides design strategies and principles for crowd work. The use of classification codes may improve efficiency considerably. We also comment on the applicability of these techniques for scalable assessment in education via peer grading, e.g. for massive open online courses (MOOCs).

AB - Crowd workers are often unreliable and anonymous. Hence there is a need to ensure reliable work delivery while preserving some level of privacy to the requester's data. For this purpose, we use a combination of random perturbation to mask the sensitive data and error-correcting codes for quality assurance. We also consider the possibility of collusion attacks by malicious crowd workers. We develop mathematical models to study the precise tradeoffs between task performance quality, level of privacy against collusion attacks, and cost of invoking a large crowd. Such a study provides design strategies and principles for crowd work. The use of classification codes may improve efficiency considerably. We also comment on the applicability of these techniques for scalable assessment in education via peer grading, e.g. for massive open online courses (MOOCs).

UR - http://www.scopus.com/inward/record.url?scp=84901207655&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84901207655&partnerID=8YFLogxK

U2 - 10.1109/ITA.2014.6804213

DO - 10.1109/ITA.2014.6804213

M3 - Paper

AN - SCOPUS:84901207655

ER -