TY - GEN
T1 - Utility data annotation with Amazon Mechanical Turk
AU - Sorokin, Alexander
AU - Forsyth, David
N1 - Copyright:
Copyright 2011 Elsevier B.V., All rights reserved.
PY - 2008
Y1 - 2008
N2 - We show how to outsource data annotation to Amazon Mechanical Turk. Doing so has produced annotations in quite large numbers relatively cheaply. The quality is good, and can be checked and controlled. Annotations are produced quickly. We describe results for several different annotation problems. We describe some strategies for determining when the task is well specified and properly priced.
AB - We show how to outsource data annotation to Amazon Mechanical Turk. Doing so has produced annotations in quite large numbers relatively cheaply. The quality is good, and can be checked and controlled. Annotations are produced quickly. We describe results for several different annotation problems. We describe some strategies for determining when the task is well specified and properly priced.
UR - http://www.scopus.com/inward/record.url?scp=52049123532&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=52049123532&partnerID=8YFLogxK
U2 - 10.1109/CVPRW.2008.4562953
DO - 10.1109/CVPRW.2008.4562953
M3 - Conference contribution
AN - SCOPUS:52049123532
SN - 9781424423408
T3 - 2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, CVPR Workshops
BT - 2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, CVPR Workshops
T2 - 2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, CVPR Workshops
Y2 - 23 June 2008 through 28 June 2008
ER -