TY - JOUR
T1 - Contestability for Content Moderation
AU - Vaccaro, Kristen
AU - Xiao, Ziang
AU - Hamilton, Kevin
AU - Karahalios, Karrie
N1 - Funding Information:
We thank Sanmi Koyejo, Christian Sandvig, Hari Sundaram, and our anonymous reviewers for their thoughtful feedback on this work, and the NSF and Capital One for their funding support.
Publisher Copyright:
© 2021 Owner/Author.
PY - 2021/10/18
Y1 - 2021/10/18
N2 - Content moderation systems for social media have had numerous issues of bias, in terms of race, gender, and ability among many others. One proposal for addressing such issues in automated decision making is by designing for contestability, whereby users can shape and influence how decisions are made. In this study, we conduct a series of participatory design workshops with participants from communities that have experienced problems with social media content moderation in the past. Together with participants, we explore the idea of designing for contestability in content moderation and find that users' designs suggest three fruitful, practical avenues: adding representation, improving communication, and designing with compassion. We conclude with design recommendations drawn from participants' proposals, and reflect on the challenges that remain.
AB - Content moderation systems for social media have had numerous issues of bias, in terms of race, gender, and ability among many others. One proposal for addressing such issues in automated decision making is by designing for contestability, whereby users can shape and influence how decisions are made. In this study, we conduct a series of participatory design workshops with participants from communities that have experienced problems with social media content moderation in the past. Together with participants, we explore the idea of designing for contestability in content moderation and find that users' designs suggest three fruitful, practical avenues: adding representation, improving communication, and designing with compassion. We conclude with design recommendations drawn from participants' proposals, and reflect on the challenges that remain.
KW - algorithmic experience
KW - content moderation
KW - contestability
KW - participatory design
UR - http://www.scopus.com/inward/record.url?scp=85117883146&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85117883146&partnerID=8YFLogxK
U2 - 10.1145/3476059
DO - 10.1145/3476059
M3 - Article
AN - SCOPUS:85117883146
SN - 2573-0142
VL - 5
JO - Proceedings of the ACM on Human-Computer Interaction
JF - Proceedings of the ACM on Human-Computer Interaction
IS - CSCW2
M1 - 318
ER -