ImageAlly: A Human-AI Hybrid Approach to Support Blind People in Detecting and Redacting Private Image Content

Zhuohao Jerry Zhang, Smirity Kaushik, Joo Young Seo, Haolin Yuan, Sauvik Das, Leah Findlater, Danna Gurari, Abigale Stangl, Yang Wang

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Many people who are blind take and post photos to share about their lives and connect with others. Yet, current technology does not provide blind people with accessible ways to handle when private information is unintentionally captured in their images. To explore the technology design in supporting them with this task, we developed a design probe for blind people — ImageAlly — that employs a human-AI hybrid approach to detect and redact private image content. ImageAlly notifies users when potential private information is detected in their images, using computer vision, and enables them to transfer those images to trusted sighted allies to edit the private content. In an exploratory study with pairs of blind participants and their sighted allies, we found that blind people felt empowered by ImageAlly to prevent privacy leakage in sharing images on social media. They also found other benefits from using ImageAlly, such as potentially improving their relationship with allies and giving allies the awareness of the accessibility challenges they face.

Original languageEnglish (US)
Title of host publicationProceedings of the 19th Symposium on Usable Privacy and Security, SOUPS 2023
PublisherUSENIX Association
Pages417-436
Number of pages20
ISBN (Electronic)9781939133366
StatePublished - 2023
Event19th Symposium on Usable Privacy and Security, SOUPS 2023 - Anaheim, United States
Duration: Aug 7 2023Aug 8 2023

Publication series

NameProceedings of the 19th Symposium on Usable Privacy and Security, SOUPS 2023

Conference

Conference19th Symposium on Usable Privacy and Security, SOUPS 2023
Country/TerritoryUnited States
CityAnaheim
Period8/7/238/8/23

ASJC Scopus subject areas

  • Computer Networks and Communications
  • Safety, Risk, Reliability and Quality

Fingerprint

Dive into the research topics of 'ImageAlly: A Human-AI Hybrid Approach to Support Blind People in Detecting and Redacting Private Image Content'. Together they form a unique fingerprint.

Cite this