MAIDR: Making Statistical Visualizations Accessible with Multimodal Data Representation

Joo Young Seo, Yilin Xia, Bongshin Lee, Sean McCurry, Yu Jun Yam

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

This paper investigates new data exploration experiences that enable blind users to interact with statistical data visualizations-bar plots, heat maps, box plots, and scatter plots-leveraging multimodal data representations. In addition to sonification and textual descriptions that are commonly employed by existing accessible visualizations, our MAIDR (multimodal access and interactive data representation) system incorporates two additional modalities (braille and review) that offer complementary benefits. It also provides blind users with the autonomy and control to interactively access and understand data visualizations. In a user study involving 11 blind participants, we found the MAIDR system facilitated the accurate interpretation of statistical visualizations. Participants exhibited a range of strategies in combining multiple modalities, influenced by their past interactions and experiences with data visualizations. This work accentuates the overlooked potential of combining refreshable tactile representation with other modalities and elevates the discussion on the importance of user autonomy when designing accessible data visualizations.

Original languageEnglish (US)
Title of host publicationCHI 2024 - Proceedings of the 2024 CHI Conference on Human Factors in Computing Sytems
PublisherAssociation for Computing Machinery
ISBN (Electronic)9798400703300
DOIs
StatePublished - May 11 2024
Event2024 CHI Conference on Human Factors in Computing Sytems, CHI 2024 - Hybrid, Honolulu, United States
Duration: May 11 2024May 16 2024

Publication series

NameConference on Human Factors in Computing Systems - Proceedings

Conference

Conference2024 CHI Conference on Human Factors in Computing Sytems, CHI 2024
Country/TerritoryUnited States
CityHybrid, Honolulu
Period5/11/245/16/24

Keywords

  • Accessibility
  • Blind
  • Braille Display
  • Multimodality
  • Screen Readers
  • Statistical Visualization

ASJC Scopus subject areas

  • Software
  • Human-Computer Interaction
  • Computer Graphics and Computer-Aided Design

Fingerprint

Dive into the research topics of 'MAIDR: Making Statistical Visualizations Accessible with Multimodal Data Representation'. Together they form a unique fingerprint.

Cite this