Getting the message? A study of explanation interfaces for microblog data analysis

James Schaffer, Prasanna Giridhar, Debra Jones, Tobias Höllerer, Tarek Abdelzaher, John O'donovan

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

In many of today's online applications that facilitate data exploration, results from information filters such as recommender systems are displayed alongside traditional search tools. However, the effect of prediction algorithms on users who are performing open-ended data exploration tasks through a search interface is not well understood. This paper describes a study of three interface variations of a tool for analyzing commuter traffic anomalies in the San Francisco Bay Area. The system supports novel interaction between a prediction algorithm and a human analyst, and is designed to explore the boundaries, limitations and synergies of both. The degree of explanation of underlying data and algorithmic process was varied experimentally across each interface. The experiment (N=197) was performed to assess the impact of algorithm transparency/explanation on data analysis tasks in terms of search success, general insight into the underlying data set and user experience. Results show that 1) presence of recommendations in the user interface produced a significant improvement in recall of anomalies, 2) participants were able to detect anomalies in the data that were missed by the algorithm, 3) participants who used the prediction algorithm performed significantly better when estimating quantities in the data, and 4) participants in the most explanatory condition were the least biased by the algorithm's predictions when estimating quantities.

Original languageEnglish (US)
Title of host publicationIUI 2015 - Proceedings of the 20th ACM International Conference on Intelligent User Interfaces
PublisherAssociation for Computing Machinery
Pages345-356
Number of pages12
ISBN (Electronic)9781450333061
DOIs
StatePublished - Mar 18 2015
Event20th ACM International Conference on Intelligent User Interfaces, IUI 2015 - Atlanta, United States
Duration: Mar 29 2015Apr 1 2015

Publication series

NameInternational Conference on Intelligent User Interfaces, Proceedings IUI
Volume2015-January

Other

Other20th ACM International Conference on Intelligent User Interfaces, IUI 2015
CountryUnited States
CityAtlanta
Period3/29/154/1/15

    Fingerprint

Keywords

  • Anomaly detection
  • Data mining
  • Intelligent user interfaces

ASJC Scopus subject areas

  • Software
  • Human-Computer Interaction

Cite this

Schaffer, J., Giridhar, P., Jones, D., Höllerer, T., Abdelzaher, T., & O'donovan, J. (2015). Getting the message? A study of explanation interfaces for microblog data analysis. In IUI 2015 - Proceedings of the 20th ACM International Conference on Intelligent User Interfaces (pp. 345-356). (International Conference on Intelligent User Interfaces, Proceedings IUI; Vol. 2015-January). Association for Computing Machinery. https://doi.org/10.1145/2678025.2701406