ERICA: Interaction mining mobile apps

Biplab Deka, Zifeng Huang, Ranjitha Kumar

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Design plays an important role in adoption of apps. App design, however, is a complex process with multiple design activities. To enable data-driven app design applications, we present interaction mining - capturing both static (UI layouts, visual details) and dynamic (user flows, motion details) components of an app's design. We present ERICA, a system that takes a scalable, human-computer approach to interaction mining existing Android apps without the need to modify them in any way. As users interact with apps through ERICA, it detects UI changes, seamlessly records multiple data-streams in the background, and unifies them into a user interaction trace (Figure 1). Using ERICA we collected interaction traces from over a thousand popular Android apps. Leveraging this trace data, we built machine learning classifiers to detect elements and layouts indicative of 23 common user flows. User flows are an important component of user experience (UX) design and consists of a sequence of UI states that represent semantically meaningful tasks such as searching or composing. With these classifiers, we identified and indexed more than 3000 flow examples, and released the largest online search engine of user flows in Android apps.

Original languageEnglish (US)
Title of host publicationUIST 2016 - Proceedings of the 29th Annual Symposium on User Interface Software and Technology
PublisherAssociation for Computing Machinery, Inc
Pages767-776
Number of pages10
ISBN (Electronic)9781450345316
DOIs
StatePublished - Oct 16 2016
Event29th Annual Symposium on User Interface Software and Technology, UIST 2016 - Tokyo, Japan
Duration: Oct 16 2016Oct 19 2016

Publication series

NameUIST 2016 - Proceedings of the 29th Annual Symposium on User Interface Software and Technology

Other

Other29th Annual Symposium on User Interface Software and Technology, UIST 2016
CountryJapan
CityTokyo
Period10/16/1610/19/16

Keywords

  • App design
  • Design mining
  • Interaction mining
  • User flows

ASJC Scopus subject areas

  • Human-Computer Interaction
  • Software

Fingerprint Dive into the research topics of 'ERICA: Interaction mining mobile apps'. Together they form a unique fingerprint.

Cite this