Rico: A mobile app dataset for building data-driven design applications

Biplab Deka, Zifeng Huang, Chad Franzen, Joshua Hibschman, Daniel Afergan, Yang Li, Jeffrey Nichols, Ranjitha Kumar

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Data-driven models help mobile app designers understand best practices and trends, and can be used to make predictions about design performance and support the creation of adaptive UIs. This paper presents Rico, the largest repository of mobile app designs to date, created to support five classes of data-driven applications: design search, UI layout generation, UI code generation, user interaction modeling, and user perception prediction. To create Rico, we built a system that combines crowdsourcing and automation to scalably mine design and interaction data from android apps at runtime. The Rico dataset contains design data from more than 9:7k android apps spanning 27 categories. It exposes visual, textual, structural, and interactive design properties of more than 72k unique UI screens. To demonstrate the kinds of applications that Rico enables, we present results from training an autoencoder for UI layout similarity, which supports queryby-example search over UIs.

Original languageEnglish (US)
Title of host publicationUIST 2017 - Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology
PublisherAssociation for Computing Machinery
Pages845-854
Number of pages10
ISBN (Electronic)9781450349819
DOIs
StatePublished - Oct 20 2017
Event30th Annual ACM Symposium on User Interface Software and Technology, UIST 2017 - Quebec City, Canada
Duration: Oct 22 2017Oct 25 2017

Publication series

NameUIST 2017 - Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology

Other

Other30th Annual ACM Symposium on User Interface Software and Technology, UIST 2017
Country/TerritoryCanada
CityQuebec City
Period10/22/1710/25/17

Keywords

  • App datasets
  • Design mining
  • Design search
  • Mobile app design

ASJC Scopus subject areas

  • Computer Graphics and Computer-Aided Design
  • Human-Computer Interaction
  • Software

Fingerprint

Dive into the research topics of 'Rico: A mobile app dataset for building data-driven design applications'. Together they form a unique fingerprint.

Cite this