ZIPT: Zero-integration performance testing of mobile app designs

Biplab Deka, Zifeng Huang, Chad Franzen, Jeffrey Nichols, Yang Li, Ranjitha Kumar

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

To evaluate the performance of mobile app designs, designers Andresearchers employ techniques such as A/B, usability, and analytics-driven testing. While these are all useful strategies for evaluating known designs, comparing many divergent solutions to identify the most performant remains a costly and difficult problem. This paper introduces a design performance testing approach that leverages existing app implementations and crowd workers to enable comparative testing at scale. This approach is manifest in ZIPT, a zero-integration performance testing platform that allows designers to collect detailed design and interaction data over any android app -including apps they do not own and did not build. Designers can deploy scripted tests via ZIPT to collect aggregate user performance metrics (e.g., completion rate, time on task) and qualitative feedback over third-party apps. Through case studies, we demonstrate that designers can use ZIPT's aggregate data and visualizations to understand the relative performance of interaction patterns found in the wild, and identify usability issues in existing android apps.

Original languageEnglish (US)
Title of host publicationUIST 2017 - Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology
PublisherAssociation for Computing Machinery, Inc
Pages727-736
Number of pages10
ISBN (Electronic)9781450349819
DOIs
StatePublished - Oct 20 2017
Event30th Annual ACM Symposium on User Interface Software and Technology, UIST 2017 - Quebec City, Canada
Duration: Oct 22 2017Oct 25 2017

Publication series

NameUIST 2017 - Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology

Other

Other30th Annual ACM Symposium on User Interface Software and Technology, UIST 2017
CountryCanada
CityQuebec City
Period10/22/1710/25/17

Keywords

  • App design
  • Design support tools
  • Zero-integration performance testing

ASJC Scopus subject areas

  • Computer Graphics and Computer-Aided Design
  • Human-Computer Interaction
  • Software

Fingerprint Dive into the research topics of 'ZIPT: Zero-integration performance testing of mobile app designs'. Together they form a unique fingerprint.

  • Cite this

    Deka, B., Huang, Z., Franzen, C., Nichols, J., Li, Y., & Kumar, R. (2017). ZIPT: Zero-integration performance testing of mobile app designs. In UIST 2017 - Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology (pp. 727-736). (UIST 2017 - Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology). Association for Computing Machinery, Inc. https://doi.org/10.1145/3126594:3126647