TY - GEN
T1 - ZIPT
T2 - 30th Annual ACM Symposium on User Interface Software and Technology, UIST 2017
AU - Deka, Biplab
AU - Huang, Zifeng
AU - Franzen, Chad
AU - Nichols, Jeffrey
AU - Li, Yang
AU - Kumar, Ranjitha
N1 - Publisher Copyright:
© 2017 Copyright held by the owner/author(s).
PY - 2017/10/20
Y1 - 2017/10/20
N2 - To evaluate the performance of mobile app designs, designers Andresearchers employ techniques such as A/B, usability, and analytics-driven testing. While these are all useful strategies for evaluating known designs, comparing many divergent solutions to identify the most performant remains a costly and difficult problem. This paper introduces a design performance testing approach that leverages existing app implementations and crowd workers to enable comparative testing at scale. This approach is manifest in ZIPT, a zero-integration performance testing platform that allows designers to collect detailed design and interaction data over any android app -including apps they do not own and did not build. Designers can deploy scripted tests via ZIPT to collect aggregate user performance metrics (e.g., completion rate, time on task) and qualitative feedback over third-party apps. Through case studies, we demonstrate that designers can use ZIPT's aggregate data and visualizations to understand the relative performance of interaction patterns found in the wild, and identify usability issues in existing android apps.
AB - To evaluate the performance of mobile app designs, designers Andresearchers employ techniques such as A/B, usability, and analytics-driven testing. While these are all useful strategies for evaluating known designs, comparing many divergent solutions to identify the most performant remains a costly and difficult problem. This paper introduces a design performance testing approach that leverages existing app implementations and crowd workers to enable comparative testing at scale. This approach is manifest in ZIPT, a zero-integration performance testing platform that allows designers to collect detailed design and interaction data over any android app -including apps they do not own and did not build. Designers can deploy scripted tests via ZIPT to collect aggregate user performance metrics (e.g., completion rate, time on task) and qualitative feedback over third-party apps. Through case studies, we demonstrate that designers can use ZIPT's aggregate data and visualizations to understand the relative performance of interaction patterns found in the wild, and identify usability issues in existing android apps.
KW - App design
KW - Design support tools
KW - Zero-integration performance testing
UR - http://www.scopus.com/inward/record.url?scp=85041520399&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85041520399&partnerID=8YFLogxK
U2 - 10.1145/3126594:3126647
DO - 10.1145/3126594:3126647
M3 - Conference contribution
AN - SCOPUS:85041520399
T3 - UIST 2017 - Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology
SP - 727
EP - 736
BT - UIST 2017 - Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology
PB - Association for Computing Machinery
Y2 - 22 October 2017 through 25 October 2017
ER -