Computational Approaches for Understanding, Generating, and Adapting User Interfaces

Yue Jiang, Yuwen Lu, Jeffrey Nichols, Wolfgang Stuerzlinger, Chun Yu, Christof Lutteroth, Yang Li, Ranjitha Kumar, Toby Jia Jun Li

Research output: Chapter in Book/Report/Conference proceedingConference contribution


Computational approaches for user interfaces have been used in adapting interfaces for different modalities, usage scenarios and device form factors, understanding screen semantics for accessibility, task-automation, information extraction, and in assisting interface design. Recent advances in machine learning (ML) have drawn considerable attention across HCI and related fields such as computer vision and natural language processing, leading to new ML-based user interface approaches. Similarly, significant progress has been made with more traditional optimization- and planning-based approaches to accommodate the need for adapting UIs for screens with different sizes, orientations and aspect ratios, and in emerging domains such as VR/AR and 3D interfaces. The proposed workshop seeks to bring together researchers interested in all kinds of computational approaches for user interfaces across different sectors as a community, including those who develop algorithms and models and those who build applications, to discuss common issues including the need for resources, opportunities for new applications, design implications for human-AI interaction in this domain, and practical challenges such as user privacy.

Original languageEnglish (US)
Title of host publicationCHI 2022 - Extended Abstracts of the 2022 CHI Conference on Human Factors in Computing Systems
PublisherAssociation for Computing Machinery
ISBN (Electronic)9781450391566
StatePublished - Apr 27 2022
Event2022 CHI Conference on Human Factors in Computing Systems, CHI EA 2022 - Virtual, Online, United States
Duration: Apr 30 2022May 5 2022

Publication series

NameConference on Human Factors in Computing Systems - Proceedings


Conference2022 CHI Conference on Human Factors in Computing Systems, CHI EA 2022
Country/TerritoryUnited States
CityVirtual, Online


  • adative interfaces
  • design mining
  • interface generation
  • interface semantics
  • user interfaces

ASJC Scopus subject areas

  • Human-Computer Interaction
  • Computer Graphics and Computer-Aided Design
  • Software


Dive into the research topics of 'Computational Approaches for Understanding, Generating, and Adapting User Interfaces'. Together they form a unique fingerprint.

Cite this