Publications
2024
Towards Automated Accessibility Report Generation for Mobile Apps
Amanda Swearngin,
Jason Wu,
Xiaoyi Zhang,
Esteban Gomez,
Jen Coughenour,
Rachel Stukenbourg,
Bhavya Garg,
Greg Hughes,
Adriana Hilliard,
Jeffrey P. Bigham,
Jeffrey Nichols
TOCHI 2024
Ferret-UI: Grounded Mobile UI Understanding with Multimodal LLMs
Keen You,
Haotian Zhang,
Eldon Schoop,
Floris Weers,
Amanda Swearngin,
Jeffrey Nichols,
Yinfei Yang,
Zhe Gan
ECCV 2024
UIClip: A Data-driven Model for Assessing User Interface Design
Jason Wu,
Yi-Hao Peng,
Xin Yue Li,
Amanda Swearngin,
Jeffrey P. Biham,
Jeffrey Nichols
UIST 2024
AXNav: Replaying Accessibility Tests from Natural Language
Maryam Taeb,
Amanda Swearngin,
Eldon Schoop,
Regina Cheng,
Jeffrey Nichols
CHI 2024
2023
ILuvUI: Instruction-tuned LangUage-Vision modeling of UIs from Machine Conversations
Yue Jiang,
Eldon Schoop,
Amanda Swearngin,
Jeffrey Nichols
CHI 2023
Never-ending learning of User Interfaces
Jason Wu,
Rebecca Krosnick,
Eldon Schoop,
Amanda Swearngin,
Jeffrey P. Bigham,
Jeffrey Nichols
UIST 2023
2022
Screen Correspondence: Mapping Interchangeable Elements between UIs
Jason Wu,
Amanda Swearngin,
Xiaoyi Zhang,
Jeffrey Nichols,
Jeffrey P. Bigam
Arxiv 2022
Jieshan Chen,
Amanda Swearngin,
Jason Wu,
Titus Barik,
Jeffrey Nichols,
Xiaoyi Zhang
Arxiv 2022
Towards Complete Icon Labeling in Mobile Applications
Jieshan Chen,
Amanda Swearngin,
Jason Wu,
Titus Barik,
Jeffrey Nichols,
Xiaoyi Zhang
CHI 2022
2021
Understanding Screen Relationships from Screenshots of Smartphone Applications
Shirin Feiz,
Jason Wu,
Xiaoyi Zhang,
Amanda Swearngin,
Titus Barik,
Jeffrey Nichols
IUI 2022
Scraps: Enabling Contextual Mobile Capture, Contextualization, and Use of Document Resources
Amanda Swearngin,
Shamsi Iqbal,
Victor Poznanski,
Marc Encarnacion,
Paul N. Bennett,
Jaime Teevan
CHI 2021
Honorable Mention
Screen Recognition: Creating Accessibility Metadata for Mobile Applications from Pixels
Xiaoyi Zhang,
Lilian de Greef,
Amanda Swearngin,
Samuel White,
Kyle Murray,
Lisa Yu,
Qi Shan,
Jeffrey Nichols,
Jason Wu,
Chris Fleizach,
Aaron Everitt,
Jeffrey P. Bigham
CHI 2021
Best Paper
2020
Expanding Interface Design Capabilities through Semantic and Data-Driven Analyses
Amanda Swearngin
UW Ph.D. Dissertation
Scout: Rapid Exploration of Interface Layout Alternatives through High-Level Design Constraints
Amanda Swearngin,
Chenglong Wang,
Alannah Oleson,
James Fogarty,
Amy J. Ko
2019
Modeling Mobile Interface Tappability Using Crowdsourcing and Deep Learning
Amanda Swearngin,
Yang Li
2018
Scout: Mixed-Initiative Exploration of Design Variations through High-Level Design Constraints
Amanda Swearngin,
Amy J. Ko,
James Fogarty
Rewire: Interface Design Assistance from Examples
Amanda Swearngin,
Wilmot Li,
Mira Dontcheva,
Joel Brandt,
Morgan Dixon,
Amy J. Ko
2017
Genie: Input Retargeting on the Web through Command Reverse Engineering
Amanda Swearngin,
Amy J. Ko,
James Fogarty
2013
Human Performance Regression Testing
Amanda Swearngin,
Myra B. Cohen,
Bonnie E. John,
Rachel K. E. Bellamy
2012
Easing the Generation of Predictive Human Performance Models from Legacy Systems
Amanda Swearngin,
Myra B. Cohen,
Bonnie E. John,
Rachel K. E. Bellamy
2011
Versioning for Mashups --- An Exploratory Study
Sandeep Kaur Kuttal,
Anita Sarma,
Amanda Swearngin,
Gregg Rothermel
A Reformulation Strategy for Multi-Dimensional CSPs: The Case Study of the SET Game
Amanda Swearngin,
Berthe Y. Choueiry,
Eugene C. Freuder
SARA 2011
in Catalonia, Spain