LikeThis! Empowering App Users to Submit UI Improvement Suggestions Instead of Complaints
User feedback is crucial for the evolution of mobile apps. However, research suggests that users tend to submit uninformative, vague, or destructive feedback. Unlike recent AI4SE approaches that focus on generating code and other development artifacts, our work aims at empowering users to submit better and more constructive UI feedback with concrete suggestions on how to improve the app. We propose LikeThis!, a GenAI-based approach that takes a user comment with the corresponding screenshot to immediately generate multiple improvement alternatives, from which the user can easily choose their preferred option. To evaluate LikeThis!, we first conducted a model benchmarking study based on a public dataset of carefully critiqued UI designs. The results show that GPT-Image-1 significantly outperformed three other state-of-the-art image generation models in improving the designs to address UI issues while keeping the fidelity and without introducing new issues. An intermediate step in LikeThis! to generate a solution specification before changing the design was key to achieving effective improvement. Second, we conducted a user study with 10 production apps, where 15 users used LikeThis! to submit their feedback on encountered issues. Later, the developers of the apps assessed the understandability and actionability of the feedback with and without generated improvements. The results show that our approach helps generate better feedback from both user and developer perspectives, paving the way for AI-assisted user-developer collaboration.
Thu 16 AprDisplayed time zone: Brasilia, Distrito Federal, Brazil change
11:00 - 12:30 | Requirements and Modeling 2New Ideas and Emerging Results (NIER) / Research Track / Journal-first Papers / SE in Society (SEIS) at Oceania IV Chair(s): Emitzá Guzmán Vrije Universiteit Amsterdam | ||
11:00 15mTalk | Modeling Like Peeling an Onion: Layerwise Analysis-Driven Automatic Behavioral Model Generation Research Track Yike Huang East China Normal University, Ming Hu East China Normal University, China, Xiaohong Chen East China Normal University, Zhi Jin Peking University, Wuhan University, Shuyuan Xiao East China Normal University | ||
11:15 15mTalk | Context-Adaptive Requirements Defect Prediction through Human-LLM Collaboration New Ideas and Emerging Results (NIER) Max Unterbusch University of Duisburg-Essen, Andreas Vogelsang paluno – The Ruhr Institute for Software Technology, University of Duisburg-Essen | ||
11:30 15mTalk | RECOVER: Toward Requirements Generation from Stakeholders' Conversations Journal-first Papers Gianmario Voria University of Salerno, Francesco Casillo Università di Salerno, Carmine Gravino University of Salerno, Gemma Catolino University of Salerno, Fabio Palomba University of Salerno | ||
11:45 15mTalk | Unlocking the Silent Needs: Business-Logic-Driven Iterative Requirements Auto-completion Research Track Zhujun Wu East China Normal University Shanghai, China, Xiaohong Chen East China Normal University, Zhi Jin Peking University, Wuhan University, Ming Hu East China Normal University, China, Dongming Jin Peking University, China | ||
12:00 15mTalk | LikeThis! Empowering App Users to Submit UI Improvement Suggestions Instead of Complaints Research Track Jialiang Wei Hasso Plattner Institute, Ali Ebrahimi Pourasad University of Hamburg, Walid Maalej University of Hamburg | ||
12:15 15mTalk | Agentic Generation of Structured Clinical Specifications for Digital Healthcare Services SE in Society (SEIS) Bruno Guindani Politecnico di Milano, Matteo Camilli Politecnico di Milano, Livia Lestingi DEIB, Politecnico di Milano, Marcello M. Bersani Politecnico di Milano | ||