Minuku: Detecting Diverse Display Issues in Mobile Apps with Small-scale Dataset
This program is tentative and subject to change.
User interface (UI) display issues, such as widgets occlusion, missing elements, and screen overflow, are emerging as a non-negligible source of user complaints in commercial mobile apps. However, existing automated testing tools typically rely on a vast amount of high-quality training data, making them cost-ineffective for industrial practice. Given that display issues are intuitively recognizable by humans, their diverse appearances can be abstracted by the violation of human commonsense expectations of UI appearance. Therefore, this paper proposes to reduce data requirements in display issue detection through commonsense simulation. Although leveraging large vision-language models (VLMs) to replicate human visual ability looks straightforward, off-the-shelf VLMs lack task-specific knowledge of UI designs and display correctness. To address this, we fine-tune a VLM to learn what constitutes an expected display and to reason potential display issues. This approach is termed as Minuku, an industrial data-efficient UI display issue detector. We evaluate the design effectiveness of Minuku via a set of ablation experiments. Moreover, real-world deployments in one of the largest E-commerce app providers further demonstrate that Minuku can effectively detect 40 previously unknown UI display issues and significantly reduce manual effort in industrial settings.
This program is tentative and subject to change.
Wed 19 NovDisplayed time zone: Seoul change
16:00 - 17:00 | |||
16:00 10mTalk | Minuku: Detecting Diverse Display Issues in Mobile Apps with Small-scale Dataset Industry Showcase Yongxiang Hu Fudan University, Ke Liu College of Computer Science and Artificial Intelligence, Fudan University, Hailiang Jin Meituan Inc., Shiyu Guo Meituan, Juxing Yuan Meituan Inc., Xin Wang Fudan University, Yangfan Zhou Fudan University | ||
16:10 10mTalk | HarmoBridge: Bridging ArkTS and C/C++ for Cross-Language Static Analysis on HarmonyOS Industry Showcase Jiale Wu Huazhong University of Science and Technology, Jiapeng Deng Huazhong University of Science and Technology, Yanjie Zhao Huazhong University of Science and Technology, Li Li Beihang University, Haoyu Wang Huazhong University of Science and Technology | ||
16:20 10mTalk | From Redundancy to Efficiency: Exploiting Shared UI Interactions towards Efficient LLM-Based Testing Industry Showcase Xuan Wang Fudan University, Yingchuan Wang School of Computer Science, Fudan University, Yongxiang Hu Fudan University, Yu Zhang Meituan, Hailiang Jin Meituan Inc., Shiyu Guo Meituan, Juxing Yuan Meituan Inc., Yangfan Zhou Fudan University | ||
16:30 10mTalk | Securing Millions of Decentralized Identities in Alipay Super App with End-to-End Formal Verification Industry Showcase Ziyu Mao Zhejiang University, Xiaolin Ma Zhejiang University, Lin Huang Ant Group, Huan Yang Ant Group, Wu Zhang Ant Group, Weichao Sun Ant Group, Yongtao Wang Ant Group, Jingling Xue University of New South Wales, Jingyi Wang Zhejiang University | ||
16:40 10mTalk | LLM-based Dynamic Differential Testing for Database Connectors with Reinforcement Learning-Guided Prompt Selection NIER Track Ce Lyu East China Normal University, Yanhao Wang East China Normal University, Jie Liang Beihang University, Minghao Zhao East China Normal University | ||
16:50 10mTalk | LLM-assisted Industrial-Scale Differential Testing of Package Incompatibilities in Linux Distributions Industry Showcase Yuhao Yang Central South University, Chijin Zhou East China Normal University, Runzhe Wang Alibaba Group, Weibo Zhang Central South University, Yuheng Shen Tsinghua University, Xiaohai Shi Alibaba Group, Tao Ma Alibaba Group, Chang Gao Alibaba Group, Zhe Wang Institute of Computing Technology at Chinese Academy of Sciences; Zhongguancun Laboratory, Ying Fu Tsinghua University, Heyuan Shi Central South University | ||