LLM-assisted Industrial-Scale Differential Testing of Package Incompatibilities in Linux Distributions
This program is tentative and subject to change.
An open source Linux distribution often undergoes version upgrades and migrations, which is prone to incompatibility issues especially when it comes to large-scale software changes. Although differential testing has been widely used in software testing, it is still challenging to apply it for detecting such incompatibilities in the context of industrial settings. In this paper, we report our experience in leveraging LLMs to address the challenges faced by the Anolis OS community. Specifically, we develop an LLM-based differential testing method called Versify to assist maintainers of Linux distributions in locating incompatibilities during version upgrades and migrations. Its first month of use in Anolis OS community shows that it uncovered 8,489 instances of differing behavior, of which 644 were prioritized for attention by developers. After deduplication and filtering, 39 unique compatibility reports were identified. Feedback from Anolis OS developers indicates that our reports have provided valuable recommendations for package selection in future OS releases. As of this writing, Versify has been in use for over a year in the Anolis OS testing process, and it has reduced package incompatibility issues by 81.8% in the community.
This program is tentative and subject to change.
Wed 19 NovDisplayed time zone: Seoul change
16:00 - 17:00 | |||
16:00 10mTalk | Minuku: Detecting Diverse Display Issues in Mobile Apps with Small-scale Dataset Industry Showcase Yongxiang Hu Fudan University, Ke Liu College of Computer Science and Artificial Intelligence, Fudan University, Hailiang Jin Meituan Inc., Shiyu Guo Meituan, Juxing Yuan Meituan Inc., Xin Wang Fudan University, Yangfan Zhou Fudan University | ||
16:10 10mTalk | HarmoBridge: Bridging ArkTS and C/C++ for Cross-Language Static Analysis on HarmonyOS Industry Showcase Jiale Wu Huazhong University of Science and Technology, Jiapeng Deng Huazhong University of Science and Technology, Yanjie Zhao Huazhong University of Science and Technology, Li Li Beihang University, Haoyu Wang Huazhong University of Science and Technology | ||
16:20 10mTalk | From Redundancy to Efficiency: Exploiting Shared UI Interactions towards Efficient LLM-Based Testing Industry Showcase Xuan Wang Fudan University, Yingchuan Wang School of Computer Science, Fudan University, Yongxiang Hu Fudan University, Yu Zhang Meituan, Hailiang Jin Meituan Inc., Shiyu Guo Meituan, Juxing Yuan Meituan Inc., Yangfan Zhou Fudan University | ||
16:30 10mTalk | Securing Millions of Decentralized Identities in Alipay Super App with End-to-End Formal Verification Industry Showcase Ziyu Mao Zhejiang University, Xiaolin Ma Zhejiang University, Lin Huang Ant Group, Huan Yang Ant Group, Wu Zhang Ant Group, Weichao Sun Ant Group, Yongtao Wang Ant Group, Jingling Xue University of New South Wales, Jingyi Wang Zhejiang University | ||
16:40 10mTalk | LLM-based Dynamic Differential Testing for Database Connectors with Reinforcement Learning-Guided Prompt Selection NIER Track Ce Lyu East China Normal University, Yanhao Wang East China Normal University, Jie Liang Beihang University, Minghao Zhao East China Normal University | ||
16:50 10mTalk | LLM-assisted Industrial-Scale Differential Testing of Package Incompatibilities in Linux Distributions Industry Showcase Yuhao Yang Central South University, Chijin Zhou East China Normal University, Runzhe Wang Alibaba Group, Weibo Zhang Central South University, Yuheng Shen Tsinghua University, Xiaohai Shi Alibaba Group, Tao Ma Alibaba Group, Chang Gao Alibaba Group, Zhe Wang Institute of Computing Technology at Chinese Academy of Sciences; Zhongguancun Laboratory, Ying Fu Tsinghua University, Heyuan Shi Central South University | ||