BugHunter: An Automated Tool for Bug-Aware GUI Testing via Retrieval Augmentation
Software with similar functions often encounters similar bugs. However, current automated GUI testing methods mainly generate test scripts by analyzing the internal structure of software to cover more pages, without exploring targeted paths that may trigger bugs, resulting in low bug detection efficiency. Considering that bug reports on open source platforms can provide external knowledge for testing, we propose a bug-aware automated GUI testing method and develop an automated tool, BugHunter, which uses a large language model and retrieval augmentation techniques to dynamically adjust the testing process and generate exploration paths based on bug reports from similar applications, improving bug detection efficiency. First, build a high-quality bug knowledge base from historical bug reports. Then use information retrieval to retrieve relevant reports from this bug knowledge base, and generate test paths based on bug reports of similar applications. BugHunter also introduces local and global path planning mechanisms to handle differences in software functionality and UI design, as well as ambiguous behavior or missing steps in online bug reports. We evaluate BugHunter on 121 bugs across 71 apps and compare its performance against 16 state-of-the-art baselines. BugHunter achieves 60% improvement in bug detection over the best baseline. Furthermore, BugHunter successfully detects 49 new crash bugs in real-world apps from Google Play, with 40 bugs fixed, 9 confirmed.
GitHub link: https://github.com/test7766987/BugHunter
Demo video: https://www.youtube.com/watch?v=jgqNwg1AkhA
Fri 17 AprDisplayed time zone: Brasilia, Distrito Federal, Brazil change
16:00 - 17:30 | Testing and Analysis 20Demonstrations at Oceania II Chair(s): Gunel Jahangirova King's College London | ||
16:00 15mTalk | JUnitGenie: A Framework for Path-Sensitive Unit Test Generation with Large Language Models Demonstrations Dianshu Liao the Australian National University, Xin Yin Zhejiang University, Shidong Pan Columbia University & New York University, Chao Ni Zhejiang University, Zhenchang Xing CSIRO’s Data61; Australian National University, xiaoyu sun The Australian National University Media Attached | ||
16:15 15mTalk | BugHunter: An Automated Tool for Bug-Aware GUI Testing via Retrieval Augmentation Demonstrations Zhe Liu Institute of Software, Chinese Academy of Sciences, Mengzhuo Chen Institute of Software, Chinese Academy of Sciences, Chunyang Chen TU Munich, Junjie Wang Institute of Software at Chinese Academy of Sciences, Xu Xiang Beike Technology Co., Ltd., Yujiao Yuan Beike Technology Co., Ltd., Qing Wang Institute of Software at Chinese Academy of Sciences | ||
16:30 15mTalk | Automated Testing of Conversational Agents with Chatbot Dōjō Demonstrations Iván Sotillo del Horno Universidad Autónoma de Madrid, Alejandro del Pozzo Universidad Autónoma de Madrid, Esther Guerra Universidad Autónoma de Madrid, Juan de Lara Autonomous University of Madrid Media Attached | ||
16:45 15mTalk | GDSynth: A Graph Database Testing Framework via Effective Graph Synthesis Demonstrations Fozail Ahmad McGill University, Kristóf Marussy Budapest University of Technology and Economics, Oszkár Semeráth Budapest University of Technology and Economics, Daniel Varro Linköping University / McGill University, Lili Wei McGill University DOI Media Attached | ||
17:00 15mTalk | WiseUT: An Intelligent Framework for Unit Test Generation Demonstrations Chen Yang Tianjin University, Ziqi Wang Tianjin University, Lin Yang Tianjin University, Dong Wang Tianjin University, Shutao Gao Tianjin University, Yanjie Jiang Tianjin University, Junjie Chen Tianjin University | ||
17:15 15mTalk | RESTifAI: LLM-Based Workflow for Reusable REST API Testing Demonstrations Leon Kogler CASABLANCA hotelsoftware, Maximilian Ehrhart CASABLANCA hotelsoftware, Benedikt Dornauer University of Innsbruck; University of Cologne, Eduard Paul Enoiu Mälardalen University | ||