GUI-Based Software Testing: An Automated Approach Using GPT-4 and Selenium WebDriver
This paper presents a novel method for GUI testing in web applications that largely automates the process by integrating the advanced language model GPT-4 with Selenium, a popular web application testing framework. Unlike traditional deep learning approaches, which require extensive training data, GPT-4 is pre-trained on a large corpus, giving it significant generalisation and inference capabilities. These capabilities allow testing without the need for recorded data from human testers, significantly reducing the time and effort required for the testing process. We also compare the efficiency of our integrated GPT-4 approach with monkey testing, a widely used technique for automated GUI testing where user input is randomly generated. To evaluate our approach, we implemented a web calculator with an integrated code coverage system. The results show that our integrated GPT-4 approach provides significantly better branch coverage compared to monkey testing. These results highlight the significant potential of integrating specific AI models such as GPT-4 and automated testing tools to improve the accuracy and efficiency of GUI testing in web applications.
Paper (Zimmermann_ATEST2023_LLMs_Paper.pdf) | 113KiB |
Slides (Zimmermann_ATEST2023_LLMs_Presentation.pdf) | 248KiB |
Fri 15 SepDisplayed time zone: Amsterdam, Berlin, Bern, Rome, Stockholm, Vienna change
15:30 - 16:50 | |||
15:30 20mTalk | Continuous Domain Input Abstraction and Fault Detection Capability in Combinatorial Testing [Workshop] A-TEST File Attached | ||
15:50 20mTalk | GUI-Based Software Testing: An Automated Approach Using GPT-4 and Selenium WebDriver [Workshop] A-TEST Daniel Zimmermann FZI Research Center for Information Technology, Anne Koziolek Karlsruhe Institute of Technology File Attached | ||
16:10 20mTalk | Chouette: An Automated Cross-Platform UI Crawler for Improving App Quality [Workshop] A-TEST Terrence Wong Duolingo Pre-print | ||
16:30 20mTalk | An Empirical Study on the Adoption of Scripted GUI Testing for Android Apps [Workshop] A-TEST Pre-print |