Test Amplification for REST APIs via Single and Multi-Agent LLM Systems
REST APIs (Representational State Transfer Application Programming Interfaces) play a vital role in modern cloud-native applications. As these APIs grow in complexity and scale, ensuring their correctness and robustness becomes increasingly important. Automated testing is essential for identifying hidden bugs, particularly those that appear in edge cases or under unexpected inputs. However, creating comprehensive and effective test suites for REST APIs is challenging and often demands significant effort. In this paper, we investigate the use of large language model (LLM) systems—both single-agent and multi-agent setups—for amplifying existing REST API test suites. These systems generate additional test cases that aim to push the boundaries of the API, uncovering behaviors that might otherwise go untested. We present a comparative evaluation of the two approaches across several dimensions, including test coverage, bug detection effectiveness, and practical considerations such as computational cost and energy usage. Our evaluation demonstrates increased API coverage, identification of numerous bugs in the API under test, and insights into the computational cost and energy consumption of both approaches.
Fri 19 SepDisplayed time zone: Athens change
| 11:00 - 12:30 | Reinforcement Learning and Generative TestingGeneral Track at Atrium C Chair(s): Li Huang Constructor Institute Schaffhausen | ||
| 11:0030m Talk | Reusable Test Suites for Reinforcement Learning General Track Jørn Eirik Betten Simula Research Laboratory; Oslo Metropolitan University, Quentin Mazouni Simula Research Laboratory, Dennis Gross Simula Research Laboratory, Pedro Lind Oslo Metropolitan University; School of Economics,Innovation and Technology, Kristiania University of AppliedSciences, Helge Spieker Simula Research Laboratory | ||
| 11:3030m Talk | Test Generation for Deep Reinforcement Learning Using LRP-Guided Mutation of Classified Configurations General Track Brice Tchuenkam Université du Québec en Outaouais, Omer Nguena Timo Université du Québec en Outaouais | ||
| 12:0030m Talk | Test Amplification for REST APIs via Single and Multi-Agent LLM Systems General Track Robbe Nooyens University of Antwerp, Tolgahan Bardakci University of Antwerp and Flanders Make, Mutlu Beyazıt University of Antwerp and Flanders Make vzw, Serge Demeyer University of Antwerp and Flanders Make vzw | ||
