Understandable Test Generation Through Capture/Replay and LLMs
Automatic unit test generators, particularly search-based software testing (SBST) tools such as EvoSuite, efficiently generate unit test suites with acceptable coverage. Although this removes the burden of writing unit tests from developers, these generated tests often pose challenges in terms of comprehension for developers. In my doctoral research, I aim to investigate strategies to address the issue of comprehensibility in generated test cases and improve the test suite in terms of effectiveness. To achieve this, I introduce four projects leveraging Capture/Replay and Large Language Model (LLM) techniques.
Capture/Replay carves information from End-to-End (E2E) tests, enabling the generation of unit tests containing meaningful test scenarios and actual test data. Moreover, the growing capabilities of large language models (LLMs) in language analysis and transformation play a significant role in improving readability in general. Our proposed approach involves leveraging E2E test scenario extraction alongside an LLM-guided approach to enhance test case understandability, augment coverage, and establish comprehensive mock and test oracles.
In this research, we endeavor to conduct both a quantitative analysis and a user evaluation of the quality of the generated tests in terms of executability, coverage, and understandability.
Tue 16 AprDisplayed time zone: Lisbon change
16:00 - 17:30 | Paper Presentations IIDoctoral Symposium at Fernando Pessoa Chair(s): Marsha Chechik University of Toronto, Sonia Haiduc Florida State University | ||
16:00 25mTalk | Towards AI-centric Requirements Engineering for Industrial Systems Doctoral Symposium Sarmad Bashir RISE Research Institutes of Sweden Pre-print | ||
16:25 25mTalk | Understandable Test Generation Through Capture/Replay and LLMs Doctoral Symposium Amirhossein Deljouyi Delft University of Technology | ||
16:50 25mTalk | Towards Automatic Inference of Behavioral Component Models for ROS-Based Robotics Systems Doctoral Symposium Tobias Dürschmid Carnegie Mellon University, USA | ||
17:15 15mDay closing | Reflections and Closing Doctoral Symposium |