AI-based Automotive Test Case Generation: An Action Research Study on Integration of Generative AI into Test Automation Frameworks
Generative AI is transforming software development, particularly in unit and regression testing. However, it’s rarely used in Hardware-in-the-Loop (HIL) testing due to hardware-specific environments. This paper examines integrating GitHub Copilot into automotive test automation frameworks, focusing on Volvo’s Test Automation Framework (TAF). It explores how Copilot can automate test case generation and compares AI-generated test cases with manually written ones in terms of reliability and robustness. Using an iterative action research methodology, the study evaluates the functional suitability of AI-generated test cases and the challenges of integration. Results show that in the first iteration, 23% of AI-generated test cases passed in Jenkins and received high functionality scores. In the second iteration, this increased to 36%. These findings highlight the potential of Generative AI to enhance HIL testing.
Tue 3 DecDisplayed time zone: Athens change
16:00 - 17:30 | PROFES Session 5: AI for Software Engineering in Practice (I)Industry Papers / Short Papers and Posters / Research Papers at UT Library - Room 2 (Seminar Room Tõstamaa) Chair(s): Rudolf Ramler Software Competence Center Hagenberg (SCCH) | ||
16:00 18mIndustry talk | A Multi-model Approach for Video Data Retrieval in Autonomous Vehicle Development Industry Papers Jesper Knapp Chalmers | University of Gothenburg, Klas Moberg Chalmers | University of Gothenburg, Yuchuan Jin Zenseact, Simin Sun Chalmers | University of Gothenburg, Miroslaw Staron University of Gothenburg | ||
16:18 12mShort-paper | Enhancing Transparency in Space Metrics Use: Insights from an Initial Study Short Papers and Posters Kseniia Vasylieva Reutlingen University, Thomas Brenner OHB System AG, Marco Kuhrmann Reutlingen University, Jürgen Münch Reutlingen University | ||
16:30 18mResearch paper | Supporting the Development of Oracle APEX Low-Code Applications With Large Language Models Research Papers | ||
16:48 18mIndustry talk | AI-based Automotive Test Case Generation: An Action Research Study on Integration of Generative AI into Test Automation Frameworks Industry Papers Albin Karlsson Chalmers | University of Gothenburg, Erik Lindmaa Chalmers | University of Gothenburg, Simin Sun Chalmers | University of Gothenburg, Miroslaw Staron University of Gothenburg | ||
17:06 24mTalk | Session 5 Discussion Research Papers |