Test Case Prioritization based on Neural Network Classification with Artifacts Traceability
Regression testing is an important factor in ensuring software system reliability once new changes are introduced, but maintaining complex testing suites in continuous integration environments is challenging. Test case prioritization techniques are a potential solution to this problem by computing a reordered testing suite that can provide better fault detection capabilities. However, current methods rely on manually providing artifact dependencies (requirements to code, code to test cases, test cases to faults) as input. The purpose of this paper is to minimize the gap between automatic dependency computation and test case prioritization by analyzing how Behavior-Driven Development (BDD) practices affect the two tasks. Thus, the first contribution of this paper is related to the design and implementation of an automatic traceability component to retrieve dependencies based on BDD artifacts (requirements, source code, test cases, and faults). The second contribution refers to the integration of the discovered traces as features in a neural network classification model for test cases for further prioritization. Various architectures were used for the neural network classification model. Two real-world BDD projects were used for the validation of the models, comparing the best performing models with a baseline test case prioritization technique to assess their fault-detection capabilities. Our approach achieved promising fault detection rates that demonstrate the efficiency of automatic traceability and may lead to future applicability to large-scale projects.
Slides - Test Case Prioritization based on Neural Network Classification with Artifacts Traceability (2023_ASE_ASYDE_TCP_traceability_ICRotaru_AVescan.pdf) | 1.69MiB |
Mon 11 SepDisplayed time zone: Amsterdam, Berlin, Bern, Rome, Stockholm, Vienna change
13:40 - 15:00 | Session 2: Prioritization and Optimization[Workshop] ASYDE at Room FR Chair(s): Gian Luca Scoccia University of L'Aquila | ||
13:40 20mTalk | ICO: A Platform for Optimizing Highly Configurable Systems [Workshop] ASYDE Edouard Guegain Université de Lille, Amir Taherkordi University of Oslo, Clément Quinton Université de Lille | ||
14:00 30mTalk | Test Case Prioritization based on Neural Network Classification with Artifacts Traceability [Workshop] ASYDE Ioana-Claudia Rotaru Babes-Bolyai University, Cluj-Napoca, Romania, Andreea Vescan Babes-Bolyai University Pre-print File Attached | ||
14:30 30mTalk | Neural Network-based Test Case Prioritization in Continuous Integration [Workshop] ASYDE Andreea Vescan Babes-Bolyai University, Radu Găceanu Babes-Bolyai University, Cluj-Napoca, Romania, Arnold Szederjesi Babes-Bolyai University, Cluj-Napoca, Romania Pre-print File Attached |