Neural Network-based Test Case Prioritization in Continuous Integration
In continuous integration environments, the execution of test cases is performed for every newly added feature or when a bug fix occurs. Therefore, regression testing is performed considering various testing strategies. The Test Case Prioritization (TCP) approach considers reordering test cases so that faults are found earlier with a minimum execution cost. The purpose of the paper is to investigate the impact of neural network-based classification models to assist in the prioritization of test cases. Three different models are employed with various features (duration, fault rate, cycles count, total runs count) and considering information at every 30 cycles or at every 100 cycles. The results obtained emphasize that the NEUTRON approach finds a better prioritization with respect to NAPFD (normalized average percent of the detected fault) than random permutation and is comparable with the solutions that used either duration or faults, considering that it combines both values. Compared to other existing approaches, NEUTRON obtains similar competitive results when considering a budget of 50% and the best results when considering budgets of 75% and 100%.
Slides - Neural Network-based Test Case Prioritization in Continuous Integration (2023_ASE_ASYDE_TCP_CI_AVescanRGaceanuASzederjesiDragomir.pdf) | 1.39MiB |
Mon 11 SepDisplayed time zone: Amsterdam, Berlin, Bern, Rome, Stockholm, Vienna change
13:40 - 15:00 | Session 2: Prioritization and Optimization[Workshop] ASYDE at Room FR Chair(s): Gian Luca Scoccia University of L'Aquila | ||
13:40 20mTalk | ICO: A Platform for Optimizing Highly Configurable Systems [Workshop] ASYDE Edouard Guegain Université de Lille, Amir Taherkordi University of Oslo, Clément Quinton Université de Lille | ||
14:00 30mTalk | Test Case Prioritization based on Neural Network Classification with Artifacts Traceability [Workshop] ASYDE Ioana-Claudia Rotaru Babes-Bolyai University, Cluj-Napoca, Romania, Andreea Vescan Babes-Bolyai University Pre-print File Attached | ||
14:30 30mTalk | Neural Network-based Test Case Prioritization in Continuous Integration [Workshop] ASYDE Andreea Vescan Babes-Bolyai University, Radu Găceanu Babes-Bolyai University, Cluj-Napoca, Romania, Arnold Szederjesi Babes-Bolyai University, Cluj-Napoca, Romania Pre-print File Attached |