Test Case Prioritization using Transfer Learning in Continuous Integration Environments
The continuous Integration (CI) process runs a large set of automated test cases to verify software builds. The testing phase in the CI systems has timing constraints to ensure software quality without significantly delaying the CI builds. Therefore, CI requires efficient testing techniques such as Test Case Prioritization (TCP) to run faulty test cases with priority. Recent research studies on TCP utilize different Machine Learning (ML) methods to adopt the dynamic and complex nature of CI. However, the performance of ML for TCP may decrease for a low volume of data and less failure rate, whereas using existing data with similar patterns from other domains can be valuable. We formulate this as a transfer learning (TL) problem. TL has proven to be beneficial for many real-world applications where source domains have plenty of data, but the target domains have a scarcity of it. Therefore, this research investigates leveraging the benefit of transfer learning for test case prioritization (TCP). However, only some industrial CI datasets are publicly available due to data privacy protection regulations. In such cases, model-based transfer learning is a potential solution to share knowledge among different projects without revealing data to other stakeholders. This paper applies TransBoost, a tree-kernel-based TL algorithm, to evaluate the TL approach for 24 study subjects and identify potential source datasets.
Tue 16 MayDisplayed time zone: Hobart change
13:45 - 15:15 | |||
13:45 22mTalk | Orchestration Strategies for Regression Test Suites AST 2023 Renan Greca Gran Sasso Science Institute, ISTI-CNR, Breno Miranda Federal University of Pernambuco, Antonia Bertolino National Research Council, Italy Pre-print | ||
14:07 22mTalk | Evaluating the Trade-offs of Text-based Diversity in Test Prioritization AST 2023 Ranim Khojah Chalmers | University of Gothenburg, Chi Hong Chao Chalmers | University of Gothenburg, Francisco Gomes de Oliveira Neto Chalmers University of Technology, Sweden / University of Gothenburg, Sweden | ||
14:30 22mTalk | MuTCR: Test Case Recommendation via Multi-Level Signature Matching AST 2023 Weisong Sun Nanjing University, Weidong Qian China Ship Scientific Research Center, Bin Luo Nanjing University, Zhenyu Chen Nanjing University | ||
14:52 22mTalk | Test Case Prioritization using Transfer Learning in Continuous Integration Environments AST 2023 Rezwana Mamata Ontario Tech University, Akramul Azim Ontario Tech University, Ramiro Liscano Ontario Tech University, Kevin Smith International Business Machines Corporation (IBM), Yee-Kang Chang International Business Machines Corporation (IBM), Gkerta Seferi International Business Machines Corporation (IBM), Qasim Tauseef International Business Machines Corporation (IBM) |