On Using k-means Clustering for Test Suite Reduction
Testing large software or other systems where test execution is time consuming or requires high computational resources is difficult and requires the selection of appropriate test cases. In the context of testing, appropriate means to have tests that most likely reveal faults or at least indicate when passing that the important functionality of the system works. In practice it is often the case that we have to reduce available test suites in order to finalize testing in a given time not exceeding other resources. In this paper, we introduce a machine learning based algorithm for test suite reduction that combines k-means clustering with binary search. The idea behind the algorithm is to cluster test cases that are close together and to select a representative test case from each of the clusters to be used in the new reduced test suite. We use binary search for looking for the proper number of clusters that allows to reduce the test suite under the condition of not substantially deviating from coverage or mutation score obtained from the initial tests suite. Besides discussing the algorithm, we present experimental results using small to larger Java programs with different types of inputs and outputs. For all example cases we were able to considerably reduce the number of test cases requiring a short reduction time especially compared to other test suite reduction approaches.
Sat 24 OctDisplayed time zone: Lisbon change
14:20 - 15:55 | |||
14:20 15mTalk | On Using k-means Clustering for Test Suite Reduction TAIC PART 2020 Link to publication DOI | ||
14:35 15mTalk | Prioritization of Test Cases with Varying Test Costs and Fault Severities for Certification Testing TAIC PART 2020 Link to publication DOI | ||
14:50 15mTalk | Test Tools: an illusion of usability? TAIC PART 2020 Link to publication DOI | ||
15:05 15mTalk | Towards a unified catalog of attributes to guide industry in software testing technique selection TAIC PART 2020 Italo Santos University of São Paulo, Silvana Morita Melo , Paulo Sergio Lopes de Souza University of São Paulo - USP, Simone do Rocio Senger de Souza University of São Paulo - USP Link to publication DOI | ||
15:20 15mTalk | Data Dynamics for Testing Systems Fast Abstract: Data Dynamics for Testing Systems TAIC PART 2020 Julian Harty Commercetest Ltd Link to publication DOI | ||
15:35 20mLive Q&A | Q&A TAIC PART 2020 |