As a software system evolves, its test suite can accumulate redundancies over time. Test minimization aims at removing redundant test cases. However, current techniques remove whole test cases from the test suite using test adequacy criteria, such as code coverage. This has two limitations, namely (1) by removing a whole test case the corresponding test assertions are also lost, which can inhibit test suite effectiveness, (2) the issue of partly redundant test cases, i.e., tests with redundant test statements, is ignored. We propose a novel approach for fine-grained test case minimization. Our analysis is based on the inference of a test suite model that enables automated test reorganization within test cases. It enables removing redundancies at the test statement level, while preserving the coverage and test assertions of the test suite. We evaluated our approach, implemented in a tool called Testler, on the test suites of 15 open source projects. Our analysis shows that over 4,639 (24%) of the tests in these test suites are partly redundant, with over 11,819 redundant test statements in total. Our results show that Testler removes 43% of the redundant test statements, reducing the number of partly redundant tests by 52%. As a result, test suite execution time is reduced by up to 37% (20% on average), while maintaining the original statement coverage, branch coverage, test assertions, and fault detection capability.
Wed 30 MayDisplayed time zone: Amsterdam, Berlin, Bern, Rome, Stockholm, Vienna change
14:00 - 15:30 | |||
14:00 20mTalk | Hybrid Regression Test Selection Technical Papers Lingming Zhang University of Texas at Dallas | ||
14:20 20mTalk | Fine-Grained Test Minimization Technical Papers Pre-print | ||
14:40 20mTalk | FAST Approaches to Scalable Similarity-based Test Case Prioritization Technical Papers Breno Miranda Federal University of Pernambuco, Emilio Cruciani Gran Sasso Science Institute, L'Aquila, Italy, Roberto Verdecchia Gran Sasso Science Institute, Vrije Universiteit Amsterdam, Antonia Bertolino CNR-ISTI DOI Pre-print File Attached | ||
15:00 20mTalk | Towards Refactoring-Aware Regression Test Selection Technical Papers Kaiyuan Wang , Chenguang Zhu University of Texas, Austin, Ahmet Celik University of Texas at Austin, USA, Jongwook Kim , Don Batory University of Texas, Austin, Milos Gligoric University of Texas at Austin File Attached | ||
15:20 10mTalk | Q&A in groups Technical Papers |