FAST Approaches to Scalable Similarity-based Test Case Prioritization
Many test case prioritization criteria have been proposed for speeding up fault detection. Among them, similarity-based approaches give priority to the test cases that are the most dissimilar from those already selected. However, the proposed criteria do not scale up to handle the many thousands or even some millions test suite sizes of modern industrial systems and simple heuristics are used instead. We introduce the FAST family of test case prioritization techniques that radically changes this landscape by borrowing algorithms commonly exploited in the big data domain to find similar items. FAST techniques provide scalable similarity-based test case prioritization in both white-box and black-box fashion. The results from experimentation on real world C and Java subjects show that the fastest members of the family outperform other black-box approaches in efficiency with no significant impact on effectiveness, and also outperform white-box approaches, including greedy ones, if preparation time is not counted. A simulation study of scalability shows that one FAST technique can prioritize a million test cases in less than 20 minutes.
FAST Approaches to Scalable Similarity-based Test Case Prioritization (FAST - Presentation.pdf) | 1.42MiB |
Wed 30 MayDisplayed time zone: Amsterdam, Berlin, Bern, Rome, Stockholm, Vienna change
14:00 - 15:30 | |||
14:00 20mTalk | Hybrid Regression Test Selection Technical Papers Lingming Zhang University of Texas at Dallas | ||
14:20 20mTalk | Fine-Grained Test Minimization Technical Papers Pre-print | ||
14:40 20mTalk | FAST Approaches to Scalable Similarity-based Test Case Prioritization Technical Papers Breno Miranda Federal University of Pernambuco, Emilio Cruciani Gran Sasso Science Institute, L'Aquila, Italy, Roberto Verdecchia Gran Sasso Science Institute, Vrije Universiteit Amsterdam, Antonia Bertolino CNR-ISTI DOI Pre-print File Attached | ||
15:00 20mTalk | Towards Refactoring-Aware Regression Test Selection Technical Papers Kaiyuan Wang , Chenguang Zhu University of Texas, Austin, Ahmet Celik University of Texas at Austin, USA, Jongwook Kim , Don Batory University of Texas, Austin, Milos Gligoric University of Texas at Austin File Attached | ||
15:20 10mTalk | Q&A in groups Technical Papers |