Write a Blog >>
Mon 10 Jul 2017 10:30 - 10:55 at Bren 1414 - Improving Testing Chair(s): Cristian Cadar

Test reduction has long been seen as critical for automated testing. However, traditional test reduction simply reduces the length of a test, but does not attempt to reduce semantic complexity. This paper extends previous efforts with algorithms for normalizing and generalizing tests. Rewriting tests into a normal form can reduce semantic complexity and even remove steps from an already delta-debugged test. Moreover, normalization dramatically reduces the number of tests that a reader must examine, partially addressing the ``fuzzer taming'' problem of discovering distinct faults in a set of failing tests. Generalization, in contrast, takes a test and reports what aspects of the test could have been changed while preserving the property that the test fails. Normalization plus generalization aids understanding of tests, including tests for complex and widely used APIs such as the NumPy numeric computation library and the ArcPy GIS scripting package. Normalization frequently reduces the number of tests to be examined by well over an order of magnitude, and often to just one test per fault. Together, ideally, normalization and generalization allow a user to replace reading a large set of tests that vary in unimportant ways with reading one annotated summary test.

Conference Day
Mon 10 Jul

Displayed time zone: Tijuana, Baja California change

10:30 - 12:10
Improving TestingTechnical Papers at Bren 1414
Chair(s): Cristian CadarImperial College London
10:30
25m
Talk
One Test to Rule Them All
Technical Papers
Alex GroceNorthern Arizona University, Josie HolmesPennsylvania State University, USA, Kevin Kellar
DOI
10:55
25m
Talk
Reinforcement Learning for Automatic Test Case Prioritization and Selection in Continuous Integration
Technical Papers
Helge SpiekerSimula Research Laboratory, Norway, Arnaud GotliebSimula Research Laboratory, Norway, Dusica MarijanSimula, Morten MossigeUniversity of Stavanger, Norway / ABB Robotics, Norway
DOI
11:20
25m
Talk
PerfRanker: Prioritization of Performance Regression Tests for Collection-Intensive Software
Technical Papers
Shaikh MostafaUniversity of Texas at San Antonio, USA, Xiaoyin WangUniversity of Texas at San Antonio, USA, Tao XieUniversity of Illinois at Urbana-Champaign
DOI
11:45
25m
Talk
Compiler-Assisted Test Acceleration on GPUs for Embedded Software
Technical Papers
Vanya YanevaUniversity of Edinburgh, UK, Ajitha RajanUniversity of Edinburgh, UK, Christophe DubachUniversity of Edinburgh
DOI