Write a Blog >>
Mon 10 Jul 2017 10:30 - 10:55 at Bren 1414 - Improving Testing Chair(s): Cristian Cadar

Test reduction has long been seen as critical for automated testing. However, traditional test reduction simply reduces the length of a test, but does not attempt to reduce semantic complexity. This paper extends previous efforts with algorithms for normalizing and generalizing tests. Rewriting tests into a normal form can reduce semantic complexity and even remove steps from an already delta-debugged test. Moreover, normalization dramatically reduces the number of tests that a reader must examine, partially addressing the ``fuzzer taming'' problem of discovering distinct faults in a set of failing tests. Generalization, in contrast, takes a test and reports what aspects of the test could have been changed while preserving the property that the test fails. Normalization plus generalization aids understanding of tests, including tests for complex and widely used APIs such as the NumPy numeric computation library and the ArcPy GIS scripting package. Normalization frequently reduces the number of tests to be examined by well over an order of magnitude, and often to just one test per fault. Together, ideally, normalization and generalization allow a user to replace reading a large set of tests that vary in unimportant ways with reading one annotated summary test.

Mon 10 Jul

Displayed time zone: Tijuana, Baja California change

10:30 - 12:10
Improving TestingTechnical Papers at Bren 1414
Chair(s): Cristian Cadar Imperial College London
10:30
25m
Talk
One Test to Rule Them All
Technical Papers
Alex Groce Northern Arizona University, Josie Holmes Pennsylvania State University, USA, Kevin Kellar
DOI
10:55
25m
Talk
Reinforcement Learning for Automatic Test Case Prioritization and Selection in Continuous Integration
Technical Papers
Helge Spieker Simula Research Laboratory, Norway, Arnaud Gotlieb Simula Research Laboratory, Norway, Dusica Marijan Simula, Morten Mossige University of Stavanger, Norway / ABB Robotics, Norway
DOI
11:20
25m
Talk
PerfRanker: Prioritization of Performance Regression Tests for Collection-Intensive Software
Technical Papers
Shaikh Mostafa University of Texas at San Antonio, USA, Xiaoyin Wang University of Texas at San Antonio, USA, Tao Xie University of Illinois at Urbana-Champaign
DOI
11:45
25m
Talk
Compiler-Assisted Test Acceleration on GPUs for Embedded Software
Technical Papers
Vanya Yaneva University of Edinburgh, UK, Ajitha Rajan University of Edinburgh, UK, Christophe Dubach University of Edinburgh
DOI