Write a Blog >>
Mon 10 Jul 2017 10:55 - 11:20 at Bren 1414 - Improving Testing Chair(s): Cristian Cadar

Testing in Continuous Integration (CI) involves test case prioritization, selection, and execution at each cycle. Selecting the most promising test cases to detect bugs is hard if there are uncertainties on the impact of committed code changes or, if traceability links between code and tests are not available. This paper introduces Retecs, a new method for automatically learning test case selection and prioritization in CI with the goal to minimize the round-trip time between code commits and developer feedback on failed test cases. The Retecs method uses reinforcement learning to select and prioritize test cases according to their duration, previous last execution and failure history. In a constantly changing environment, where new test cases are created and obsolete test cases are deleted, the Retecs method learns to prioritize error-prone test cases higher under guidance of a reward function and by observing previous CI cycles. By applying Retecs on data extracted from three industrial case studies, we show for the first time that reinforcement learning enables fruitful automatic adaptive test case selection and prioritization in CI and regression testing.

Mon 10 Jul

Displayed time zone: Tijuana, Baja California change

10:30 - 12:10
Improving TestingTechnical Papers at Bren 1414
Chair(s): Cristian Cadar Imperial College London
10:30
25m
Talk
One Test to Rule Them All
Technical Papers
Alex Groce Northern Arizona University, Josie Holmes Pennsylvania State University, USA, Kevin Kellar
DOI
10:55
25m
Talk
Reinforcement Learning for Automatic Test Case Prioritization and Selection in Continuous Integration
Technical Papers
Helge Spieker Simula Research Laboratory, Norway, Arnaud Gotlieb Simula Research Laboratory, Norway, Dusica Marijan Simula, Morten Mossige University of Stavanger, Norway / ABB Robotics, Norway
DOI
11:20
25m
Talk
PerfRanker: Prioritization of Performance Regression Tests for Collection-Intensive Software
Technical Papers
Shaikh Mostafa University of Texas at San Antonio, USA, Xiaoyin Wang University of Texas at San Antonio, USA, Tao Xie University of Illinois at Urbana-Champaign
DOI
11:45
25m
Talk
Compiler-Assisted Test Acceleration on GPUs for Embedded Software
Technical Papers
Vanya Yaneva University of Edinburgh, UK, Ajitha Rajan University of Edinburgh, UK, Christophe Dubach University of Edinburgh
DOI