Write a Blog >>
Mon 10 Jul 2017 10:55 - 11:20 at Bren 1414 - Improving Testing Chair(s): Cristian Cadar

Testing in Continuous Integration (CI) involves test case prioritization, selection, and execution at each cycle. Selecting the most promising test cases to detect bugs is hard if there are uncertainties on the impact of committed code changes or, if traceability links between code and tests are not available. This paper introduces Retecs, a new method for automatically learning test case selection and prioritization in CI with the goal to minimize the round-trip time between code commits and developer feedback on failed test cases. The Retecs method uses reinforcement learning to select and prioritize test cases according to their duration, previous last execution and failure history. In a constantly changing environment, where new test cases are created and obsolete test cases are deleted, the Retecs method learns to prioritize error-prone test cases higher under guidance of a reward function and by observing previous CI cycles. By applying Retecs on data extracted from three industrial case studies, we show for the first time that reinforcement learning enables fruitful automatic adaptive test case selection and prioritization in CI and regression testing.

Mon 10 Jul

issta-2017-research
10:30 - 12:10: Technical Papers - Improving Testing at Bren 1414
Chair(s): Cristian CadarImperial College London
issta-2017-research10:30 - 10:55
Talk
Alex GroceNorthern Arizona University, Josie HolmesPennsylvania State University, USA, Kevin Kellar
DOI
issta-2017-research10:55 - 11:20
Talk
Helge SpiekerSimula Research Laboratory, Norway, Arnaud GotliebSimula Research Laboratory, Norway, Dusica MarijanSimula, Morten MossigeUniversity of Stavanger, Norway / ABB Robotics, Norway
DOI
issta-2017-research11:20 - 11:45
Talk
Shaikh MostafaUniversity of Texas at San Antonio, USA, Xiaoyin WangUniversity of Texas at San Antonio, USA, Tao XieUniversity of Illinois at Urbana-Champaign
DOI
issta-2017-research11:45 - 12:10
Talk
Vanya YanevaUniversity of Edinburgh, UK, Ajitha RajanUniversity of Edinburgh, UK, Christophe DubachUniversity of Edinburgh
DOI