ICST 2025
Mon 31 March - Fri 4 April 2025 Naples, Italy
Wed 2 Apr 2025 12:00 - 12:15 at Room A - Testing, Localisation and Repair Chair(s): Shin Yoo

Google’s approach to testing includes both testing prior to code submission (for fast validation) and after code submission (for comprehensive validation). However, Google’s ever growing testing demand has lead to increased continuous integration cycle latency and machine costs. When the post code submission continuous integration cycles get longer, it delays detecting breakages in the main repository which increases developer friction and lowers productivity. To mitigate this without increasing resource demand, Google is implementing Postsubmit Speculative Cycles in their Test Automation Platform (TAP). Speculative Cycles prioritize finding novel breakages faster. In this paper we present our new test scheduling architecture and the machine learning system (Transition Prediction) driving it. Both the ML system and the end-to-end test scheduling system are empirically evaluated on 3-months of our production data (120 billion test×cycle pairs, 7.7 million breaking targets, with ∼20 thousand unique breakages). Using Speculative Cycles we observed a median (p50) reduction of approximately 65% (from 107 to 37 minutes) in the time taken to detect novel breaking targets.

Wed 2 Apr

Displayed time zone: Amsterdam, Berlin, Bern, Rome, Stockholm, Vienna change

11:00 - 12:30
Testing, Localisation and RepairJournal-First Papers / Research Papers / Industry at Room A
Chair(s): Shin Yoo KAIST
11:00
15m
Talk
A Taxonomy of Integration-relevant Faults for Microservice Testing
Research Papers
Lena Gregor Technical University of Munich, Anja Hentschel Siemens AG, Leon Kastner Technical University of Munich, Alexander Pretschner TU Munich
Pre-print
11:15
15m
Talk
Suspicious Types and Bad Neighborhoods- Filtering Spectra with Compiler Information
Research Papers
Leonhard Applis Delft University of Technology, Matthías Páll Gissurarson Chalmers University of Technology, Sweden, Annibale Panichella Delft University of Technology
11:30
15m
Talk
Summary of Automated Program Repair for Variability Bugs in Software Product Line Systems
Journal-First Papers
Thu-Trang Nguyen , Xiao-Yi Zhang University of Science and Technology Beijing, Paolo Arcaini National Institute of Informatics , Fuyuki Ishikawa National Institute of Informatics, Hieu Vo VNU University of Engineering and Technology
Link to publication DOI
11:45
15m
Talk
Automated Engineering of Domain-Specific Metamorphic Testing Environments
Journal-First Papers
Pablo Gómez-Abajo Universidad Autónoma de Madrid, Pablo C Canizares Autonomous University of Madrid, Spain, Alberto Núňez University Complutense of Madrid, Spain., Esther Guerra Universidad Autónoma de Madrid, Juan de Lara Autonomous University of Madrid
Link to publication DOI
12:00
15m
Talk
Speculative Testing at Google with Transition Prediction
Industry
Link to publication Pre-print
12:15
15m
Talk
Challenges, Strategies, and Impacts: A Qualitative Study on UI Testing in CI/CD Processes from GitHub Developers’ Perspectives
Research Papers
XIAOXIAO GAN Virginia Tech, Huayu Liang Virginia Tech, Chris Brown Virginia Tech
:
:
:
: