Write a Blog >>
ICSE 2022
Sun 8 - Fri 27 May 2022
Tue 10 May 2022 05:05 - 05:10 at ICSE room 3-odd hours - Software Testing 2 Chair(s): Aldeida Aleti
Tue 10 May 2022 12:10 - 12:15 at ICSE room 2-even hours - Software Testing 11 Chair(s): Jonathan Bell

At IVU Traffic Technologies, continuous integration (CI) pipelines build, analyze, and test the code for inadvertent effects before pull requests are merged. However, compiling the entire code base and executing all regression tests for each pull request is infeasible due to prohibitively long feedback times. Regression test selection (RTS) aims to reduce the testing effort. Yet, existing safe RTS techniques are not suitable, as they largely rely on language-specific program analysis. The IVU code base consists of more than 13 million lines of code in Java or C/C++ and contains thousands of non-code artifacts. Regression tests commonly operate across languages, using cross-language links, or read from non-code artifacts. In this paper, we describe our build system aware multi-language RTS approach, which selectively compiles and executes affected code modules and regression tests, respectively, for a pull request. We evaluate our RTS technique on 397 pull requests, covering roughly 2,700 commits. The results show that we are able to safely exclude up to 75% of tests on average (no undetected real failures slip into the target branches) and thereby save 72% of testing time, whereas end-to-end CI pipeline time is reduced by up to 63% on average.

Tue 10 May

Displayed time zone: Eastern Time (US & Canada) change

05:00 - 06:00
05:00
5m
Talk
Reinforcement Learning for Test Case Prioritization
Journal-First Papers
Mojtaba Bagherzadeh University of Ottawa, Nafiseh Kahani , Lionel Briand University of Luxembourg; University of Ottawa
Link to publication DOI Pre-print Media Attached
05:05
5m
Talk
Build System Aware Multi-language Regression Test Selection in Continuous Integration
SEIP - Software Engineering in Practice
Daniel Elsner TU Munich, Roland Würsching Technical University of Munich, Markus Schnappinger , Alexander Pretschner TU Munich, Maria Graber IVU Traffic Technologies, René Dammer IVU Traffic Technologies, Silke Reimer IVU Traffic Technologies
DOI Pre-print Media Attached
05:10
5m
Talk
Testing Machine Learning Systems in Industry: An Empirical Study
SEIP - Software Engineering in Practice
Shuyue Li Xi'an Jiaotong University, Jiaqi Guo Xi'an Jiaotong University, Jian-Guang Lou Microsoft Research, Ming Fan Xi'an Jiaotong University, Ting Liu Xi'an Jiaotong University, Dongmei Zhang Microsoft Research
DOI Pre-print Media Attached
05:15
5m
Talk
GIFdroid: Automated Replay of Visual Bug Reports for Android Apps
Technical Track
Sidong Feng Monash University, Chunyang Chen Monash University
DOI Pre-print Media Attached
05:20
5m
Talk
BuildSheriff: Change-Aware Test Failure Triage for Continuous Integration Builds
Technical Track
Chen Zhang Fudan University, Bihuan Chen Fudan University, China, Xin Peng Fudan University, Wenyun Zhao Fudan University, China
Pre-print Media Attached
05:25
5m
Talk
Natural Attack for Pre-trained Models of Code
Technical Track
Zhou Yang Singapore Management University, Jieke Shi Singapore Management University, Junda He Singapore Management University, David Lo Singapore Management University
DOI Pre-print Media Attached
12:00 - 13:00
12:00
5m
Talk
Smoke Testing for Machine Learning: Simple Tests to Discover Severe Defects
Journal-First Papers
Steffen Herbold TU Clausthal, Tobias Haar University of Goettingen
DOI Media Attached
12:05
5m
Talk
Algorithmic Profiling for Real-World Complexity Problems
Journal-First Papers
Boqin Qin China Telecom Cloud Computing Corporation, Tengfei Tu Beijing University of Posts and Telecommunications, Ziheng Liu University of California, San Diego, Tingting Yu University of Cincinnati, Linhai Song Pennsylvania State University, USA
DOI Pre-print Media Attached
12:10
5m
Talk
Build System Aware Multi-language Regression Test Selection in Continuous Integration
SEIP - Software Engineering in Practice
Daniel Elsner TU Munich, Roland Würsching Technical University of Munich, Markus Schnappinger , Alexander Pretschner TU Munich, Maria Graber IVU Traffic Technologies, René Dammer IVU Traffic Technologies, Silke Reimer IVU Traffic Technologies
DOI Pre-print Media Attached
12:15
5m
Talk
Free Lunch for Testing: Fuzzing Deep-Learning Libraries from Open Source
Technical Track
Anjiang Wei Stanford University, Yinlin Deng University of Illinois at Urbana-Champaign, Chenyuan Yang Nanjing University, Lingming Zhang University of Illinois at Urbana-Champaign
Pre-print Media Attached
12:20
5m
Talk
Automatic Detection of Performance Bugs in Database Systems using Equivalent Queries
Technical Track
Xinyu Liu Georgia Institute of Technology, Qi Zhou Facebook, Joy Arulraj Georgia Institute of Technology, Alessandro Orso Georgia Tech
Pre-print Media Attached
12:25
5m
Talk
R2Z2: Detecting Rendering Regressions in Web Browsers through Differential Fuzz Testing
Technical Track
Suhwan Song Seoul National University, South Korea, Jaewon Hur Seoul National University, Sunwoo Kim Samsung Research, Samsung Electronics, Philip Rogers Google, Byoungyoung Lee Seoul National University, South Korea
Pre-print Media Attached

Information for Participants
Tue 10 May 2022 05:00 - 06:00 at ICSE room 3-odd hours - Software Testing 2 Chair(s): Aldeida Aleti
Info for room ICSE room 3-odd hours:

Click here to go to the room on Midspace

Tue 10 May 2022 12:00 - 13:00 at ICSE room 2-even hours - Software Testing 11 Chair(s): Jonathan Bell
Info for room ICSE room 2-even hours:

Click here to go to the room on Midspace