Write a Blog >>
ICSE 2022
Sun 8 - Fri 27 May 2022
Tue 10 May 2022 20:10 - 20:15 at ICSE room 2-even hours - Software Testing 5 Chair(s): Leonardo Sousa
Thu 12 May 2022 12:10 - 12:15 at ICSE room 3-even hours - Software Testing 14 Chair(s): Brittany Johnson
Thu 26 May 2022 11:05 - 11:10 at Room 301+302 - Papers 15: Software Testing 2 Chair(s): Rohan Padhye

Test cases that pass and fail without changes to the code under test are known as flaky. The past decade has seen increasing research interest in flaky tests, though little attention has been afforded to the views and experiences of software developers. In this study, we utilized a multi-source approach to obtain insights into how developers define flaky tests, their experiences of the impacts and causes of flaky tests, and the actions they take in response to them. To that end, we designed a literature-guided developer survey that we deployed on social media and received 170 responses. We also searched on StackOverflow and analyzed 38 threads relevant to flaky tests, offering a distinct perspective free of any self-reporting bias. Through a mixture of numerical and thematic analysis, our study reveals a number of findings, including (1) developers strongly agree that flaky tests hinder continuous integration; (2) developers who experience flaky tests more often may be more likely to ignore potentially genuine test failures; and (3) developers rate issues in setup and teardown to be the most common causes of flaky tests.

Tue 10 May

Displayed time zone: Eastern Time (US & Canada) change

20:00 - 21:00
20:00
5m
Talk
Demystifying the Challenges and Benefits of Analyzing User-Reported Logs in Bug Reports
Journal-First Papers
An Ran Chen Concordia University, Tse-Hsun (Peter) Chen Concordia University, Shaowei Wang University of Manitoba
Link to publication Media Attached
20:05
5m
Talk
Reinforcement Learning for Test Case Prioritization
Journal-First Papers
Mojtaba Bagherzadeh University of Ottawa, Nafiseh Kahani , Lionel Briand University of Luxembourg; University of Ottawa
Link to publication DOI Pre-print Media Attached
20:10
5m
Talk
Surveying the Developer Experience of Flaky Tests
SEIP - Software Engineering in Practice
Owain Parry The University of Sheffield, Gregory Kapfhammer Allegheny College, Michael Hilton Carnegie Mellon University, USA, Phil McMinn University of Sheffield
Pre-print Media Attached
20:15
5m
Talk
The Impact of Flaky Tests on Historical Test Prioritization on Chrome
SEIP - Software Engineering in Practice
Emad Fallahzadeh Concordia University, Peter Rigby Concordia University, Montreal, Canada
Pre-print Media Attached
20:20
5m
Talk
Demystifying the Dependency Challenge in Kernel Fuzzing
Technical Track
Yu Hao University of California at Riverside, USA, Hang Zhang Georgia Institute of Technology, Guoren Li UC Riverside, Xingyun Du UC Riverside, Zhiyun Qian University of California at Riverside, USA, Ardalan Amiri Sani UC Irvine
Pre-print Media Attached
20:25
5m
Talk
BuildSheriff: Change-Aware Test Failure Triage for Continuous Integration Builds
Technical Track
Chen Zhang Fudan University, Bihuan Chen Fudan University, China, Xin Peng Fudan University, Wenyun Zhao Fudan University, China
Pre-print Media Attached

Thu 12 May

Displayed time zone: Eastern Time (US & Canada) change

12:00 - 13:00
12:00
5m
Talk
To What Extent Do DNN-based Image Classification Models Make Unreliable Inferences?
Journal-First Papers
Yongqiang TIAN The Hong Kong University of Science and Technology; University of Waterloo, Shiqing Ma Rutgers University, Ming Wen Huazhong University of Science and Technology, Yepang Liu Southern University of Science and Technology, Shing-Chi Cheung Hong Kong University of Science and Technology, Xiangyu Zhang Purdue University
DOI Pre-print Media Attached
12:05
5m
Talk
Demystifying the Challenges and Benefits of Analyzing User-Reported Logs in Bug Reports
Journal-First Papers
An Ran Chen Concordia University, Tse-Hsun (Peter) Chen Concordia University, Shaowei Wang University of Manitoba
Link to publication Media Attached
12:10
5m
Talk
Surveying the Developer Experience of Flaky Tests
SEIP - Software Engineering in Practice
Owain Parry The University of Sheffield, Gregory Kapfhammer Allegheny College, Michael Hilton Carnegie Mellon University, USA, Phil McMinn University of Sheffield
Pre-print Media Attached
12:15
5m
Talk
Fuzzing Class Specifications
Technical Track
Facundo Molina University of Rio Cuarto and CONICET, Argentina, Marcelo d'Amorim Federal University of Pernambuco, Nazareno Aguirre University of Rio Cuarto and CONICET, Argentina
Pre-print Media Attached
12:20
5m
Talk
Demystifying the Dependency Challenge in Kernel Fuzzing
Technical Track
Yu Hao University of California at Riverside, USA, Hang Zhang Georgia Institute of Technology, Guoren Li UC Riverside, Xingyun Du UC Riverside, Zhiyun Qian University of California at Riverside, USA, Ardalan Amiri Sani UC Irvine
Pre-print Media Attached
12:25
5m
Talk
Natural Attack for Pre-trained Models of Code
Technical Track
Zhou Yang Singapore Management University, Jieke Shi Singapore Management University, Junda He Singapore Management University, David Lo Singapore Management University
DOI Pre-print Media Attached

Thu 26 May

Displayed time zone: Eastern Time (US & Canada) change

11:00 - 12:30
Papers 15: Software Testing 2Technical Track / SEIP - Software Engineering in Practice at Room 301+302
Chair(s): Rohan Padhye Carnegie Mellon University
11:00
5m
Talk
CONFETTI: Amplifying Concolic Guidance for Fuzzers
Technical Track
James Kukucka George Mason University, Luís Pina University of Illinois at Chicago, Paul Ammann George Mason University, USA, Jonathan Bell Northeastern University
Pre-print Media Attached
11:05
5m
Talk
Surveying the Developer Experience of Flaky Tests
SEIP - Software Engineering in Practice
Owain Parry The University of Sheffield, Gregory Kapfhammer Allegheny College, Michael Hilton Carnegie Mellon University, USA, Phil McMinn University of Sheffield
Pre-print Media Attached
11:10
5m
Talk
Natural Attack for Pre-trained Models of Code
Technical Track
Zhou Yang Singapore Management University, Jieke Shi Singapore Management University, Junda He Singapore Management University, David Lo Singapore Management University
DOI Pre-print Media Attached
11:15
5m
Talk
FADATest: Fast and Adaptive Performance Regression Testing of Dynamic Binary Translation Systems
Technical Track
Jin Wu Harbin Institute of Technology, Jian Dong Harbin Institute Of Technology, Ruili Fang University of Georgia, Wen Zhang University of Georgia, Wenwen Wang University of Georgia, Decheng Zuo Harbin Institute of Technology
Pre-print Media Attached
11:20
5m
Talk
Repairing Order-Dependent Flaky Tests via Test Generation
Technical Track
Chengpeng Li University of Texas at Austin, Chenguang Zhu University of Texas at Austin, Wenxi Wang University of Texas at Austin, August Shi University of Texas at Austin
Link to publication DOI Media Attached
11:25
5m
Talk
BeDivFuzz: Integrating Behavioral Diversity into Generator-based Fuzzing
Technical Track
Hoang Lam Nguyen Humboldt-Universität zu Berlin, Lars Grunske Humboldt-Universität zu Berlin
Pre-print Media Attached
11:30
5m
Talk
Nessie: Automatically Testing JavaScript APIs with Asynchronous Callbacks
Technical Track
Ellen Arteca Northeastern University, Sebastian Harner University of Stuttgart, Michael Pradel University of Stuttgart, Frank Tip Northeastern University
Pre-print Media Attached
11:35
5m
Talk
EAGLE: Creating Equivalent Graphs to Test Deep Learning Libraries
Technical Track
Jiannan Wang Purdue University, Thibaud Lutellier University of Waterloo, Shangshu Qian Purdue University, Hung Viet Pham University of Waterloo, Lin Tan Purdue University
Pre-print Media Attached

Information for Participants
Tue 10 May 2022 20:00 - 21:00 at ICSE room 2-even hours - Software Testing 5 Chair(s): Leonardo Sousa
Info for room ICSE room 2-even hours:

Click here to go to the room on Midspace

Thu 12 May 2022 12:00 - 13:00 at ICSE room 3-even hours - Software Testing 14 Chair(s): Brittany Johnson
Info for room ICSE room 3-even hours:

Click here to go to the room on Midspace