Write a Blog >>
ICSE 2022
Sun 8 - Fri 27 May 2022
Tue 10 May 2022 13:10 - 13:15 at ICSE room 5-odd hours - Validation and Verification 7 Chair(s): Guido Salvaneschi
Wed 11 May 2022 20:10 - 20:15 at ICSE room 3-even hours - Validation and Verification 5 Chair(s): Saba Alimadadi
Thu 26 May 2022 11:30 - 11:35 at Room 301+302 - Papers 15: Software Testing 2 Chair(s): Rohan Padhye

Previous algorithms for feedback-directed unit test generation iteratively create sequences of API calls by executing partial tests and by adding new API calls at the end of the test. These algorithms are challenged by a popular class of APIs: higher-order functions that receive callback arguments, which often are invoked asynchronously. Existing test generators cannot effectively test such APIs because they only sequence API calls, but do not nest one call into the callback function of another. This paper presents Nessie, the first feedback-directed unit test generator that supports nesting of API calls and that tests asynchronous callbacks. Nesting API calls enables a test to use values produced by an API that are available only once a callback has been invoked, and is often necessary to ensure that methods are invoked in a specific order. The core contributions of our approach are a tree-based representation of unit tests with callbacks and a novel algorithm to iteratively generate such tests in a feedback-directed manner. We evaluate our approach on ten popular JavaScript libraries with both asynchronous and synchronous callbacks. The results show that, in a comparison with LambdaTester, a state of the art test generation technique that only considers sequencing of method calls, Nessie finds more behavioral differences and achieves slightly higher coverage. Notably, Nessie needs to generate significantly fewer tests to achieve and exceed the coverage achieved by the state of the art.

Tue 10 May

Displayed time zone: Eastern Time (US & Canada) change

13:00 - 14:00
Validation and Verification 7Journal-First Papers / Technical Track / SEIP - Software Engineering in Practice at ICSE room 5-odd hours
Chair(s): Guido Salvaneschi University of St. Gallen
13:00
5m
Talk
Control and Discovery of Environment Behaviour
Journal-First Papers
Maureen Keegan Intercom, Nicolás D’Ippolito Dept. of Computer Science FCEyN, University of Buenos Aires, Víctor Braberman ICC (UBA-CONICET), Nir Piterman University of Gothenberg, Sebastian Uchitel Universidad de Buenos Aires / Imperial College
Link to publication DOI Pre-print Media Attached
13:05
5m
Talk
Unreliable Test Infrastructures in Automotive Testing Setups
SEIP - Software Engineering in Practice
Claudius Jordan Technical University of Munich, Philipp Foth Technical University of Munich, Alexander Pretschner TU Munich, Matthias Fruth TraceTronic GmbH
Pre-print Media Attached
13:10
5m
Talk
Nessie: Automatically Testing JavaScript APIs with Asynchronous Callbacks
Technical Track
Ellen Arteca Northeastern University, Sebastian Harner University of Stuttgart, Michael Pradel University of Stuttgart, Frank Tip Northeastern University
Pre-print Media Attached
13:15
5m
Talk
Towards Boosting Patch Execution On-the-Fly
Technical Track
Samuel Benton The University of Texas at Dallas, Yuntong Xie Tsinghua University, Lan Lu SUSTech, Mengshi Zhang Meta, Xia Li Kennesaw State University, Lingming Zhang University of Illinois at Urbana-Champaign
Media Attached File Attached
13:20
5m
Talk
Diversity-Driven Automated Formal VerificationDistinguished Paper Award
Technical Track
Emily First University of Massachusetts Amherst, Yuriy Brun University of Massachusetts
DOI Pre-print Media Attached
13:25
5m
Talk
Nalin: Learning from Runtime Behavior to Find Name-Value Inconsistencies
Technical Track
Jibesh Patra University of Stuttgart, Michael Pradel University of Stuttgart
Pre-print Media Attached

Wed 11 May

Displayed time zone: Eastern Time (US & Canada) change

20:00 - 21:00
Validation and Verification 5Technical Track / SEIP - Software Engineering in Practice / Journal-First Papers at ICSE room 3-even hours
Chair(s): Saba Alimadadi Simon Fraser University
20:00
5m
Talk
Control and Discovery of Environment Behaviour
Journal-First Papers
Maureen Keegan Intercom, Nicolás D’Ippolito Dept. of Computer Science FCEyN, University of Buenos Aires, Víctor Braberman ICC (UBA-CONICET), Nir Piterman University of Gothenberg, Sebastian Uchitel Universidad de Buenos Aires / Imperial College
Link to publication DOI Pre-print Media Attached
20:05
5m
Talk
How Does Code Reviewing Feedback Evolve? A Longitudinal Study at Dell EMC
SEIP - Software Engineering in Practice
Ruiyin Wen McGill University, Maxime Lamothe Polytechnique Montréal, Shane McIntosh University of Waterloo
Pre-print Media Attached
20:10
5m
Talk
Nessie: Automatically Testing JavaScript APIs with Asynchronous Callbacks
Technical Track
Ellen Arteca Northeastern University, Sebastian Harner University of Stuttgart, Michael Pradel University of Stuttgart, Frank Tip Northeastern University
Pre-print Media Attached
20:15
5m
Talk
ExAIS: Executable AI Semantics
Technical Track
Richard Schumi Singapore Management University, Jun Sun Singapore Management University
Pre-print Media Attached
20:20
5m
Talk
Towards Boosting Patch Execution On-the-Fly
Technical Track
Samuel Benton The University of Texas at Dallas, Yuntong Xie Tsinghua University, Lan Lu SUSTech, Mengshi Zhang Meta, Xia Li Kennesaw State University, Lingming Zhang University of Illinois at Urbana-Champaign
Media Attached File Attached
20:25
5m
Talk
Diversity-Driven Automated Formal VerificationDistinguished Paper Award
Technical Track
Emily First University of Massachusetts Amherst, Yuriy Brun University of Massachusetts
DOI Pre-print Media Attached

Thu 26 May

Displayed time zone: Eastern Time (US & Canada) change

11:00 - 12:30
Papers 15: Software Testing 2Technical Track / SEIP - Software Engineering in Practice at Room 301+302
Chair(s): Rohan Padhye Carnegie Mellon University
11:00
5m
Talk
CONFETTI: Amplifying Concolic Guidance for Fuzzers
Technical Track
James Kukucka George Mason University, Luís Pina University of Illinois at Chicago, Paul Ammann George Mason University, USA, Jonathan Bell Northeastern University
Pre-print Media Attached
11:05
5m
Talk
Surveying the Developer Experience of Flaky Tests
SEIP - Software Engineering in Practice
Owain Parry The University of Sheffield, Gregory Kapfhammer Allegheny College, Michael Hilton Carnegie Mellon University, USA, Phil McMinn University of Sheffield
Pre-print Media Attached
11:10
5m
Talk
Natural Attack for Pre-trained Models of Code
Technical Track
Zhou Yang Singapore Management University, Jieke Shi Singapore Management University, Junda He Singapore Management University, David Lo Singapore Management University
DOI Pre-print Media Attached
11:15
5m
Talk
FADATest: Fast and Adaptive Performance Regression Testing of Dynamic Binary Translation Systems
Technical Track
Jin Wu Harbin Institute of Technology, Jian Dong Harbin Institute Of Technology, Ruili Fang University of Georgia, Wen Zhang University of Georgia, Wenwen Wang University of Georgia, Decheng Zuo Harbin Institute of Technology
Pre-print Media Attached
11:20
5m
Talk
Repairing Order-Dependent Flaky Tests via Test Generation
Technical Track
Chengpeng Li University of Texas at Austin, Chenguang Zhu University of Texas at Austin, Wenxi Wang University of Texas at Austin, August Shi University of Texas at Austin
Link to publication DOI Media Attached
11:25
5m
Talk
BeDivFuzz: Integrating Behavioral Diversity into Generator-based Fuzzing
Technical Track
Hoang Lam Nguyen Humboldt-Universität zu Berlin, Lars Grunske Humboldt-Universität zu Berlin
Pre-print Media Attached
11:30
5m
Talk
Nessie: Automatically Testing JavaScript APIs with Asynchronous Callbacks
Technical Track
Ellen Arteca Northeastern University, Sebastian Harner University of Stuttgart, Michael Pradel University of Stuttgart, Frank Tip Northeastern University
Pre-print Media Attached
11:35
5m
Talk
EAGLE: Creating Equivalent Graphs to Test Deep Learning Libraries
Technical Track
Jiannan Wang Purdue University, Thibaud Lutellier University of Waterloo, Shangshu Qian Purdue University, Hung Viet Pham University of Waterloo, Lin Tan Purdue University
Pre-print Media Attached

Information for Participants
Tue 10 May 2022 13:00 - 14:00 at ICSE room 5-odd hours - Validation and Verification 7 Chair(s): Guido Salvaneschi
Info for room ICSE room 5-odd hours:

Click here to go to the room on Midspace

Wed 11 May 2022 20:00 - 21:00 at ICSE room 3-even hours - Validation and Verification 5 Chair(s): Saba Alimadadi
Info for room ICSE room 3-even hours:

Click here to go to the room on Midspace