ICST 2024
Mon 27 - Fri 31 May 2024 Canada
VenueSecond Student Centre, York University
Room nameRoom 2
Floor0
Room InformationNo extra information available
Program

This program is tentative and subject to change.

You're viewing the program in a time zone which is different from your device's time zone change time zone

Mon 27 May

Displayed time zone: Eastern Time (US & Canada) change

14:00 - 15:30
Session on Applications of CTIWCT at Room 2
14:00
30m
Talk
Assessing the Degree of Feature Interactions that Determine a Model Prediction
IWCT
Krishna Khadka The University of Texas at Arlington, Sunny Shree , Jeff Yu Lei University of Texas at Arlington, Raghu Kacker National Institute of Standards and Technology, Richard Kuhn
14:30
30m
Talk
Coverage for Identifying Critical Metadata in Machine Learning Operating Envelopes
IWCT
Erin Lanus Virginia Tech, Brian Lee Virginia Tech, Luis Pol Virginia Tech, Daniel Sobien Virginia Tech, Justin Kauffman Virginia Tech, Laura Freeman Virginia Tech
15:00
30m
Talk
Integrating Product Sampling and Behavioral Testing for Software Product Lines with Combinatorial Testing
IWCT
Andrea Bombarda University of Bergamo, Angelo Gargantini University of Bergamo
16:00 - 17:30
Closing SessionIWCT at Room 2
16:00
25m
Talk
On Combinatorial Security Testing for the Tor Anonymity Network Client
IWCT
Dimitris Simos SBA Research, Bernhard Garn SBA Research, Dominik-Philip Schreiber MATRIS Research Group, SBA Research, Manuel Leithner SBA Research, Rick Kuhn National Institute of Standards and Technology, Raghu Kacker National Institute of Standards and Technology
16:25
30m
Talk
Summary of CT tools
IWCT

16:55
35m
Day closing
Closing Remarks for IWCT 2024
IWCT

Tue 28 May

Displayed time zone: Eastern Time (US & Canada) change

09:00 - 10:30
Session 1 (Opening, Keynote, Papers 1)AIST at Room 2
09:00
15m
Day opening
Workshop Opening
AIST
Gregory Gay Chalmers | University of Gothenburg, Sebastiano Panichella Zurich University of Applied Sciences, Aitor Arrieta Mondragon University
09:15
60m
Keynote
Towards Better Software Quality in the Era of Large Language Models
AIST
Lingming Zhang University of Illinois at Urbana-Champaign
10:15
15m
Talk
Generating Minimalist Adversarial Perturbations to Test Object-Detection Models: An Adaptive Multi-Metric Evolutionary Search Approach
AIST
Cristopher McIntyre-Garcia , Adrien Heymans University of Ottawa, Beril Borali University of Ottawa, Won-Sook Le University of Ottawa, Shiva Nejati University of Ottawa
11:00 - 12:30
Session 2 (Papers 2)AIST at Room 2
11:00
22m
Talk
"No Free Lunch" when using Large Language Models to Verify Self-Generated Programs
AIST
Sol Zilberman Michigan State University, Betty H.C. Cheng Michigan State University
11:22
22m
Talk
An End-to-End Test Case Prioritization Framework using Optimized Machine Learning Models
AIST
Md Asif Khan Ontario Tech University, Akramul Azim Ontario Tech University, Ramiro Liscano Ontario Tech University, Kevin Smith International Business Machines Corporation (IBM), Yee-Kang Chang International Business Machines Corporation (IBM), Qasim Tauseef International Business Machines Corporation (IBM), Gkerta Seferi International Business Machines Corporation (IBM)
11:45
22m
Talk
Iterative Optimization of Hyperparameter-based Metamorphic Transformations
AIST
Gaadha Sudheerbabu Åbo Akademi University, Tanwir Ahmad Åbo Akademi University, Dragos Truscan Åbo Akademi University, Jüri Vain Tallinn University of Technology, Estonia, Ivan Porres Åbo Akademi University
12:07
22m
Talk
Machine Learning for Cross-Vulnerability Prediction in Smart Contracts
AIST
Hajra Naeem Toronto Metropolitan University, Manar H. Alalfi
14:00 - 15:30
Session 3 (Tutorials)AIST at Room 2
14:00
45m
Tutorial
Tutorial: A Hands-on Tutorial for Automatic Test Case Generation and Fuzzing for JavaScript
AIST
Mitchell Olsthoorn Delft University of Technology, Annibale Panichella Delft University of Technology
14:45
45m
Tutorial
Tutorial: SoKotHban - Competitive Adversarial Testing of Sokoban Solvers
AIST
Addison Crump CISPA Helmholtz Center for Information Security
16:00 - 17:30
Session 4 (Discussion Panel)AIST at Room 2
16:00
75m
Panel
Panel Discussion
AIST

17:15
15m
Day closing
Workshop Closing
AIST
Aitor Arrieta Mondragon University, Gregory Gay Chalmers | University of Gothenburg, Sebastiano Panichella Zurich University of Applied Sciences

Wed 29 May

Displayed time zone: Eastern Time (US & Canada) change

11:00 - 12:40
Testing and LLMsIndustry / Research Papers at Room 2
Chair(s): Sudipta Chattopadhyay Singapore University of Technology and Design
11:00
20m
Industry talk
Are We Testing or Being Tested? Exploring the Practical Applications of Large Language Models in Software Testing
Industry
Robson T. de Souza Santos , Italo Santos Northern Arizona University, Cleyton V. C. de Magalhaes CESAR School, Ronnie de Souza Santos University of Calgary
11:20
20m
Research paper
Improving Patch Correctness Analysis via Random Testing and Large Language Models
Research Papers
Facundo Molina IMDEA Software Institute, Juan Manuel Copia IMDEA Software Institute; Universidad Politécnica de Madrid, Alessandra Gorla IMDEA Software Institute
Pre-print
11:40
20m
Research paper
Intent-Driven Mobile GUI Testing with Autonomous Large Language Model Agents
Research Papers
Juyeon Yoon Korea Advanced Institute of Science and Technology, Robert Feldt Chalmers University of Technology, Sweden, Shin Yoo Korea Advanced Institute of Science and Technology
Pre-print
12:00
20m
Research paper
KAT: Dependency-aware Automated API Testing with Large Language Models
Research Papers
Tri Le , Thien Tran , Duy Cao , Vy Le , Vu Nguyen Head of Research, Katalon Inc.; University of Science, VNU-HCM, Vietnam, Tien N. Nguyen University of Texas at Dallas
12:20
20m
Research paper
Quantizing Large-Language Models for Predicting Flaky Tests
Research Papers
Shanto Rahman The University of Texas at Austin, Abdelrahman Baz , Sasa Misailovic University of Illinois at Urbana-Champaign, August Shi The University of Texas at Austin
15:30 - 17:00
Testing Autonomous Driving SystemsResearch Papers / Testing Tools and Demonstration at Room 2
Chair(s): Nargiz Humbatova USI Lugano
15:30
20m
Research paper
Adversarial Testing with Reinforcement Learning: A Case Study on Autonomous Driving
Research Papers
Andréa Doreste , Matteo Biagiola Università della Svizzera italiana, Paolo Tonella USI Lugano
15:50
20m
Research paper
Assessing Quality Metrics for Neural Reality Gap Input Mitigation in Autonomous Driving Testing
Research Papers
Stefano Carlo Lambertenghi Technische Universität München, fortiss GmbH, Andrea Stocco Technical University of Munich, fortiss
Pre-print
16:10
20m
Research paper
Predicting Safety Misbehaviours in Autonomous Driving Systems using Uncertainty Quantification
Research Papers
Ruben Grewal , Paolo Tonella USI Lugano, Andrea Stocco Technical University of Munich, fortiss
Pre-print
16:30
20m
Research paper
AURORA: Navigating UI Tarpits via Automated Neural Screen Understanding
Research Papers
Safwat Ali Khan George Mason University, Wenyu Wang University of Illinois Urbana-Champaign, Yiran Ren , Bin Zhu , Jiangfan Shi , Wing Lam George Mason University, Kevin Moran University of Central Florida
Pre-print
16:50
10m
Demonstration
U-Fuzz: A Tool for Stateful Fuzzing of IoT Protocols on COTS Devices
Testing Tools and Demonstration
Shang Zewen , Matheus Eduardo Garbelini , Sudipta Chattopadhyay Singapore University of Technology and Design

Thu 30 May

Displayed time zone: Eastern Time (US & Canada) change

11:00 - 12:40
Mutation Testing and Test PrioritizaitonResearch Papers / Journal-First Papers / Industry at Room 2
Chair(s): Facundo Molina IMDEA Software Institute
11:00
20m
Industry talk
Towards Mutation-guided Test Suites for Smart Contracts
Industry
11:20
20m
Research paper
On the Coupling between Vulnerabilities and LLM-generated Mutants: A Study on Vul4J dataset
Research Papers
Aayush Garg Luxembourg Institute of Science and Technology, Renzo Degiovanni Luxembourg Institute of Science and Technology, Mike Papadakis University of Luxembourg, Yves Le Traon University of Luxembourg, Luxembourg
Pre-print
11:40
20m
Long-paper
Mutation Testing Optimisations using the Clang Front-end
Journal-First Papers
Sten Vercammen , Serge Demeyer University of Antwerp; Flanders Make, Markus Borg CodeScene, Niklas Pettersson , Görel Hedin Lund University
12:00
20m
Research paper
MACS: Multi-agent Adversarial Reinforcement Learning for Finding Diverse Critical Driving Scenarios
Research Papers
Shuting Kang University of Chinese Academy of Sciences, Qian Dong Institute of Software Chinese Academy of Sciences, Yunzhi Xue Institute of Software Chinese Academy of Sciences, Yanjun Wu Institute of Software, Chinese Academy of Sciences
12:20
20m
Long-paper
Lessons learned from replicating a study on information-retrieval-based test case prioritization
Journal-First Papers
Nasir Mehmood Minhas Mälardalen University, Mohsin Irshad , Kai Petersen University of Applied Sciences Flensburg, Germany / Blekinge Institute of Technology, Sweden, Jürgen Börstler Blekinge Institute of Technology
14:00 - 15:00
Verification and TestingIndustry / Journal-First Papers / Research Papers at Room 2
14:00
20m
Industry talk
Randomised Testing of the Compiler for a Verification-Aware Programming Language
Industry
Alastair F. Donaldson Imperial College London, Dilan Sheth Imperial College London, Jean-Baptiste Tristan Amazon Web Services, Alex Usher Imperial College London
14:20
20m
Long-paper
Automatically Generating Test Cases for Safety-Critical Software via Symbolic Execution
Journal-First Papers
Elson Kurian University of Milano Bicocca, Daniela Briola University of Milano Bicocca, Pietro Braione University of Milano-Bicocca, Giovanni Denaro University of Milano - Bicocca
14:40
20m
Research paper
EmoSTL: Formal Spatial-Temporal Verification of Emotion Specifications in Computer Games
Research Papers
Saba Gholizadeh Ansari Utrecht University, Wishnu Prasetya Utrecht University, Frank Dignum Umea University, Mehdi Dastani , Gabriele Keller Utrecht University

Fri 31 May

Displayed time zone: Eastern Time (US & Canada) change

11:00 - 12:20
Testing with and for Deep and Reinforcement LearningResearch Papers / Industry at Room 2
11:00
20m
Research paper
METAL: Metamorphic Testing Framework for Analyzing Large-Language Model Qualities
Research Papers
Sangwon Hyun University of Adelaide, Mingyu Guo , Muhammad Ali Babar School of Computer Science, The University of Adelaide
11:20
20m
Industry talk
End-to-end RPA-like testing using reinforcement learning
Industry
Ciprian Paduraru University of Bucharest, Rares Cristea University of Bucharest, Alin Stefanescu University of Bucharest
11:40
20m
Research paper
Spectral Analysis of the Relation between Deep Learning Faults and Neural Activation Values
Research Papers
Nargiz Humbatova USI Lugano, Gunel Jahangirova King's College London, Paolo Tonella USI Lugano
12:00
20m
Research paper
Learning Environment Models with Continuous Stochastic Dynamics - with an Application to Deep RL Testing
Research Papers
Martin Tappler TU Wien, Austria, Edi Muskardin , Bernhard Aichernig Graz University of Technology, Bettina Könighofer
13:30 - 14:30
Metamorphic and Combinatorial TestingIndustry / Journal-First Papers at Room 2
Chair(s): Wishnu Prasetya Utrecht University
13:30
20m
Industry talk
Metamorphic Testing of an Autonomous Delivery Robots Scheduler
Industry
Thomas Laurent Lero@Trinity College Dublin, Paolo Arcaini National Institute of Informatics , Xiao-Yi Zhang , Fuyuki Ishikawa National Institute of Informatics
Pre-print
13:50
20m
Long-paper
Design, implementation, and validation of a benchmark generator for combinatorial interaction testing tools
Journal-First Papers
Andrea Bombarda University of Bergamo, Angelo Gargantini University of Bergamo

Mon 27 May

Displayed time zone: Eastern Time (US & Canada) change

Tue 28 May

Displayed time zone: Eastern Time (US & Canada) change

Wed 29 May

Displayed time zone: Eastern Time (US & Canada) change