ICST 2024
Mon 27 - Fri 31 May 2024 Canada

This program is tentative and subject to change.

You're viewing the program in a time zone which is different from your device's time zone change time zone

Mon 27 May

Displayed time zone: Eastern Time (US & Canada) change

08:00 - 09:00
Breakfast & RegistrationSocial
08:00
60m
Other
Breakfast & Registration
Social

09:00 - 10:30
Session 1: shared with NEXTAA-MOST at Room 1
09:00 - 10:30
Session 1NEXTA at Room 3
09:15
15m
Day opening
Welcome to NEXTA2024
NEXTA
Sahar Tahvili Ericsson AB
09:30
60m
Keynote
Risk-Driven Testing and Certification in Simulated Environments
NEXTA
Michael Felderer German Aerospace Center (DLR) & University of Cologne
09:00 - 10:30
ITEQS IITEQS at Room 4
Chair(s): Eduard Paul Enoiu Mälardalen University, Mehrdad Saadatmand RISE Research Institutes of Sweden, Dragos Truscan Åbo Akademi University
09:00
10m
Talk
ITEQS 2024 Opening
ITEQS
Dragos Truscan Åbo Akademi University, Eduard Paul Enoiu Mälardalen University, Mehrdad Saadatmand RISE Research Institutes of Sweden
09:15
60m
Keynote
Keynote: The Challenges of Integrating Static Analysis and Dynamic Security Testing in the Context of Increasing Regulation
ITEQS
Martin A. Schneider Fraunhofer FOKUS
10:30 - 11:00
Coffee BreakSocial
10:30
30m
Coffee break
Break
Social

11:00 - 12:30
Session 2A-MOST at Room 1
Chair(s): Florian Lorber Silicon Austria Labs
11:00
30m
Day opening
Welcome to 20 Years of A-MOST
A-MOST
Florian Lorber Silicon Austria Labs, Cristina Seceleanu Mälardalen University, Martin Tappler TU Wien, Austria
11:30
30m
Full-paper
Testing the Evolution of Feature Models with Specific Combinatorial Tests
A-MOST
Andrea Bombarda University of Bergamo, Silvia Bonfanti University of Bergamo, Angelo Gargantini University of Bergamo
File Attached
12:00
30m
Full-paper
Annotating Control-Flow Graphs for Formalized Test Coverage Criteria
A-MOST
Sean Kauffman Queen's University, Canada, Carlos Moreno , Sebastian Fischmeister University of Waterloo, Canada
11:00 - 12:30
Session 2NEXTA at Room 3
11:00
30m
Research paper
Automated Hybrid Fuzzing of Web APIs
NEXTA
Andrea Bogle The Aerospace Corporation, Tan Tran The Aerospace Corporation, Rafael Ceja The Aerospace Corporation, Joshua Sasaki The Aerospace Corporation, Riyadh Mahmood The Aerospace Corporation
11:30
30m
Short-paper
Improving security analysis rule set by relationship identification
NEXTA
Charles Lohest UCLouvain, Axel Legay Université Catholique de Louvain, Belgium
12:00
30m
Short-paper
TCPGraphix: A Visualization Tool for ML-Powered Test Case Prioritization Data Analysis
NEXTA
Yara Q Mahmoud Ontario Tech University, Akramul Azim Ontario Tech University, Md Asif Khan Ontario Tech University
11:00 - 12:30
ITEQS IIITEQS at Room 4
Chair(s): Mehrdad Saadatmand RISE Research Institutes of Sweden
11:00
30m
Full-paper
Automated SQA Framework with Predictive Machine Learning in Airfield Software
ITEQS
Ridwan Hossain , Akramul Azim Ontario Tech University, Linda Cato Team Eagle, Bruce Wilkins Team Eagle
11:30
30m
Full-paper
Early Detection with Explainability of Network Attacks Using Deep LearningBest Paper
ITEQS
Tanwir Ahmad Åbo Akademi University, Dragos Truscan Åbo Akademi University
12:00
30m
Full-paper
Testing cyber-physical systems with explicit output coverageBest Paper
ITEQS
Jarkko Peltomäki Åbo Akademi University, Jesper Winsten , Maxime Methais , Ivan Porres Åbo Akademi University
12:30 - 14:00
LunchSocial
12:30
90m
Lunch
Lunch
Social

14:00 - 15:30
Session 3A-MOST at Room 1
Chair(s): Cristina Seceleanu Mälardalen University
14:00
30m
Full-paper
Active Model Learning for Software Interrogation and Diagnosis
A-MOST
Adam Porter University of Maryland, alan Karr
14:30
30m
Short-paper
Active Model Learning of Git Version Control System
A-MOST
Edi Muskardin , Tamim Burgstaller , Martin Tappler TU Wien, Austria, Bernhard Aichernig Graz University of Technology
15:00
30m
Full-paper
Bridging the Gap Between Models in RL: Test Models vs. Neural Networks
A-MOST
Martin Tappler TU Wien, Austria, Florian Lorber Silicon Austria Labs
14:00 - 15:30
Session on Applications of CTIWCT at Room 2
14:00
30m
Talk
Assessing the Degree of Feature Interactions that Determine a Model Prediction
IWCT
Krishna Khadka The University of Texas at Arlington, Sunny Shree , Jeff Yu Lei University of Texas at Arlington, Raghu Kacker National Institute of Standards and Technology, Richard Kuhn
14:30
30m
Talk
Coverage for Identifying Critical Metadata in Machine Learning Operating Envelopes
IWCT
Erin Lanus Virginia Tech, Brian Lee Virginia Tech, Luis Pol Virginia Tech, Daniel Sobien Virginia Tech, Justin Kauffman Virginia Tech, Laura Freeman Virginia Tech
15:00
30m
Talk
Integrating Product Sampling and Behavioral Testing for Software Product Lines with Combinatorial Testing
IWCT
Andrea Bombarda University of Bergamo, Angelo Gargantini University of Bergamo
14:00 - 15:30
ITEQS IIIITEQS at Room 4
Chair(s): Tanwir Ahmad Åbo Akademi University
14:00
30m
Full-paper
A Survey on the Verification and Validation of Artificial Pancreas Software Systems
ITEQS
Bara' Nazzal Queen's University, Canada, Manar Alalfi Toronto Metropolitan University, James Cordy Queen's University, Canada
14:30
30m
Full-paper
ConDU: Method for On-the-fly Detection of Non-deadlock Concurrency Errors in UAV Software
ITEQS
Jinseok Park Gyeongsang National University, Changhui Bae Gyeongsang National University, Seongjin Lee Gyeongsang National Unviersity
15:00
30m
Full-paper
Java Lock Contention Anti-Patterns and Their Associated Recommendations
ITEQS
Aritra Ahmed Ontario Tech University, Ramiro Liscano Ontario Tech University, Akramul Azim Ontario Tech University, Yee-Kang Chang International Business Machines Corporation (IBM), Vijay Sundaresan IBM Canada
15:30 - 16:00
Coffee BreakSocial
15:30
30m
Coffee break
Break
Social

16:00 - 17:30
Session 4A-MOST at Room 1
Chair(s): Martin Tappler TU Wien, Austria
16:00
30m
Short-paper
Coverage measurement in model-based testing of web applications: Tool support and an industrial experience report
A-MOST
16:30
30m
Short-paper
Modeling and Safety Analysis of Autonomous Underwater Vehicles Behaviors
A-MOST
Sergio Quijano IT University of Copenhagen, Mahsa Varshosaz IT University of Copenhagen, Denmark, Andrzej Wąsowski IT University of Copenhagen, Denmark
17:00
30m
Full-paper
Optimizing Model-based Generated Tests: Leveraging Machine Learning for Test Reduction
A-MOST
Muhammad Nouman Zafar Malardalen University, Wasif Afzal Mälardalen University, Eduard Paul Enoiu Mälardalen University, Zulqarnain Haider , Inderjeet Singh Alstom
16:00 - 17:30
Closing SessionIWCT at Room 2
16:00
25m
Talk
On Combinatorial Security Testing for the Tor Anonymity Network Client
IWCT
Dimitris Simos SBA Research, Bernhard Garn SBA Research, Dominik-Philip Schreiber MATRIS Research Group, SBA Research, Manuel Leithner SBA Research, Rick Kuhn National Institute of Standards and Technology, Raghu Kacker National Institute of Standards and Technology
16:25
30m
Talk
Summary of CT tools
IWCT

16:55
35m
Day closing
Closing Remarks for IWCT 2024
IWCT

16:00 - 17:30
ClosingNEXTA at Room 3
16:00
30m
Awards
Closing and Best Paper Award
NEXTA
Sahar Tahvili Ericsson AB
16:00 - 17:30
ITEQS IVITEQS at Room 4
Chair(s): Mehrdad Saadatmand RISE Research Institutes of Sweden
16:00
10m
Talk
Closing
ITEQS
Dragos Truscan Åbo Akademi University, Eduard Paul Enoiu Mälardalen University, Mehrdad Saadatmand RISE Research Institutes of Sweden

Tue 28 May

Displayed time zone: Eastern Time (US & Canada) change

08:00 - 09:00
BreakfastSocial
08:00
60m
Other
Breakfast & Registration
Social

08:30 - 10:30
CCIW Session 1CCIW at Room 5
Chair(s): Tim A. D. Henderson Google
08:30
20m
Day opening
Welcome to CCIW
CCIW
08:50
25m
Talk
Thinktank: Leveraging LLM Reasoning for Advanced Task Execution in CI/CD
CCIW
Tim Keller SAP SE
09:15
25m
Talk
Widespread Error Detection in Large Scale Continuous Integration Systems
CCIW
Stanislaw Swierc Meta Platforms, Inc., James Lu Meta Platforms, Inc., Thomas Yi Meta Platforms, Inc.
09:40
25m
Talk
Scalable Continuous Integration using Remote Execution
CCIW
Ola Rozenfeld EngFlow Inc.
10:05
25m
Talk
Replay-Based Continual Learning for Test Case Prioritization
CCIW
Asma Fariha Ontario Tech University, Akramul Azim Ontario Tech University, Ramiro Liscano Ontario Tech University
09:00 - 10:30
Opening & Academic KeynoteMODAL at Room 1
Chair(s): Wing Lam George Mason University
09:30
15m
Day opening
Welcome ceremony
MODAL

09:45
45m
Keynote
Keynote: Julia Rubin
MODAL
K: Julia Rubin University of British Columbia, S: Wing Lam George Mason University
09:00 - 10:30
Session 1 (Opening, Keynote, Papers 1)AIST at Room 2
09:00
15m
Day opening
Workshop Opening
AIST
Gregory Gay Chalmers | University of Gothenburg, Sebastiano Panichella Zurich University of Applied Sciences, Aitor Arrieta Mondragon University
09:15
60m
Keynote
Towards Better Software Quality in the Era of Large Language Models
AIST
Lingming Zhang University of Illinois at Urbana-Champaign
10:15
15m
Talk
Generating Minimalist Adversarial Perturbations to Test Object-Detection Models: An Adaptive Multi-Metric Evolutionary Search Approach
AIST
Cristopher McIntyre-Garcia , Adrien Heymans University of Ottawa, Beril Borali University of Ottawa, Won-Sook Le University of Ottawa, Shiva Nejati University of Ottawa
09:00 - 10:30
Opening and KeynoteTestEd at Room 3
Chair(s): Upsorn Praphamontripong University of Virginia
09:00
10m
Other
TestEd 2024 Opening
TestEd
Upsorn Praphamontripong University of Virginia
09:10
80m
Keynote
Why Testing is Even More Important in the Age of Generative AI
TestEd
K: Briana B. Morrison University of Virginia
09:00 - 10:30
KeynoteMutation at Room 4
09:30
5m
Day opening
MUTATION opening
Mutation

09:35
55m
Keynote
Keynote: Mutation for AI and with AI
Mutation
K: Jie M. Zhang King's College London
10:30 - 11:00
Coffee BreakSocial
10:30
30m
Coffee break
Break
Social

11:00 - 12:30
Lightning Talks & Program Analysis PanelMODAL at Room 1
Chair(s): Kevin Moran University of Central Florida
11:00
45m
Talk
Lightning (5-10 min.) Talks - All Participants
MODAL

11:45
45m
Panel
Panel: Program Analysis for Mobile Apps
MODAL
Julia Rubin University of British Columbia, Safwat Hassan University of Toronto, Canada, Weiyi Shang University of Waterloo, Yousra Aafer Purdue University
11:00 - 12:30
Session 2 (Papers 2)AIST at Room 2
11:00
22m
Talk
"No Free Lunch" when using Large Language Models to Verify Self-Generated Programs
AIST
Sol Zilberman Michigan State University, Betty H.C. Cheng Michigan State University
11:22
22m
Talk
An End-to-End Test Case Prioritization Framework using Optimized Machine Learning Models
AIST
Md Asif Khan Ontario Tech University, Akramul Azim Ontario Tech University, Ramiro Liscano Ontario Tech University, Kevin Smith International Business Machines Corporation (IBM), Yee-Kang Chang International Business Machines Corporation (IBM), Qasim Tauseef International Business Machines Corporation (IBM), Gkerta Seferi International Business Machines Corporation (IBM)
11:45
22m
Talk
Iterative Optimization of Hyperparameter-based Metamorphic Transformations
AIST
Gaadha Sudheerbabu Åbo Akademi University, Tanwir Ahmad Åbo Akademi University, Dragos Truscan Åbo Akademi University, Jüri Vain Tallinn University of Technology, Estonia, Ivan Porres Åbo Akademi University
12:07
22m
Talk
Machine Learning for Cross-Vulnerability Prediction in Smart Contracts
AIST
Hajra Naeem Toronto Metropolitan University, Manar H. Alalfi
11:00 - 12:30
Session 1Mutation at Room 4
11:00
30m
Talk
Mutant-Kraken: A Mutation Testing Tool for Kotlin
Mutation
Josue Morales Towson University, Lin Deng Towson University, Josh Dehlinger Towson University, Suranjan Chakraborty Towson University
11:30
30m
Talk
Timed Model-Based Mutation Operators for Simulink Models
Mutation
Jian Chen Queen's University, Manar Alalfi Toronto Metropolitan University, Thomas Dean
12:00
30m
Talk
Improving the Efficacy of Testing Scientific Software: Insights from Mutation Testing
Mutation
Kris Roker University of North Florida, Upulee Kanewala University of North Florida
11:00 - 12:30
CCIW Session 2CCIW at Room 5
Chair(s): Tim A. D. Henderson Google
11:00
25m
Talk
Future of Google Testing
CCIW
11:25
25m
Talk
The Effects of Computational Resources on Flaky Tests
CCIW
Jonathan Bell Northeastern University, Wing Lam George Mason University, Marcelo d'Amorim North Carolina State University, Alexi Turcotte Northeastern University, Ellen Arteca Google MTV , Satyajit Gokhale Northeastern University, Martin Gruber BMW Group, University of Passau, Denini Silva Federal University of Pernambuco
11:50
40m
Panel
What are the biggest challenges in large scale CI/CD?
CCIW
12:30 - 14:00
LunchSocial
12:30
90m
Lunch
Lunch
Social

14:00 - 15:30
Industry Keynote & Mobile Testing PanelMODAL at Room 1
Chair(s): Kevin Moran University of Central Florida
14:00
45m
Keynote
Keynote: Jiangfan Shi - Difficulties and Challenges of Mobile Testing in Industry for Traditional-Age and LLM-Age
MODAL
Jiangfan Shi , S: Kevin Moran University of Central Florida
14:45
45m
Panel
Panel: Mobile Testing
MODAL
Jiangfan Shi , Mattia Fazzini University of Minnesota, Wenyu Wang University of Illinois Urbana-Champaign, Wing Lam George Mason University
14:00 - 15:30
Session 3 (Tutorials)AIST at Room 2
14:00
45m
Tutorial
Tutorial: A Hands-on Tutorial for Automatic Test Case Generation and Fuzzing for JavaScript
AIST
Mitchell Olsthoorn Delft University of Technology, Annibale Panichella Delft University of Technology
14:45
45m
Tutorial
Tutorial: SoKotHban - Competitive Adversarial Testing of Sokoban Solvers
AIST
Addison Crump CISPA Helmholtz Center for Information Security
14:00 - 15:30
Session 2Mutation at Room 4
14:00
30m
Talk
Test Harness Mutilation
Mutation
Samuel Moelius Trail of Bits
14:30
30m
Talk
An Empirical Evaluation of Manually Created Equivalent Mutants
Mutation
Philipp Straubinger University of Passau, Alexander Degenhart University of Passau, Gordon Fraser University of Passau
Pre-print
15:00
30m
Talk
A Study of Flaky Failure De-Duplication to Identify Unreliably Killed Mutants
Mutation
Abdulrahman Alshammari George Mason University, Paul Ammann George Mason University, USA, Michael Hilton Carnegie Mellon University, Jonathan Bell Northeastern University
14:00 - 15:30
Session 1InSTA at Room 5
14:00
10m
Talk
Welcome and Opening Messages InSTA 2024
InSTA

14:10
30m
Research paper
Design and construction of requirement specifications ambiguity detection support method
InSTA
Toshiharu Kato , Satoshi Masuda Tokyo City University, Kazuhiko Tsuda University of Tsukuba Tokyo
14:40
30m
Industry talk
Prompt Engineering Impacts to Software Test Architectures for Beginner to Experts
InSTA
Jon D. Hagar Grand Software Testing, LLC, Hot Sulphur Springs, CO, Satoshi Masuda Tokyo City University
15:10
20m
Talk
Information exchange in InSTA. (free discussion)
InSTA

15:30 - 16:00
Coffee BreakSocial
15:30
30m
Coffee break
Break
Social

16:00 - 17:30
Community Infrastructure Panel & ClosingMODAL at Room 1
Chair(s): Wing Lam George Mason University
16:00
45m
Panel
Panel: Community Dataset and Infrastructure
MODAL
August Shi The University of Texas at Austin, Kevin Moran University of Central Florida, Mei Nagappan University of Waterloo, Shin Yoo Korea Advanced Institute of Science and Technology
16:45
15m
Day closing
Closing discussions
MODAL

16:00 - 17:30
Session 4 (Discussion Panel)AIST at Room 2
16:00
75m
Panel
Panel Discussion
AIST

17:15
15m
Day closing
Workshop Closing
AIST
Aitor Arrieta Mondragon University, Gregory Gay Chalmers | University of Gothenburg, Sebastiano Panichella Zurich University of Applied Sciences
16:00 - 17:30
Best paper award and closingMutation at Room 4
16:00 - 17:30
Session 2InSTA at Room 5
16:00
30m
Research paper
Software Bug Prediction Model using Graph Neural Network
InSTA
Tomohiro Takeda , Satoshi Masuda Tokyo City University
16:30
10m
Talk
Closing
InSTA

Wed 29 May

Displayed time zone: Eastern Time (US & Canada) change

07:30 - 08:30
BreakfastSocial
07:30
60m
Other
Breakfast & Registration
Social

08:30 - 09:00
OpeningSocial at Room 1
Chair(s): Hadi Hemmati York University, Gregory Gay Chalmers | University of Gothenburg, Shiva Nejati University of Ottawa
08:30
30m
Day opening
Opening
Social

09:00 - 10:30
Keynote I - Lin TanKeynotes at Room 1
Chair(s): Gregory Gay Chalmers | University of Gothenburg
09:00
90m
Keynote
Synergy of Software Reliability and Large Language Models
Keynotes
K: Lin Tan Purdue University
10:30 - 11:00
Coffee BreakSocial
10:30
30m
Coffee break
Break
Social

11:00 - 12:40
Test Generation and Test CausalityIndustry / Research Papers / Journal-First Papers at Room 1
Chair(s): Jonathan Bell Northeastern University
11:00
20m
Research paper
Automatically Removing Unnecessary Stubbings from Test Suites
Research Papers
Mengzhen Li University of Minnesota, Mattia Fazzini University of Minnesota
11:20
20m
Industry talk
BugOut: Automated Test Generation and Bug Detection for Low-Code
Industry
11:40
20m
Research paper
Enhanced Fast and Reliable Statistical Vulnerability Root Cause Analysis with Sanitizer
Research Papers
Zhuo Yan Ocean University of China, Haipeng Qu Ocean University of China, Lingyun Ying Qi An Xin Group Corp., Ke Liu , Chao Qu
12:00
20m
Research paper
Causal Test Adequacy
Research Papers
Michael Foster The University of Sheffield, Christopher Wild , Neil Walkinshaw University of Sheffield, Robert Hierons The University of Sheffield
12:20
20m
Long-paper
Summary of Automated Code-based Test Case Reuse for Software Product Line Testing
Journal-First Papers
Pilsu Jung Gyeongsang National Unviersity, Seonah Lee Gyeongsang National University, Uicheon Lee
11:00 - 12:40
Testing and LLMsIndustry / Research Papers at Room 2
Chair(s): Sudipta Chattopadhyay Singapore University of Technology and Design
11:00
20m
Industry talk
Are We Testing or Being Tested? Exploring the Practical Applications of Large Language Models in Software Testing
Industry
Robson T. de Souza Santos , Italo Santos Northern Arizona University, Cleyton V. C. de Magalhaes CESAR School, Ronnie de Souza Santos University of Calgary
11:20
20m
Research paper
Improving Patch Correctness Analysis via Random Testing and Large Language Models
Research Papers
Facundo Molina IMDEA Software Institute, Juan Manuel Copia IMDEA Software Institute; Universidad Politécnica de Madrid, Alessandra Gorla IMDEA Software Institute
Pre-print
11:40
20m
Research paper
Intent-Driven Mobile GUI Testing with Autonomous Large Language Model Agents
Research Papers
Juyeon Yoon Korea Advanced Institute of Science and Technology, Robert Feldt Chalmers University of Technology, Sweden, Shin Yoo Korea Advanced Institute of Science and Technology
Pre-print
12:00
20m
Research paper
KAT: Dependency-aware Automated API Testing with Large Language Models
Research Papers
Tri Le , Thien Tran , Duy Cao , Vy Le , Vu Nguyen Head of Research, Katalon Inc.; University of Science, VNU-HCM, Vietnam, Tien N. Nguyen University of Texas at Dallas
12:20
20m
Research paper
Quantizing Large-Language Models for Predicting Flaky Tests
Research Papers
Shanto Rahman The University of Texas at Austin, Abdelrahman Baz , Sasa Misailovic University of Illinois at Urbana-Champaign, August Shi The University of Texas at Austin
12:40 - 14:00
LunchSocial
12:40
80m
Lunch
Lunch
Social

14:00 - 15:00
Keynote II - Mike HoyeKeynotes at Room 1
Chair(s): Shiva Nejati University of Ottawa
14:00
60m
Keynote
We build the world we measure
Keynotes
15:00 - 15:30
Coffee BreakSocial
15:00
30m
Coffee break
Break
Social

15:30 - 17:00
15:30
20m
Research paper
MSGFuzzer: Message Sequence Guided Industrial Robot Protocol Fuzzing
Research Papers
Yang Zhang Beijing Key Laboratory of IOT Information Security Technology, Institute of Information Engineering, CAS, Beijing, China; School of Cyber Security, University of Chinese Academy of Sciences, Beijing, China, Dongliang Fang Beijing Key Laboratory of IOT Information Security Technology, Institute of Information Engineering, CAS, China; School of Cyber Security, University of Chinese Academy of Sciences, China, Puzhuo Liu Beijing Key Laboratory of IOT Information Security Technology, Institute of Information Engineering, CAS, Beijing, China; School of Cyber Security, University of Chinese Academy of Sciences, Beijing, China;, Laile Xi , Xiao Lu , Xin Chen , Shuaizong Si , Limin Sun Institute of Information Engineering, Chinese Academy of Sciences, School of Cyber Security, University of Chinese Academy of Sciences,
15:50
20m
Research paper
U-Fuzz: Stateful Fuzzing of IoT Protocols on COTS Devices
Research Papers
Shang Zewen , Matheus Eduardo Garbelini , Sudipta Chattopadhyay Singapore University of Technology and Design
16:10
20m
Research paper
Formatted Stateful Greybox Fuzzing of TLS server
Research Papers
Fan Hu , Jiangan Ji , Hui Shu , Zheming Li Tsinghua University, Tieming Liu , Chao Zhang Tsinghua University
16:30
20m
Long-paper
A Fuzzing-Based Test-Creation Approach for Evaluating Digital TV Receivers via Transport Streams
Journal-First Papers
Fabrício Izumi Banceira , Eddie Lima Samsung Electronics, Brazil, Lucas C. Cordeiro University of Manchester, UK and Federal University of Amazonas, Brazil, Orlewilson Maia , Rômulo Fabrício , Bruno Farias University of Manchester, UK, Aguinaldo Silva
16:50
10m
Demonstration
MOTIF: A tool for Mutation Testing with Fuzzing
Testing Tools and Demonstration
Jaekwon Lee University of Ottawa & University of Luxembourg, Enrico Viganò University of Luxembourg, Fabrizio Pastore University of Luxembourg, Lionel Briand University of Ottawa, Canada; Lero centre, University of Limerick, Ireland
15:30 - 17:00
Testing Autonomous Driving SystemsResearch Papers / Testing Tools and Demonstration at Room 2
Chair(s): Nargiz Humbatova USI Lugano
15:30
20m
Research paper
Adversarial Testing with Reinforcement Learning: A Case Study on Autonomous Driving
Research Papers
Andréa Doreste , Matteo Biagiola Università della Svizzera italiana, Paolo Tonella USI Lugano
15:50
20m
Research paper
Assessing Quality Metrics for Neural Reality Gap Input Mitigation in Autonomous Driving Testing
Research Papers
Stefano Carlo Lambertenghi Technische Universität München, fortiss GmbH, Andrea Stocco Technical University of Munich, fortiss
Pre-print
16:10
20m
Research paper
Predicting Safety Misbehaviours in Autonomous Driving Systems using Uncertainty Quantification
Research Papers
Ruben Grewal , Paolo Tonella USI Lugano, Andrea Stocco Technical University of Munich, fortiss
Pre-print
16:30
20m
Research paper
AURORA: Navigating UI Tarpits via Automated Neural Screen Understanding
Research Papers
Safwat Ali Khan George Mason University, Wenyu Wang University of Illinois Urbana-Champaign, Yiran Ren , Bin Zhu , Jiangfan Shi , Wing Lam George Mason University, Kevin Moran University of Central Florida
Pre-print
16:50
10m
Demonstration
U-Fuzz: A Tool for Stateful Fuzzing of IoT Protocols on COTS Devices
Testing Tools and Demonstration
Shang Zewen , Matheus Eduardo Garbelini , Sudipta Chattopadhyay Singapore University of Technology and Design
17:00 - 18:00
Open Steering Committee MeetingKeynotes at Room 1
17:00
60m
Meeting
Open Steering Committee Meeting
Keynotes

18:15 - 21:00
ReceptionSocial
18:15
2h45m
Social Event
Reception
Social

Thu 30 May

Displayed time zone: Eastern Time (US & Canada) change

08:00 - 09:00
BreakfastSocial
08:00
60m
Other
Breakfast & Registration
Social

09:00 - 10:30
Keynote III - Sam MalekKeynotes at Room 1
Chair(s): Hadi Hemmati York University
09:00
90m
Keynote
Beyond Alt Text: Emerging Software Engineering Techniques for a More Accessible Software
Keynotes
K: Sam Malek University of California at Irvine
10:30 - 11:00
Coffee BreakSocial
10:30
30m
Coffee break
Break
Social

10:30 - 11:00
10:30
30m
Poster
gptCombFuzz: Combinatorial Oriented LLM Seed Generation for effective Fuzzing
Posters
Darshan Lohiya , Golla Monika Rani , Sangharatna Godboley National Institute of Technology Warangal, Radha Krishna Pisipati
10:30
30m
Poster
Towards Understanding Root Causes of Real Failures in Healthcare Machine Learning Applications
Posters
Guna Sekaran Jaganathan , Nazmul Kazi , Indika Kahanda University of North Florida, Upulee Kanewala University of North Florida
10:30
30m
Poster
VeriSol-MCE: Verification-based condition coverage analysis of Smart Contracts using Model Checker Engines
Posters
Sangharatna Godboley National Institute of Technology Warangal, Radha Krishna Pisipati
10:30
30m
Research paper
Causal Test Adequacy
Research Papers
Michael Foster The University of Sheffield, Christopher Wild , Neil Walkinshaw University of Sheffield, Robert Hierons The University of Sheffield
10:30
30m
Industry talk
BugOut: Automated Test Generation and Bug Detection for Low-Code
Industry
10:30
30m
Industry talk
In industrial embedded software, are some compilation errors easier to localize and fix than others?
Industry
Han Fu , Sigrid Eldh Ericsson AB, Mälardalen University, Carleton Unviersity, Kristian Wiklund Ericsson AB, Andreas Ermedahl , Philipp Haller KTH Royal Institute of Technology, Cyrille Artho KTH Royal Institute of Technology, Sweden
10:30
30m
Industry talk
Metamorphic Testing of an Autonomous Delivery Robots Scheduler
Industry
Thomas Laurent Lero@Trinity College Dublin, Paolo Arcaini National Institute of Informatics , Xiao-Yi Zhang , Fuyuki Ishikawa National Institute of Informatics
Pre-print
10:30
30m
Doctoral symposium paper
Agile Regression Testing
Doctoral Symposium
Suddhasvatta Das Arizona State University
10:30
30m
Doctoral symposium paper
Insights into System Failures: ML-Assisted Testing and Failure Models for Cyber-Physical Systems
Doctoral Symposium
Baharin Aliashrafi Jodat University of Ottawa
10:30
30m
Doctoral symposium paper
Search-based Security Testing of Enterprise Microservices
Doctoral Symposium
Susruthan Seran , Susruthan Seran Kristiania University College
10:30
30m
Doctoral symposium paper
Teaching Model-Driven Engineering from a model-testing perspective
Doctoral Symposium
Felix Cammaerts KU Leuven
File Attached
11:00 - 12:40
Test FlakinessJournal-First Papers / Research Papers / Industry at Room 1
Chair(s): Andrea Stocco Technical University of Munich, fortiss
11:00
20m
Long-paper
Test Code Flakiness in Mobile Apps: The Developer's Perspective
Journal-First Papers
Valeria Pontillo Vrije Universiteit Brussel, Fabio Palomba University of Salerno, Filomena Ferrucci University of Salerno
Link to publication
11:20
20m
Long-paper
Flakiness goes live: Insights from an In Vivo testing simulation study
Journal-First Papers
Morena Barboni University of Camerino, Antonia Bertolino National Research Council, Italy, Guglielmo De Angelis CNR-IASI
11:40
20m
Research paper
262,447 Test Failures Later: An Empirical Evaluation of Flaky Failure Classifiers
Research Papers
Abdulrahman Alshammari George Mason University, Paul Ammann George Mason University, USA, Michael Hilton Carnegie Mellon University, Jonathan Bell Northeastern University
12:00
20m
Research paper
Automatically Reproducing Timing-Dependent Flaky-Test Failures
Research Papers
Shanto Rahman The University of Texas at Austin, Aaron Massey George Mason University, Wing Lam George Mason University, August Shi The University of Texas at Austin, Jonathan Bell Northeastern University
12:20
20m
Industry talk
Cost of Flaky Tests in CI: An Industrial Case Study
Industry
Fabian Leinen Technical University of Munich, Daniel Elsner TU Munich, Alexander Pretschner TU Munich, Andreas Stahlbauer , Michael Sailer , Elmar Juergens CQSE GmbH
Pre-print
11:00 - 12:40
Mutation Testing and Test PrioritizaitonResearch Papers / Journal-First Papers / Industry at Room 2
Chair(s): Facundo Molina IMDEA Software Institute
11:00
20m
Industry talk
Towards Mutation-guided Test Suites for Smart Contracts
Industry
11:20
20m
Research paper
On the Coupling between Vulnerabilities and LLM-generated Mutants: A Study on Vul4J dataset
Research Papers
Aayush Garg Luxembourg Institute of Science and Technology, Renzo Degiovanni Luxembourg Institute of Science and Technology, Mike Papadakis University of Luxembourg, Yves Le Traon University of Luxembourg, Luxembourg
Pre-print
11:40
20m
Long-paper
Mutation Testing Optimisations using the Clang Front-end
Journal-First Papers
Sten Vercammen , Serge Demeyer University of Antwerp; Flanders Make, Markus Borg CodeScene, Niklas Pettersson , Görel Hedin Lund University
12:00
20m
Research paper
MACS: Multi-agent Adversarial Reinforcement Learning for Finding Diverse Critical Driving Scenarios
Research Papers
Shuting Kang University of Chinese Academy of Sciences, Qian Dong Institute of Software Chinese Academy of Sciences, Yunzhi Xue Institute of Software Chinese Academy of Sciences, Yanjun Wu Institute of Software, Chinese Academy of Sciences
12:20
20m
Long-paper
Lessons learned from replicating a study on information-retrieval-based test case prioritization
Journal-First Papers
Nasir Mehmood Minhas Mälardalen University, Mohsin Irshad , Kai Petersen University of Applied Sciences Flensburg, Germany / Blekinge Institute of Technology, Sweden, Jürgen Börstler Blekinge Institute of Technology
11:00 - 12:40
Student Presentation (Closed)Doctoral Symposium at Room 3
11:00
25m
Doctoral symposium paper
Agile Regression Testing
Doctoral Symposium
Suddhasvatta Das Arizona State University
11:25
25m
Doctoral symposium paper
Insights into System Failures: ML-Assisted Testing and Failure Models for Cyber-Physical Systems
Doctoral Symposium
Baharin Aliashrafi Jodat University of Ottawa
11:50
25m
Doctoral symposium paper
Search-based Security Testing of Enterprise Microservices
Doctoral Symposium
Susruthan Seran , Susruthan Seran Kristiania University College
12:15
25m
Doctoral symposium paper
Teaching Model-Driven Engineering from a model-testing perspective
Doctoral Symposium
Felix Cammaerts KU Leuven
File Attached
12:40 - 14:00
LunchSocial
12:40
80m
Lunch
Lunch
Social

12:40 - 14:00
Women@ICST LunchSocial at Room 1
Chair(s): Shiva Nejati University of Ottawa
12:40
80m
Lunch
Lunch
Social

12:40 - 14:00
12:40
80m
Poster
gptCombFuzz: Combinatorial Oriented LLM Seed Generation for effective Fuzzing
Posters
Darshan Lohiya , Golla Monika Rani , Sangharatna Godboley National Institute of Technology Warangal, Radha Krishna Pisipati
12:40
80m
Poster
Towards Understanding Root Causes of Real Failures in Healthcare Machine Learning Applications
Posters
Guna Sekaran Jaganathan , Nazmul Kazi , Indika Kahanda University of North Florida, Upulee Kanewala University of North Florida
12:40
80m
Poster
VeriSol-MCE: Verification-based condition coverage analysis of Smart Contracts using Model Checker Engines
Posters
Sangharatna Godboley National Institute of Technology Warangal, Radha Krishna Pisipati
12:40
80m
Research paper
Causal Test Adequacy
Research Papers
Michael Foster The University of Sheffield, Christopher Wild , Neil Walkinshaw University of Sheffield, Robert Hierons The University of Sheffield
12:40
80m
Industry talk
BugOut: Automated Test Generation and Bug Detection for Low-Code
Industry
12:40
80m
Industry talk
In industrial embedded software, are some compilation errors easier to localize and fix than others?
Industry
Han Fu , Sigrid Eldh Ericsson AB, Mälardalen University, Carleton Unviersity, Kristian Wiklund Ericsson AB, Andreas Ermedahl , Philipp Haller KTH Royal Institute of Technology, Cyrille Artho KTH Royal Institute of Technology, Sweden
12:40
80m
Industry talk
Metamorphic Testing of an Autonomous Delivery Robots Scheduler
Industry
Thomas Laurent Lero@Trinity College Dublin, Paolo Arcaini National Institute of Informatics , Xiao-Yi Zhang , Fuyuki Ishikawa National Institute of Informatics
Pre-print
12:40
80m
Doctoral symposium paper
Agile Regression Testing
Doctoral Symposium
Suddhasvatta Das Arizona State University
12:40
80m
Doctoral symposium paper
Insights into System Failures: ML-Assisted Testing and Failure Models for Cyber-Physical Systems
Doctoral Symposium
Baharin Aliashrafi Jodat University of Ottawa
12:40
80m
Doctoral symposium paper
Search-based Security Testing of Enterprise Microservices
Doctoral Symposium
Susruthan Seran , Susruthan Seran Kristiania University College
12:40
80m
Doctoral symposium paper
Teaching Model-Driven Engineering from a model-testing perspective
Doctoral Symposium
Felix Cammaerts KU Leuven
File Attached
14:00 - 15:00
Software Testing Education and Fault LocalizationResearch Papers / Journal-First Papers at Room 1
Chair(s): Shin Yoo Korea Advanced Institute of Science and Technology
14:00
20m
Research paper
State of the Practice in Software Testing Teaching in Four European Countries
Research Papers
Porfirio Tramontana Department of Electrical Engineering and Information Technologies, University of Naples Federico II, Italy, Beatriz Marín Universitat Politècnica de València, Ana Paiva Faculty of Engineering, University of Porto and INESC TEC, Alexandra Mendes Faculty of Engineering, University of Porto & INESC TEC, Tanja E. J. Vos Universitat Politècnica de València and Open Universiteit, Domenico Amalfitano University of Naples Federico II, Felix Cammaerts KU Leuven, Monique Snoeck Katholieke Universiteit Leuven, Anna Rita Fasolino Federico II University of Naples
14:20
20m
Long-paper
Can gamification help in software testing education? Findings from an empirical study
Journal-First Papers
Raquel Blanco , Manuel Trinidad , María José Suárez-Cabal , Alejandro Calderón Sánchez , Mercedes Ruiz University of Cadiz, Javier Tuya Computer Science Department, University of Oviedo
14:40
20m
Research paper
FusionFL: A statement-level feature fusion based fault localization approach
Research Papers
Yanbo Zhang , Yawen Wang State Key Laboratory of Networking and Switching Technology, Beijing University of Posts and Telecommunications, Dongming Zhu , Wenjing Liu
14:00 - 15:00
Verification and TestingIndustry / Journal-First Papers / Research Papers at Room 2
Chair(s): Franz Wotawa Graz University of Technology
14:00
20m
Industry talk
Randomised Testing of the Compiler for a Verification-Aware Programming Language
Industry
Alastair F. Donaldson Imperial College London, Dilan Sheth Imperial College London, Jean-Baptiste Tristan Amazon Web Services, Alex Usher Imperial College London
14:20
20m
Long-paper
Automatically Generating Test Cases for Safety-Critical Software via Symbolic Execution
Journal-First Papers
Elson Kurian University of Milano Bicocca, Daniela Briola University of Milano Bicocca, Pietro Braione University of Milano-Bicocca, Giovanni Denaro University of Milano - Bicocca
14:40
20m
Research paper
EmoSTL: Formal Spatial-Temporal Verification of Emotion Specifications in Computer Games
Research Papers
Saba Gholizadeh Ansari Utrecht University, Wishnu Prasetya Utrecht University, Frank Dignum Umea University, Mehdi Dastani , Gabriele Keller Utrecht University
Pre-print
14:00 - 15:00
Doctoral Symposium Panel (open)Doctoral Symposium at Room 3
14:00
60m
Panel
Doctoral Symposium Panel (Open)
Doctoral Symposium

15:00 - 15:30
Coffee BreakSocial
15:00
30m
Coffee break
Break
Social

15:00 - 15:30
15:00
30m
Poster
gptCombFuzz: Combinatorial Oriented LLM Seed Generation for effective Fuzzing
Posters
Darshan Lohiya , Golla Monika Rani , Sangharatna Godboley National Institute of Technology Warangal, Radha Krishna Pisipati
15:00
30m
Poster
Towards Understanding Root Causes of Real Failures in Healthcare Machine Learning Applications
Posters
Guna Sekaran Jaganathan , Nazmul Kazi , Indika Kahanda University of North Florida, Upulee Kanewala University of North Florida
15:00
30m
Poster
VeriSol-MCE: Verification-based condition coverage analysis of Smart Contracts using Model Checker Engines
Posters
Sangharatna Godboley National Institute of Technology Warangal, Radha Krishna Pisipati
15:00
30m
Research paper
Causal Test Adequacy
Research Papers
Michael Foster The University of Sheffield, Christopher Wild , Neil Walkinshaw University of Sheffield, Robert Hierons The University of Sheffield
15:00
30m
Industry talk
BugOut: Automated Test Generation and Bug Detection for Low-Code
Industry
15:00
30m
Industry talk
In industrial embedded software, are some compilation errors easier to localize and fix than others?
Industry
Han Fu , Sigrid Eldh Ericsson AB, Mälardalen University, Carleton Unviersity, Kristian Wiklund Ericsson AB, Andreas Ermedahl , Philipp Haller KTH Royal Institute of Technology, Cyrille Artho KTH Royal Institute of Technology, Sweden
15:00
30m
Industry talk
Metamorphic Testing of an Autonomous Delivery Robots Scheduler
Industry
Thomas Laurent Lero@Trinity College Dublin, Paolo Arcaini National Institute of Informatics , Xiao-Yi Zhang , Fuyuki Ishikawa National Institute of Informatics
Pre-print
15:00
30m
Doctoral symposium paper
Agile Regression Testing
Doctoral Symposium
Suddhasvatta Das Arizona State University
15:00
30m
Doctoral symposium paper
Insights into System Failures: ML-Assisted Testing and Failure Models for Cyber-Physical Systems
Doctoral Symposium
Baharin Aliashrafi Jodat University of Ottawa
15:00
30m
Doctoral symposium paper
Search-based Security Testing of Enterprise Microservices
Doctoral Symposium
Susruthan Seran , Susruthan Seran Kristiania University College
15:00
30m
Doctoral symposium paper
Teaching Model-Driven Engineering from a model-testing perspective
Doctoral Symposium
Felix Cammaerts KU Leuven
File Attached
15:30 - 16:30
Most Influential PaperMost Influential Paper at Room 1
Chair(s): Gregory Gay Chalmers | University of Gothenburg, Shiva Nejati University of Ottawa
15:30
60m
Talk
Ask the Mutants: Mutating Faulty Programs for Fault Localization
Most Influential Paper
Seokhyeon Moon Samsung SDS, Yunho Kim Hanyang University, Moonzoo Kim KAIST / VPlusLab Inc. , Shin Yoo Korea Advanced Institute of Science and Technology
17:00 - 22:30
BanquetSocial
17:00
5h30m
Dinner
Dinner
Social

Fri 31 May

Displayed time zone: Eastern Time (US & Canada) change

08:00 - 09:00
BreakfastSocial
08:00
60m
Other
Breakfast & Registration
Social

09:00 - 09:15
AwardsSocial at Room 1
09:00
15m
Awards
Awards
Social
Shiva Nejati University of Ottawa, Gregory Gay Chalmers | University of Gothenburg
09:15 - 10:30
Keynote IV - Danny TarlowKeynotes at Room 1
Chair(s): Hadi Hemmati York University
09:15
75m
Keynote
DIDACT: Large sequence models for software development activities
Keynotes
10:30 - 11:00
Coffee BreakSocial
10:30
30m
Coffee break
Break
Social

11:00 - 12:20
Testing and ApplicationsResearch Papers / Testing Tools and Demonstration / Industry at Room 1
Chair(s): Jeremy Bradbury Ontario Tech University
11:00
20m
Industry talk
In industrial embedded software, are some compilation errors easier to localize and fix than others?
Industry
Han Fu , Sigrid Eldh Ericsson AB, Mälardalen University, Carleton Unviersity, Kristian Wiklund Ericsson AB, Andreas Ermedahl , Philipp Haller KTH Royal Institute of Technology, Cyrille Artho KTH Royal Institute of Technology, Sweden
11:20
20m
Research paper
Brewing Up Reliability: Espresso Test Generation for Android Apps
Research Papers
Iván Arcuschin Moreno University of Buenos Aires, Argentina, Lisandro Di Meo , Michael Auer University of Passau, Juan Pablo Galeotti University of Buenos Aires, Gordon Fraser University of Passau
11:40
20m
Research paper
Differential Optimization Testing of Gremlin-Based Graph Database Systems
Research Papers
Yingying Zheng Institute of Software Chinese Academy of Sciences, Wensheng Dou Institute of Software Chinese Academy of Sciences, Lei Tang Institute of Software Chinese Academy of Sciences, Ziyu Cui Institute of Software Chinese Academy of Sciences, Jiansen Song Institute of Software Chinese Academy of Sciences, Ziyue Cheng , Wei Wang , Jun Wei Institute of Software at Chinese Academy of Sciences; University of Chinese Academy of Sciences; University of Chinese Academy of Sciences Chongqing School, Hua Zhong , Tao Huang Institute of Software Chinese Academy of Sciences
12:00
10m
Demonstration
MLHCBugs: A Framework to Reproduce Real Faults in Healthcare Machine Learning Applications
Testing Tools and Demonstration
Guna Sekaran Jaganathan , Nazmul Kazi , Indika Kahanda University of North Florida, Upulee Kanewala University of North Florida
12:10
10m
Demonstration
The GitHub Recent Bugs Dataset for Evaluating LLM-based Debugging Applications
Testing Tools and Demonstration
Jae Yong Lee , Sungmin Kang , Juyeon Yoon Korea Advanced Institute of Science and Technology, Shin Yoo Korea Advanced Institute of Science and Technology
11:00 - 12:20
Testing with and for Deep and Reinforcement LearningResearch Papers / Industry at Room 2
Chair(s): Sahar Tahvili Ericsson AB
11:00
20m
Research paper
METAL: Metamorphic Testing Framework for Analyzing Large-Language Model Qualities
Research Papers
Sangwon Hyun University of Adelaide, Mingyu Guo , Muhammad Ali Babar School of Computer Science, The University of Adelaide
11:20
20m
Industry talk
End-to-end RPA-like testing using reinforcement learning
Industry
Ciprian Paduraru University of Bucharest, Rares Cristea University of Bucharest, Alin Stefanescu University of Bucharest
11:40
20m
Research paper
Spectral Analysis of the Relation between Deep Learning Faults and Neural Activation Values
Research Papers
Nargiz Humbatova USI Lugano, Gunel Jahangirova King's College London, Paolo Tonella USI Lugano
12:00
20m
Research paper
Learning Environment Models with Continuous Stochastic Dynamics - with an Application to Deep RL Testing
Research Papers
Martin Tappler TU Wien, Austria, Edi Muskardin , Bernhard Aichernig Graz University of Technology, Bettina Könighofer
12:30 - 13:30
LunchSocial
12:30
60m
Lunch
Lunch
Social

13:30 - 14:30
Testing and RepairResearch Papers / Industry at Room 1
Chair(s): August Shi The University of Texas at Austin
13:30
20m
Research paper
Evolutionary Testing for Program Repair
Research Papers
Haifeng Ruan , Hoang Lam Nguyen Humboldt-Universität zu Berlin, Ridwan Salihin Shariffdeen National University of Singapore, Yannic Noller Singapore University of Technology and Design, Abhik Roychoudhury National University of Singapore
13:50
20m
Research paper
Does Going Beyond Branch Coverage Make Program Repair Tools More Reliable?
Research Papers
Amirfarhad Nilizadeh University of Central Florida, Gary T. Leavens University of Central Florida, Corina Pasareanu CMU, NASA, KBR, Xuan-Bach D. Le The University of Melbourne, David Cok CEA, LIST, Software Safety and Security Laboratory
14:10
20m
Industry talk
SafeRevert: When Can Breaking Changes be Automatically Reverted?
Industry
Pre-print
13:30 - 14:30
Metamorphic and Combinatorial TestingIndustry / Journal-First Papers at Room 2
Chair(s): Wishnu Prasetya Utrecht University
13:30
20m
Industry talk
Metamorphic Testing of an Autonomous Delivery Robots Scheduler
Industry
Thomas Laurent Lero@Trinity College Dublin, Paolo Arcaini National Institute of Informatics , Xiao-Yi Zhang , Fuyuki Ishikawa National Institute of Informatics
Pre-print
13:50
20m
Long-paper
Design, implementation, and validation of a benchmark generator for combinatorial interaction testing tools
Journal-First Papers
Andrea Bombarda University of Bergamo, Angelo Gargantini University of Bergamo
14:30 - 15:30
Fishbowl PanelKeynotes at Room 1
Chair(s): Gregory Gay Chalmers | University of Gothenburg
14:30
60m
Panel
Fishbowl Panel - The Role of AI in Software Testing
Keynotes
Joana Coutinho , Mehrdad Saadatmand RISE Research Institutes of Sweden, Shaukat Ali Simula Research Laboratory and Oslo Metropolitan University, Renzo Degiovanni Luxembourg Institute of Science and Technology
15:30 - 16:00
Coffee BreakSocial
15:30
30m
Coffee break
Break
Social

16:00 - 16:30
ClosingSocial at Room 1
Chair(s): Hadi Hemmati York University, Gregory Gay Chalmers | University of Gothenburg, Shiva Nejati University of Ottawa
16:00
30m
Day closing
Closing
Social

Hide past events