ICST 2024
Mon 27 - Fri 31 May 2024 Canada
Thu 30 May 2024 10:30 - 11:00 at Hall - Poster Session
Thu 30 May 2024 12:40 - 14:00 at Hall - Poster Session
Thu 30 May 2024 15:00 - 15:30 at Hall - Poster Session
Fri 31 May 2024 13:30 - 13:50 at Room 2 & 3 - Metamorphic and Combinatorial Testing Chair(s): Wishnu Prasetya

Delivery systems operated by autonomous robots use schedulers to allocate robots to the different orders. Such schedulers are often optimisation-based algorithms that aim to maximise the number of delivered goods. The oracle problem affects the testing of these schedulers, as it is not always possible to assess whether the schedule produced for a given scenario is the optimal one. In this work, we propose a framework, based on a novel use of metamorphic testing, to assess the optimality of the scheduling algorithm developed by Panasonic for the management of a fleet of autonomous delivery robots in the Fujisawa Sustainable Smart Town, Japan. In the framework, a metamorphic relation (MR) transforms a source test case in a followup test case in a predefined way, and compares the results of the execution of the two tests in a simulated environment: if the comparison violates the expected relation, we can claim that one of the two schedules produced by the scheduler is suboptimal. We propose 19 MRs that target different aspects of the delivery system. Experiments over more than 900,000 test cases show that the different MRs have different abilities in exposing suboptimal behaviour and that most of the MRs do not subsume each other. Moreover, they also show that MR violations can provide useful insights into the scheduler’s behaviour to Panasonic’s engineers.

Thu 30 May

Displayed time zone: Eastern Time (US & Canada) change

10:30 - 11:00
10:30
30m
Poster
gptCombFuzz: Combinatorial Oriented LLM Seed Generation for effective Fuzzing
Posters
Darshan Lohiya , Golla Monika Rani , Sangharatna Godboley National Institute of Technology Warangal, Radha Krishna Pisipati
10:30
30m
Poster
Towards Understanding Root Causes of Real Failures in Healthcare Machine Learning Applications
Posters
Guna Sekaran Jaganathan , Nazmul Kazi , Indika Kahanda University of North Florida, Upulee Kanewala University of North Florida
10:30
30m
Poster
VeriSol-MCE: Verification-based condition coverage analysis of Smart Contracts using Model Checker Engines
Posters
Sangharatna Godboley National Institute of Technology Warangal, Radha Krishna Pisipati
10:30
30m
Research paper
Causal Test Adequacy
Research Papers
Michael Foster The University of Sheffield, Christopher Wild , Neil Walkinshaw University of Sheffield, Robert Hierons The University of Sheffield
10:30
30m
Industry talk
BugOut: Automated Test Generation and Bug Detection for Low-Code
Industry
10:30
30m
Industry talk
In industrial embedded software, are some compilation errors easier to localize and fix than others?
Industry
Han Fu , Sigrid Eldh Ericsson AB, Mälardalen University, Carleton Unviersity, Kristian Wiklund Ericsson AB, Andreas Ermedahl , Philipp Haller KTH Royal Institute of Technology, Cyrille Artho KTH Royal Institute of Technology, Sweden
10:30
30m
Industry talk
Metamorphic Testing of an Autonomous Delivery Robots Scheduler
Industry
Thomas Laurent Lero@Trinity College Dublin, Paolo Arcaini National Institute of Informatics , Xiao-Yi Zhang , Fuyuki Ishikawa National Institute of Informatics
Pre-print
10:30
30m
Doctoral symposium paper
Agile Regression Testing
Doctoral Symposium
Suddhasvatta Das Arizona State University
10:30
30m
Doctoral symposium paper
Insights into System Failures: ML-Assisted Testing and Failure Models for Cyber-Physical Systems
Doctoral Symposium
Baharin Aliashrafi Jodat University of Ottawa
10:30
30m
Doctoral symposium paper
Search-based Security Testing of Enterprise Microservices
Doctoral Symposium
Susruthan Seran , Susruthan Seran Kristiania University College
10:30
30m
Doctoral symposium paper
Teaching Model-Driven Engineering from a model-testing perspective
Doctoral Symposium
Felix Cammaerts KU Leuven
File Attached
12:40 - 14:00
12:40
80m
Poster
gptCombFuzz: Combinatorial Oriented LLM Seed Generation for effective Fuzzing
Posters
Darshan Lohiya , Golla Monika Rani , Sangharatna Godboley National Institute of Technology Warangal, Radha Krishna Pisipati
12:40
80m
Poster
Towards Understanding Root Causes of Real Failures in Healthcare Machine Learning Applications
Posters
Guna Sekaran Jaganathan , Nazmul Kazi , Indika Kahanda University of North Florida, Upulee Kanewala University of North Florida
12:40
80m
Poster
VeriSol-MCE: Verification-based condition coverage analysis of Smart Contracts using Model Checker Engines
Posters
Sangharatna Godboley National Institute of Technology Warangal, Radha Krishna Pisipati
12:40
80m
Research paper
Causal Test Adequacy
Research Papers
Michael Foster The University of Sheffield, Christopher Wild , Neil Walkinshaw University of Sheffield, Robert Hierons The University of Sheffield
12:40
80m
Industry talk
BugOut: Automated Test Generation and Bug Detection for Low-Code
Industry
12:40
80m
Industry talk
In industrial embedded software, are some compilation errors easier to localize and fix than others?
Industry
Han Fu , Sigrid Eldh Ericsson AB, Mälardalen University, Carleton Unviersity, Kristian Wiklund Ericsson AB, Andreas Ermedahl , Philipp Haller KTH Royal Institute of Technology, Cyrille Artho KTH Royal Institute of Technology, Sweden
12:40
80m
Industry talk
Metamorphic Testing of an Autonomous Delivery Robots Scheduler
Industry
Thomas Laurent Lero@Trinity College Dublin, Paolo Arcaini National Institute of Informatics , Xiao-Yi Zhang , Fuyuki Ishikawa National Institute of Informatics
Pre-print
12:40
80m
Doctoral symposium paper
Agile Regression Testing
Doctoral Symposium
Suddhasvatta Das Arizona State University
12:40
80m
Doctoral symposium paper
Insights into System Failures: ML-Assisted Testing and Failure Models for Cyber-Physical Systems
Doctoral Symposium
Baharin Aliashrafi Jodat University of Ottawa
12:40
80m
Doctoral symposium paper
Search-based Security Testing of Enterprise Microservices
Doctoral Symposium
Susruthan Seran , Susruthan Seran Kristiania University College
12:40
80m
Doctoral symposium paper
Teaching Model-Driven Engineering from a model-testing perspective
Doctoral Symposium
Felix Cammaerts KU Leuven
File Attached
15:00 - 15:30
15:00
30m
Poster
gptCombFuzz: Combinatorial Oriented LLM Seed Generation for effective Fuzzing
Posters
Darshan Lohiya , Golla Monika Rani , Sangharatna Godboley National Institute of Technology Warangal, Radha Krishna Pisipati
15:00
30m
Poster
Towards Understanding Root Causes of Real Failures in Healthcare Machine Learning Applications
Posters
Guna Sekaran Jaganathan , Nazmul Kazi , Indika Kahanda University of North Florida, Upulee Kanewala University of North Florida
15:00
30m
Poster
VeriSol-MCE: Verification-based condition coverage analysis of Smart Contracts using Model Checker Engines
Posters
Sangharatna Godboley National Institute of Technology Warangal, Radha Krishna Pisipati
15:00
30m
Research paper
Causal Test Adequacy
Research Papers
Michael Foster The University of Sheffield, Christopher Wild , Neil Walkinshaw University of Sheffield, Robert Hierons The University of Sheffield
15:00
30m
Industry talk
BugOut: Automated Test Generation and Bug Detection for Low-Code
Industry
15:00
30m
Industry talk
In industrial embedded software, are some compilation errors easier to localize and fix than others?
Industry
Han Fu , Sigrid Eldh Ericsson AB, Mälardalen University, Carleton Unviersity, Kristian Wiklund Ericsson AB, Andreas Ermedahl , Philipp Haller KTH Royal Institute of Technology, Cyrille Artho KTH Royal Institute of Technology, Sweden
15:00
30m
Industry talk
Metamorphic Testing of an Autonomous Delivery Robots Scheduler
Industry
Thomas Laurent Lero@Trinity College Dublin, Paolo Arcaini National Institute of Informatics , Xiao-Yi Zhang , Fuyuki Ishikawa National Institute of Informatics
Pre-print
15:00
30m
Doctoral symposium paper
Agile Regression Testing
Doctoral Symposium
Suddhasvatta Das Arizona State University
15:00
30m
Doctoral symposium paper
Insights into System Failures: ML-Assisted Testing and Failure Models for Cyber-Physical Systems
Doctoral Symposium
Baharin Aliashrafi Jodat University of Ottawa
15:00
30m
Doctoral symposium paper
Search-based Security Testing of Enterprise Microservices
Doctoral Symposium
Susruthan Seran , Susruthan Seran Kristiania University College
15:00
30m
Doctoral symposium paper
Teaching Model-Driven Engineering from a model-testing perspective
Doctoral Symposium
Felix Cammaerts KU Leuven
File Attached

Fri 31 May

Displayed time zone: Eastern Time (US & Canada) change

13:30 - 14:30
Metamorphic and Combinatorial TestingIndustry / Journal-First Papers at Room 2 & 3
Chair(s): Wishnu Prasetya Utrecht University
13:30
20m
Industry talk
Metamorphic Testing of an Autonomous Delivery Robots Scheduler
Industry
Thomas Laurent Lero@Trinity College Dublin, Paolo Arcaini National Institute of Informatics , Xiao-Yi Zhang , Fuyuki Ishikawa National Institute of Informatics
Pre-print
13:50
20m
Long-paper
Design, implementation, and validation of a benchmark generator for combinatorial interaction testing tools
Journal-First Papers
Andrea Bombarda University of Bergamo, Angelo Gargantini University of Bergamo