ICST 2024
Mon 27 - Fri 31 May 2024 Canada
Tue 28 May 2024 11:45 - 12:07 at Room 1 - Session 2 (Papers 2)

Verification and validation of a software system to ensure compliance with the specification and intended functional behaviour often pose a challenge when it lacks an explicit test oracle. We present an efficient black-box metamorphic testing approach in which test cases are automatically generated based on metamorphic transformations. The hyperparameters of several metamorphic transformations are optimized on the fly using a generative AI with a feedback loop for optimal test generation and test suite minimization. The proposed method uses several combined metamorphic relations to define test inputs and to determine the test verdict. The feedback on test quality is evaluated based on the metamorphic relation’s fitness function and used to optimize the next iterations of test generation. The effectiveness of the proposed approach is evaluated on an industrial case study of a crane’s load position system which lacks an explicit test oracle. The experimental results confirm that optimizing the morphing transformations using the feedback loop improves the effectiveness of metamorphic test input generation. The outcome of the study shows that the approach can be potentially applied for functional safety verification in software systems with a test oracle problem.

Tue 28 May

Displayed time zone: Eastern Time (US & Canada) change

11:00 - 12:30
Session 2 (Papers 2)AIST at Room 1
11:00
22m
Talk
"No Free Lunch" when using Large Language Models to Verify Self-Generated Programs
AIST
Sol Zilberman Michigan State University, Betty H.C. Cheng Michigan State University
11:22
22m
Talk
An End-to-End Test Case Prioritization Framework using Optimized Machine Learning Models
AIST
Md Asif Khan Ontario Tech University, Akramul Azim Ontario Tech University, Ramiro Liscano Ontario Tech University, Kevin Smith International Business Machines Corporation (IBM), Yee-Kang Chang International Business Machines Corporation (IBM), Qasim Tauseef International Business Machines Corporation (IBM), Gkerta Seferi International Business Machines Corporation (IBM)
11:45
22m
Talk
Iterative Optimization of Hyperparameter-based Metamorphic Transformations
AIST
Gaadha Sudheerbabu Åbo Akademi University, Tanwir Ahmad Åbo Akademi University, Dragos Truscan Åbo Akademi University, Jüri Vain Tallinn University of Technology, Estonia, Ivan Porres Åbo Akademi University
12:07
22m
Talk
Machine Learning for Cross-Vulnerability Prediction in Smart Contracts
AIST
Hajra Naeem Toronto Metropolitan University, Manar H. Alalfi