TCSE logo 
 Sigsoft logo
Sustainability badge
Wed 30 Apr 2025 11:45 - 12:00 at 205 - Testing and QA 1 Chair(s): Jonathan Bell

Falsification is a popular simulation-based testing method for Cyber-Physical Systems to find inputs that violate a formal requirement. It employs optimization algorithms to minimize a robustness metric that defines the satisfaction of a given property over an execution trace. Despite falsification representing an established approach, detecting violations considering many, possibly independent, requirements simultaneously, under flaky simulations is an open problem. We address this problem by proposing a novel approach that combines parametric model checking and many-objective optimization. We use parametric model checking to shift part of the complexity of the problem offline. We pre-compute numeric constraints for the satisfaction of all requirements on a parametric specification of the testing scenario. Flaky violations are then detected using many-objective optimization to explore the space of changing factors in the scenario and push the parameters out of all precomputed constraints. The results of our empirical evaluation using four open-source evaluation subjects with increasing complexity (number of requirements) show that our approach can falsify many requirements simultaneously, without hiding their individual contribution. The effectiveness, in terms of quantity and severity of violations, is significantly higher than random search as well as two selected state-of-the-art baseline approaches. Furthermore, the extra offline computation yields a negligible cost.

Wed 30 Apr

Displayed time zone: Eastern Time (US & Canada) change

11:00 - 12:30
Testing and QA 1Research Track / Journal-first Papers at 205
Chair(s): Jonathan Bell Northeastern University
11:00
15m
Talk
Critical Variable State-Aware Directed Greybox Fuzzing
Research Track
Xu Chen Institute of Information Engineering at Chinese Academy of Sciences, China / University of Chinese Academy of Sciences, China, Ningning Cui Institute of Information Engineering at Chinese Academy of Sciences, China / University of Chinese Academy of Sciences, China, Zhe Pan Institute of Information Engineering at Chinese Academy of Sciences, China / University of Chinese Academy of Sciences, China, Liwei Chen Institute of Information Engineering at Chinese Academy of Sciences; University of Chinese Academy of Sciences, Gang Shi Institute of Information Engineering at Chinese Academy of Sciences; University of Chinese Academy of Sciences, Dan Meng Institute of Information Engineering at Chinese Academy of Sciences; University of Chinese Academy of Sciences
11:15
15m
Talk
LWDIFF: An LLM-Assisted Differential Testing Framework for WebAssembly Runtimes
Research Track
Shiyao Zhou The Hong Kong Polytechnic University, Jincheng Wang Hong Kong Polytechnic University, He Ye University College London (UCL), Hao Zhou The Hong Kong Polytechnic University, Claire Le Goues Carnegie Mellon University, Xiapu Luo Hong Kong Polytechnic University
11:30
15m
Talk
No Harness, No Problem: Oracle-guided Harnessing for Auto-generating C API Fuzzing HarnessesArtifact-FunctionalArtifact-AvailableArtifact-Reusable
Research Track
Gabriel Sherman University of Utah, Stefan Nagy University of Utah
11:45
15m
Talk
Parametric Falsification of Many Probabilistic Requirements under Flakiness
Research Track
Matteo Camilli Politecnico di Milano, Raffaela Mirandola Karlsruhe Institute of Technology (KIT)
12:00
15m
Talk
REDII: Test Infrastructure to Enable Deterministic Reproduction of Failures for Distributed Systems
Research Track
Yang Feng Nanjing University, Zheyuan Lin Nanjing University, Dongchen Zhao Nanjing University, Mengbo Zhou Nanjing University, Jia Liu Nanjing University, James Jones University of California at Irvine
12:15
15m
Talk
Adopting Automated Bug Assignment in Practice - A Longitudinal Case Study at Ericsson
Journal-first Papers
Markus Borg CodeScene, Leif Jonsson Ericsson AB, Emelie Engstrom Lund University, Béla Bartalos Verint, Attila Szabo Ericsson
:
:
:
: