Test Case Generation for Simulink Models using Model Fuzzing and State Solving
Simulink plays an important role in the industry for modeling and synthesis of embedded systems. Ensuring system stability requires using numerous test cases to validate the functionality and safety of the models. However, as requirements increase, the complexity of the models poses new challenges to traditional testing methods. Traditional methods such as constraint solving and random search run into significant obstacles when navigating the complex branching logic and states within models. In this paper, we introduce HybridTCG, a test case generation method by collaborating model fuzzing and state solving for Simulink models. First, HybridTCG starts a code-based fuzzer to generate high-coverage test cases rapidly. Then, it refines the test cases generated by the fuzzer, preserving only those that can achieve new model coverage. These selected test cases are input into the state-solving engine to derive corresponding states and resolve the constraints of subsequent branches. Ultimately, the test cases produced by the solving engine will be fed back into the fuzzer as high-quality seeds to enhance the fuzzing process. We have implemented HybridTCG and conducted a comprehensive evaluation using various benchmark Simulink models. Compared to the builtin Simulink Design Verifier and state-of-the-art academic work SimCoTest and STCG, HybridTCG achieves an average improvement of 54%, 108% and 24% on Decision Coverage, 50%, 62% and 6% on Condition Coverage, 291%, 282% and 45% on Modified Condition Decision Coverage, respectively. Moreover, HybridTCG is also much more efficient in testing than other tools.
Tue 29 OctDisplayed time zone: Pacific Time (US & Canada) change
13:30 - 15:00 | Testing 1Research Papers / Industry Showcase at Gardenia Chair(s): Jialun Cao Hong Kong University of Science and Technology | ||
13:30 15mTalk | Spotting Code Mutation for Predictive Mutation Testing Research Papers Yifan Zhao Peking University, Yizhou Chen Peking University, Zeyu Sun Institute of Software, Chinese Academy of Sciences, Qingyuan Liang Peking University, Guoqing Wang Peking University, Dan Hao Peking University | ||
13:45 15mTalk | Efficient Detection of Test Interference in C Projects Research Papers | ||
14:00 15mTalk | MR-Adopt: Automatic Deduction of Input Transformation Function for Metamorphic Testing Research Papers Congying Xu The Hong Kong University of Science and Technology, China, Songqiang Chen The Hong Kong University of Science and Technology, Jiarong Wu The Hong Kong University of Science and Technology, Shing-Chi Cheung Hong Kong University of Science and Technology, Valerio Terragni University of Auckland, Hengcheng Zhu The Hong Kong University of Science and Technology, Jialun Cao Hong Kong University of Science and Technology | ||
14:15 15mTalk | Approximation-guided Fairness Testing through Discriminatory Space Analysis Research Papers Zhenjiang Zhao Graduate School of Informatics and Engineering, University of Electro-Communications, Tokyo, Japan, Takahisa Toda The University of Electro-Communications, Takashi Kitamura | ||
14:30 15mTalk | Integrating Mutation Testing into Developer Workflow: An Industrial Case Study Industry Showcase Stefan Alexander van Heijningen Chalmers and University of Gothenburg, Theo Wiik Chalmers and University of Gothenburg, Francisco Gomes de Oliveira Neto Chalmers | University of Gothenburg, Gregory Gay Chalmers | University of Gothenburg, Kim Viggedal Zenseact, David Friberg Zenseact | ||
14:45 15mTalk | Test Case Generation for Simulink Models using Model Fuzzing and State Solving Research Papers Zhuo Su KLISS, BNRist, School of Software, Tsinghua University, Zehong Yu KLISS, BNRist, School of Software, Tsinghua University, Dongyan Wang Information Technology Center, Renmin University of China, Wanli Chang College of Computer Science and Electronic Engineering, Hunan University, Bin Gu Beijing Institute of Control Engineering, Yu Jiang Tsinghua University |