Several experience reports illustrate that mutation testing is capable of supporting a ``shift-left'' testing strategy for software systems coded in textual programming languages like C++. For graphical modelling languages like Simulink, such experience reports are missing, primarily because of a lack of adequate tool support. In this paper we present a proof-of-concept (named MUT4SLX) for automatic mutant generation and test execution of Simulink models. MUT4SLX features 15 mutation operators which are modelled after realistic faults (mined from an industrial bug database) and are fast to inject (because we only replace parameter values within blocks). An experimental evaluation on a sample project (a Helicopter Control System) demonstrates that MUT4SLX is capable of injecting 70 mutants in less than a second, resulting in a total analysis time of 8.14 hours.
The tool is available at: https://github.com/haliliceylan/MUT4SLX/ and the demonstration video can be found at: https://youtu.be/inud_NRGutc.
| [Presentation] MUT4SLX: Fast Mutation Testing for Simulink (Ceylan2023-ASE-v2.pdf) | 1.57MiB |
| [Preprint] MUT4SLX: Fast Mutant Generation for Simulink (ceylan2023ase-preprint.pdf) | 383KiB |
Thu 14 SepDisplayed time zone: Amsterdam, Berlin, Bern, Rome, Stockholm, Vienna change
13:30 - 15:00 | Software Testing for Specialized Systems 3Journal-first Papers / Tool Demonstrations / Research Papers at Plenary Room 2 Chair(s): Xiaoyin Wang University of Texas at San Antonio | ||
13:30 12mTalk | An Image is Worth a Thousand Toxic Words: A Metamorphic Testing Framework for Content Moderation Software Research Papers Wenxuan Wang Chinese University of Hong Kong, Jingyuan Huang Chinese University of Hong Kong, Jen-tse Huang The Chinese University of Hong Kong, Chang Chen Chinese University of Hong Kong, Jiazhen Gu Chinese University of Hong Kong, Pinjia He Chinese University of Hong Kong, Shenzhen, Michael Lyu The Chinese University of Hong Kong File Attached | ||
13:42 12mTalk | CoMSA: A modeling driven sampling approach for configuration performance testing Research Papers Yuanjie Xia University of Waterloo, Zishuo Ding University of Waterloo, Weiyi Shang University of Waterloo Pre-print Media Attached | ||
13:54 12mTalk | DroneReqValidator: Facilitating High Fidelity Simulation Testing for Uncrewed Aerial Systems Developers Tool Demonstrations Bohan Zhang Saint Louis University, Missouri, Yashaswini Shivalingaiah Saint Louis University, Missouri, Ankit Agrawal Saint Louis University, Missouri Pre-print Media Attached File Attached | ||
14:06 12mTalk | Effective Concurrency Testing for Go via Directional Primitive-constrained Interleaving Exploration Research Papers Zongze Jiang Huazhong University of Science and Technology, Ming Wen Huazhong University of Science and Technology, Yixin Yang Huazhong University of Science and Technology, Chao Peng ByteDance, China, Ping Yang Bytedance Network Technology, Hai Jin Huazhong University of Science and Technology File Attached | ||
14:18 12mTalk | Fuzzing for CPS Mutation Testing Research Papers Jaekwon Lee University of Luxembourg, Luxembourg, Enrico Viganò University of Luxembourg, Oscar Cornejo University of Milano Bicocca, Italy, Fabrizio Pastore University of Luxembourg, Lionel Briand University of Luxembourg; University of Ottawa Pre-print File Attached | ||
14:30 12mTalk | MUT4SLX: Fast Mutation Testing for Simulink Tool Demonstrations Halil Ibrahim Ceylan University of Antwerp, Onur Kilincceker University of Antwerp and Flanders Make vzw, Mutlu Beyazıt University of Antwerp and Flanders Make vzw, Serge Demeyer University of Antwerp; Flanders Make Media Attached File Attached | ||
14:42 12mTalk | Machine learning-based test selection for simulation-based testing of self-driving cars software Journal-first Papers Christian Birchler Zurich University of Applied Sciences, Sajad Khatiri USI-Lugnao & Zurich University of Applied Sciences, Bill Bosshard Meier Planungsdienste GmbH, Alessio Gambi IMC University of Applied Sciences Krems, Sebastiano Panichella Zurich University of Applied Sciences | ||