Signal Feature Coverage and Testing for CPS Dataflow Models
Design of cyber-physical systems (CPS) typically involves dataflow modelling. The structure of dataflow models differs from the traditional software, making standard coverage metrics not appropriate for measuring the thoroughness of testing. To address this limitation, this paper proposes \emph{signal feature coverage} as a new coverage metric for systematically testing CPS dataflow models. We derive signal feature coverage by leveraging signal features. We developed a testing framework in Simulink, a popular dataflow modelling and simulation environment, that automates the generation and execution of test cases based on the defined coverage metric. We evaluated the effectiveness of our approach by carrying out experiments on five Simulink models tested against ten Signal Temporal Logic specifications. We compared our coverage-based testing approach to adaptive random testing, falsification testing, output diversity-based approaches, and testing using MathWorks’ Simulink Design Verifier. The results demonstrate that our coverage-based testing approach outperforms the conventional techniques regarding fault detection capability.
Wed 15 AprDisplayed time zone: Brasilia, Distrito Federal, Brazil change
11:00 - 12:30 | Testing and Analysis 2Journal-first Papers / SE In Practice (SEIP) / Research Track at Oceania II Chair(s): Andrea Stocco Technical University of Munich, fortiss | ||
11:00 15mTalk | An industrial experience report on applying search-based boundary input generation to cyber-physical systems Journal-first Papers Pablo Valle Mondragon University, Vincenzo Riccio University of Udine, Aitor Arrieta Mondragon University, Paolo Tonella USI Lugano, Maite Arratibel Orona | ||
11:15 15mTalk | Testing CPS with Design Assumptions-Based Metamorphic Relations and Genetic Programming Journal-first Papers Claudio Mandrioli University of Luxembourg, Seung Yeob Shin University of Luxembourg, Domenico Bianculli University of Luxembourg, Lionel Briand University of Ottawa, Canada; Lero centre, University of Limerick, Ireland Link to publication DOI Pre-print | ||
11:30 15mTalk | Signal Feature Coverage and Testing for CPS Dataflow Models Journal-first Papers Ezio Bartocci TU Wien, Leonardo Mariani University of Milano-Bicocca, Dejan Nickovic Austrian Institute of Technology, Drishti Yadav University of Luxembourg, Luxembourg | ||
11:45 15mTalk | Uncovering Failures in Cyber-Physical System State Transitions: A Fuzzing-Based Approach Applied to sUAS Research Track Theodore Chambers University of Notre Dame, Arturo Miguel Russell Bernal University of Notre Dame, Michael Vierhauser University of Innsbruck, Jane Cleland-Huang University of Notre Dame Pre-print | ||
12:00 15mTalk | Vision Language Model-based Testing of Industrial Autonomous Mobile Robots SE In Practice (SEIP) Jiahui Wu Simula Research Laboratory and University of Oslo, Chengjie Lu Simula Research Laboratory and University of Oslo, Aitor Arrieta Mondragon University, Shaukat Ali Simula Research Laboratory and Oslo Metropolitan University, Thomas Peyrucain PAL Robotics | ||
12:15 15mTalk | Misbehavior Forecasting for Focused Autonomous Driving Systems Testing Research Track M M Abid Naziri North Carolina State University, Stefano Carlo Lambertenghi Technische Universität München, fortiss GmbH, Andrea Stocco Technical University of Munich, fortiss, Marcelo d'Amorim North Carolina State University Pre-print | ||