Time-Aware Coverage Criteria for Testing of AI-Enabled Hybrid Control Systems
Modern Cyber-Physical Systems (CPSs) that need to perform complex control tasks (e.g., autonomous driving) are increasingly using AI-enabled controllers, mainly based on deep neural networks (DNNs). The quality assurance of such types of systems is of vital importance. However, their verification can be extremely challenging, due to their complexity and uninterpretable decision logic. Falsification is an established approach for CPS quality assurance, which, instead of attempting to prove the system correctness, aims at finding a time-variant input signal violating a formal specification describing the desired behaviour; it often employs a search-based testing approach that tries to minimize the robustness of the specification, given by its quantitative semantics. However, guidance provided by robustness is mostly black-box and only related to the system output, but does not allow to understand whether the temporal internal behaviour of the neural network controller has been explored sufficiently. To bridge this gap, in this paper, we make an early attempt and first propose four time-aware coverage criteria specifically designed for neural network controllers in the context of CPS, which consider different features by design: the simple temporal activation of a neuron, the continuous activation of a neuron for a given duration, and the differential neuron activation behavior over time. We further show that these criteria can be employed in the falsification process, by providing more exploration in the search. Preliminary experiments have been performed on Adaptive Cruise Control system, and show that considering coverage during falsification increases the falsification rate.
Wed 17 NovDisplayed time zone: Hobart change
20:00 - 21:00 | LBR + DS Poster (1) (Wed 07:00 - 10:00)Doctoral Symposium / Late Breaking Results at Kangaroo Chair(s): Maria Spichkova RMIT University, Australia | ||
20:00 2mTalk | Time-Aware Coverage Criteria for Testing of AI-Enabled Hybrid Control Systems Late Breaking Results Zhenya Zhang Kyushu University, Deyun Lyu Kyushu university, Paolo Arcaini National Institute of Informatics
, Lei Ma University of Alberta, Ichiro Hasuo National Institute of Informatics, Japan, Jianjun Zhao Kyushu University | ||
20:02 2mTalk | Metamorphic Testing on Multi-module UAV Systems Late Breaking Results Rui Li Swinburne University of Technology, Huai Liu Swinburne University of Technology, Guannan Lou Macquarie University, Xi Zheng Macquarie University, Xiao Liu School of Information Technology, Deakin University, Tsong Yueh Chen Swinburne University of Technology | ||
20:04 2mTalk | Quality analysis of mobile applications with special focus on security aspects Doctoral Symposium Kristiina Rahkema University of Tartu Pre-print | ||
20:06 2mTalk | Semi-automated Cross-Component Issue Management and Impact Analysis Doctoral Symposium Sandro Speth Institute of Software Engineering, University of Stuttgart File Attached | ||
20:08 2mTalk | Cross-Lingual Transfer Learning Framework for Program Analysis Doctoral Symposium Zhiming Li Nanyang Technological University, Singapore | ||
20:10 2mTalk | Decoupling Server and Client Code Through Cloud-Native Domain-Specific Functions Late Breaking Results José Miguel Pérez-Álvarez NAVER LABS Europe, Adrian Mos NAVER LABS Europe, Benjamin V. Hanrahan Pennsylvania State University, Iyadunni J. Adenuga Pennsylvania State University | ||
20:12 2mTalk | Tackling Flaky Tests: Understanding the Problem and Providing Practical Solutions Doctoral Symposium Martin Gruber BMW Group, University of Passau File Attached | ||
20:14 2mTalk | Effectively Analyzing Evolving Software with Differential Facts Doctoral Symposium Xiuheng Wu Nanyang Technological University File Attached | ||
20:16 2mTalk | Automatically Annotating Sentences for Task-specific Bug Report Summarization Late Breaking Results Akalanka Galappaththi University of Alberta, John Anvik University of Lethbridge, Rafat Bin Islam University of Lethbridge | ||
20:18 2mTalk | Genetic Optimisation of C++ Applications Late Breaking Results Rafail Giavrimis Turing Intelligence Technology, Alexis Butler Turing Intelligence Technology, Constantin Cezar Petrescu University of Surrey, Michail Basios Turing Intelligence Technology, Santanu Dash University of Surrey, UK | ||
20:20 2mTalk | Revisiting Textual Feature of Bug-Triage Approach Late Breaking Results | ||
20:22 2mTalk | Training Automated Test Oracles to Identify Semantic Bugs Doctoral Symposium Charaka Geethal Monash University File Attached | ||
20:24 2mTalk | Automated Approach for System-level Testing of Unmanned Aerial Systems Doctoral Symposium Hassan Sartaj National University of Computer and Emerging Sciences, Islamabad, Pakistan File Attached | ||
20:26 2mTalk | How can Subgroup Discovery help AIOps? Doctoral Symposium Youcef REMIL INSA Lyon, INFOLOGIC, Anes Bendimerad Infologic, Mehdi Kaytoue INFOLOGIC, Jean-François Boulicaut INSA Lyon Pre-print | ||
20:28 2mTalk | Gas Estimation and Optimization for Smart Contracts on Ethereum Doctoral Symposium Chunmiao Li National Institute of Informatics Pre-print | ||
20:30 2mTalk | Fuzzing Methods Recommendation Based on Feature Vectors Doctoral Symposium Chi Zhang Jiangsu University File Attached |