ICST 2023
Sun 16 - Thu 20 April 2023 Dublin, Ireland

Unmanned aerial vehicles (UAVs), also known as drones, are acquiring increasing autonomy. With their commercial adoption, the problem of testing their functional and non-functional, and in particular their safety requirements has become a critical concern. Simulation-based testing represents a fundamental practice, but the testing scenarios considered in software-in-the-loop testing may not be representative of the actual scenarios experienced in the field. In this paper, we propose SURREALIST (teSting UAVs in the neighboRhood of REAl flIghtS), a novel search-based approach that analyses the logs from real UAV flights and automatically generates simulation-based test cases in the neighborhood of such real flights, thereby improving the realism and representativeness of the simulation-based tests. This is done in two steps: first, SURREALIST faithfully replicates the given UAV flight in the simulation environment, generating a simulation-based test that mirrors a pre-logged real-world behavior. Then, it smoothly manipulates the replicated flight conditions to discover slightly modified test cases that are challenging or trigger misbehavior of the UAV under test in simulation. In our experiments, we were able to replicate a real flight accurately in the simulation environment and to expose unstable and potentially unsafe behavior in the neighborhood of a replicated flight, which even led to crashes.

Mon 17 Apr

Displayed time zone: Dublin change

14:00 - 15:30
Session 3: Autonomous & Cyberphysical Systems IIPrevious Editions / Industry / Research Papers at Grand canal
Chair(s): Fabrizio Pastore University of Luxembourg
14:00
20m
Talk
Test Maintenance for Machine Learning Systems: A Case Study in the Automotive Industry
Industry
Lukas Berglund Chalmers | University of Gothenburg, Tim Grube Chalmers | University of Gothenburg, Gregory Gay Chalmers | University of Gothenburg, Francisco Gomes de Oliveira Neto Chalmers University of Technology, Sweden / University of Gothenburg, Sweden, Dimitrios Platis Zenseact
14:20
20m
Talk
Digital Twin-based Anomaly Detection in Cyber-physical Systems
Previous Editions
Xu Qinghua , Shaukat Ali Simula Research Laboratory, Tao Yue Simula Research Laboratory
DOI
14:40
20m
Talk
Quality Metrics and Oracles for Autonomous Vehicles Testing
Previous Editions
Gunel Jahangirova USI Lugano, Switzerland, Andrea Stocco Technical University of Munich & fortiss, Paolo Tonella USI Lugano
DOI
15:00
20m
Talk
Simulation-based Test Case Generation for Unmanned Aerial Vehicles in the Neighborhood of Real Flights
Research Papers
Sajad Khatiri USI-Lugnao & Zurich University of Applied Sciences, Sebastiano Panichella Zurich University of Applied Sciences, Paolo Tonella USI Lugano
Pre-print