Simulation-based Test Case Generation for Unmanned Aerial Vehicles in the Neighborhood of Real Flights
Unmanned aerial vehicles (UAVs), also known as drones, are acquiring increasing autonomy. With their commercial adoption, the problem of testing their functional and non-functional, and in particular their safety requirements has become a critical concern. Simulation-based testing represents a fundamental practice, but the testing scenarios considered in software-in-the-loop testing may not be representative of the actual scenarios experienced in the field. In this paper, we propose SURREALIST (teSting UAVs in the neighboRhood of REAl flIghtS), a novel search-based approach that analyses the logs from real UAV flights and automatically generates simulation-based test cases in the neighborhood of such real flights, thereby improving the realism and representativeness of the simulation-based tests. This is done in two steps: first, SURREALIST faithfully replicates the given UAV flight in the simulation environment, generating a simulation-based test that mirrors a pre-logged real-world behavior. Then, it smoothly manipulates the replicated flight conditions to discover slightly modified test cases that are challenging or trigger misbehavior of the UAV under test in simulation. In our experiments, we were able to replicate a real flight accurately in the simulation environment and to expose unstable and potentially unsafe behavior in the neighborhood of a replicated flight, which even led to crashes.
Mon 17 AprDisplayed time zone: Dublin change
14:00 - 15:30 | Session 3: Autonomous & Cyberphysical Systems IIPrevious Editions / Industry / Research Papers at Grand canal Chair(s): Fabrizio Pastore University of Luxembourg | ||
14:00 20mTalk | Test Maintenance for Machine Learning Systems: A Case Study in the Automotive Industry Industry Lukas Berglund Chalmers | University of Gothenburg, Tim Grube Chalmers | University of Gothenburg, Gregory Gay Chalmers | University of Gothenburg, Francisco Gomes de Oliveira Neto Chalmers University of Technology, Sweden / University of Gothenburg, Sweden, Dimitrios Platis Zenseact | ||
14:20 20mTalk | Digital Twin-based Anomaly Detection in Cyber-physical Systems Previous Editions DOI | ||
14:40 20mTalk | Quality Metrics and Oracles for Autonomous Vehicles Testing Previous Editions Gunel Jahangirova USI Lugano, Switzerland, Andrea Stocco Technical University of Munich & fortiss, Paolo Tonella USI Lugano DOI | ||
15:00 20mTalk | Simulation-based Test Case Generation for Unmanned Aerial Vehicles in the Neighborhood of Real Flights Research Papers Sajad Khatiri USI-Lugnao & Zurich University of Applied Sciences, Sebastiano Panichella Zurich University of Applied Sciences, Paolo Tonella USI Lugano Pre-print |