ESEIW 2022
Sun 18 - Fri 23 September 2022 Helsinki, Finland
Thu 22 Sep 2022 16:06 - 16:17 at Sonck - Session 3B - Registered Reports 1 Chair(s): Sérgio Soares

Background/Context. The use of automated driving systems (ADSs) in the real world requires rigorous testing to ensure safety. To increase trust, ADSs should be tested on a large set of diverse road scenarios. Literature suggests that if a vehicle is driven along a set of geometrically diverse roads-measured using various diversity measures (DMs)-it will react in a wide range of behaviours, thereby increasing the chances of observing failures (if any), or strengthening the confidence in its safety, if no failures are observed. To the best of our knowledge, however, this assumption has never been tested before, nor have road DMs been assessed for their properties.

Objective/Aim. Our goal is to perform an exploratory study on 47 currently used and new, potentially promising road DMs. Specifically, our research questions look into the road DMs themselves, to analyse their properties (e.g. monotonicity, computation efficiency), and to test correlation between DMs. Furthermore, we look at the use of road DMs to investigate whether the assumption that diverse test suites of roads expose diverse driving behaviour holds.

Method. Our empirical analysis relies on a state-of-the-art, open-source ADSs testing infrastructure and uses a data set containing over 97,000 individual road geometries and matching simulation data that were collected using two driving agents. By sampling random test suites of various sizes and measuring their roads’ geometric diversity, we study road DMs properties, the correlation between road DMs, and the correlation between road DMs and the observed behaviour.

Thu 22 Sep

Displayed time zone: Athens change

15:45 - 17:00
Session 3B - Registered Reports 1ESEM Registered Reports at Sonck
Chair(s): Sérgio Soares Universidade Federal de Pernambuco
The Relevance of Model Transformation Language Features on Qualitative Properties of MTLs: A Study Protocol
ESEM Registered Reports
Stefan Höppner Ulm University, Matthias Tichy Ulm University, Germany
On the acceptance by code reviewers of candidate security patches suggested by Automated Program Repair tools
ESEM Registered Reports
Aurora Papotti Vrije Universiteit Amsterdam, Ranindya Paramitha University of Trento, Fabio Massacci University of Trento; Vrije Universiteit Amsterdam
DOI Pre-print
Does Road Diversity Really Matter in Testing Automated Driving Systems? A Registered Report
ESEM Registered Reports
Stefan Klikovits , Vincenzo Riccio USI Lugano, Ezequiel Castellano National Institute of Informatics, Ahmet Cetinkaya Shibaura Institute of Technology, Alessio Gambi IMC University of Applied Sciences Krems, Paolo Arcaini National Institute of Informatics
Link to publication
A Unified and Holistic Classification Scheme for Software Engineering Research
ESEM Registered Reports
Angelika Kaplan Karlsruhe Institute of Technology, Thomas Kühn Karlsruhe Institute of Technology, Ralf Reussner Karlsruhe Institute of Technology (KIT) and FZI - Research Center for Information Technology (FZI)
Studying the explanations for the automated prediction of bug and non-bug issues using LIME and SHAP
ESEM Registered Reports
Benjamin Ledel TU Clausthal, Steffen Herbold TU Clausthal
Team performance and large-scale agile software development
ESEM Registered Reports
Muhammad Ovais Ahmad Karlstad University, Hadi Ghanbari Aalto University, Tomas Gustavsson Karlstad University
Research paper
Comparative analysis of real bugs in open-source Machine Learning projects - A Registered Report
ESEM Registered Reports
Tuan Dung Lai Deakin University, Anj Simmons Deakin University, Scott Barnett Deakin University, Jean-Guy Schneider Deakin University, Rajesh Vasa Deakin University, Australia
Link to publication Pre-print