Sun 25 Oct 2020 23:00 - 23:30 at Farfetch (D. Maria) - RT3 - Testing Deep Learning and Robotic Systems Chair(s): João Pascoal Faria
Robotic systems are increasingly a part of everyday life. Characteristics of robotic systems such as interaction with the physical world, and integration of hardware and software components, differentiate robotic systems from conventional software systems. Although numerous studies have investigated the challenges of software testing in practice, no such study has focused on testing of robotic systems. In this paper, we conduct a qualitative study to better understand the testing practices used by the robotics community, and identify the challenges faced by practitioners when testing their systems. We identify a total of 12 testing practices and 9 testing challenges from our participants’ responses. We group these challenges into 3 major themes: Real-world complexities, Community and standards, and Component integration. We believe that further research on addressing challenges described with these three major themes can result in higher adoption of robotics testing practices, more testing automation, and higher-quality robotic systems.
Sun 25 OctDisplayed time zone: Lisbon change
11:00 - 12:30 | RT3 - Testing Deep Learning and Robotic SystemsResearch Papers at Farfetch (D. Maria) +11h Chair(s): Antonio Filieri Imperial College London | ||
11:00 30mTalk | An Empirical Evaluation of Mutation Operators for Deep Learning Systems Research Papers Link to publication DOI | ||
11:30 30mTalk | Comparing Offline and Online Testing of Deep Neural Networks: An Autonomous Car Case Study Research Papers Fitash Ul Haq University of Luxembourg, Donghwan Shin University of Luxembourg, Shiva Nejati University of Luxembourg, Lionel Briand University of Luxembourg, University of Ottawa Link to publication DOI | ||
12:00 30mTalk | A Study on Challenges of Testing Robotic Systems Research Papers Afsoon Afzal Carnegie Mellon University, Claire Le Goues Carnegie Mellon University, Michael Hilton Carnegie Mellon University, USA, Christopher Steven Timperley Carnegie Mellon University Link to publication DOI | ||
22:00 - 23:30 | RT3 - Testing Deep Learning and Robotic SystemsResearch Papers at Farfetch (D. Maria) Chair(s): João Pascoal Faria Faculty of Engineering, University of Porto and INESC TEC | ||
22:00 30mTalk | An Empirical Evaluation of Mutation Operators for Deep Learning Systems Research Papers Link to publication DOI | ||
22:30 30mTalk | Comparing Offline and Online Testing of Deep Neural Networks: An Autonomous Car Case Study Research Papers Fitash Ul Haq University of Luxembourg, Donghwan Shin University of Luxembourg, Shiva Nejati University of Luxembourg, Lionel Briand University of Luxembourg, University of Ottawa Link to publication DOI | ||
23:00 30mTalk | A Study on Challenges of Testing Robotic Systems Research Papers Afsoon Afzal Carnegie Mellon University, Claire Le Goues Carnegie Mellon University, Michael Hilton Carnegie Mellon University, USA, Christopher Steven Timperley Carnegie Mellon University Link to publication DOI | ||