If a Human Can See It, So Should Your System: Reliability Requirements for Machine Vision Components
Fri 13 May 2022 11:20 - 11:25 at ICSE room 1-odd hours - Reliability and Safety 6 Chair(s): Pasqualina Potena
Wed 25 May 2022 09:50 - 09:55 at Room 304+305 - Papers 3: Reliability and Safety Chair(s): Cristian Cadar
Wed 25 May 2022 13:30 - 15:00 at Ballroom Gallery - Posters 1
Machine Vision Components (MVC) are becoming safety-critical. Assuring their quality, including safety, is essential for their successful deployment. Assurance relies on the availability of precisely specified and, ideally, machine-verifiable requirements. MVCs with state-of-the-art performance rely on machine learning (ML) and training data, but largely lack such requirements. In this paper, we address the need for defining machine-verifiable reliability requirements for MVCs against transformations that simulate the full range of realistic and safety-critical changes in the environment. Using human performance as a baseline, we define reliability requirements as: `if the changes in an image do not affect a human’s decision, neither should they affect the MVC’s.’ To this end, we provide: (1) a class of safety-related image transformations; (2) reliability requirement classes to specify correctness-preservation and prediction-preservation for MVCs; (3) a method to instantiate machine-verifiable requirements from these requirements classes using human performance experiment data; (4) human performance experiment data for image recognition involving eight commonly used transformations, from about 2000 human participants; and (5) a method for automatically checking whether an MVC satisfies our requirements. Further, we show that our reliability requirements are feasible and reusable by evaluating our methods on 13 state-of-the-art pre-trained image classification models. Finally, we demonstrate that our approach detects reliability gaps in MVCs that other existing methods are unable to detect.
Tue 10 MayDisplayed time zone: Eastern Time (US & Canada) change
20:00 - 21:00 | Reliability and Safety 5Technical Track / SEIP - Software Engineering in Practice at ICSE room 1-even hours Chair(s): David Lo Singapore Management University | ||
20:00 5mTalk | When Cyber-Physical Systems Meet AI: A Benchmark, an Evaluation, and a Way Forward SEIP - Software Engineering in Practice Jiayang Song University of Alberta, Deyun Lyu Kyushu university, Zhenya Zhang Nanyang Technological University, Zhijie Wang University of Alberta, Tianyi Zhang Purdue University, Lei Ma University of Alberta DOI Pre-print Media Attached | ||
20:05 5mTalk | Multi-Intention-Aware Configuration Selection for Performance Tuning Technical Track Haochen He National University of Defense Technology, Zhouyang Jia National University of Defense Technology, Shanshan Li National University of Defense Technology, Yue Yu College of Computer, National University of Defense Technology, Changsha 410073, China, Chenglong Zhou National University of Defense Technology, Qing Liao Harbin Institute of Technology, Ji Wang National University of Defense Technology, Liao Xiangke National University of Defense Technology Pre-print Media Attached | ||
20:10 5mTalk | DeepStability: A Study of Unstable Numerical Methods and Their Solutions in Deep Learning Technical Track Pre-print Media Attached | ||
20:15 5mTalk | If a Human Can See It, So Should Your System: Reliability Requirements for Machine Vision Components Technical Track Boyue Caroline Hu University of Toronto, Lina Marsso University of Toronto, Krzysztof Czarnecki University of Waterloo, Canada, Rick Salay University of Toronto, Huakun Shen University of Toronto, Marsha Chechik University of Toronto DOI Pre-print Media Attached |