Fri 14 Oct 2022 10:30 - 12:00 at Gold C - AI Quality Assurance II (Part II)
Data-driven AI (e.g., deep learning) has become a driving force and has been applied in many applications across diverse domains. The human-competitive performance makes them stand as core components in complicated software systems for tasks, e.g., computer vision (CV) and natural language processing (NLP). Corresponding to the increasing popularity of deploying more powerful and complicated DL models, there is also a pressing need to ensure the quality and reliability of these AI systems. However, the data-driven paradigm and black-box nature make such AI software fundamentally different from classical software. To this end, new software quality assurance techniques for AI-driven systems are thus challenging and needed. In this tutorial, we introduce the recent progress in AI Quality Assurance, especially for testing techniques for DNNs and provide hands-on experience. We will first give the details and discuss the difference between testing for traditional software and AI software. Then, we will provide hands-on tutorials on testing techniques for feed-forward neural networks (FNNs) with a CV use case and recurrent neural networks (RNNs) with an NLP use case. Finally, we will discuss with the audience the success and failures in achieving the full potential of testing AI software as well as possible improvements and research directions. The materials are available at AI Quality Assurance
Fri 14 OctDisplayed time zone: Eastern Time (US & Canada) change
08:30 - 10:00 | |||
08:30 90mTutorial | AI Quality Assurance Tutorials Zhijie Wang University of Alberta, Yuheng Huang University of Alberta, Canada, Lei Ma University of Alberta, Houssem Ben Braiek École Polytechnique de Montréal, Foutse Khomh Polytechnique Montréal |
10:30 - 12:00 | |||
10:30 90mTutorial | AI Quality Assurance Tutorials Zhijie Wang University of Alberta, Yuheng Huang University of Alberta, Canada, Lei Ma University of Alberta, Houssem Ben Braiek École Polytechnique de Montréal, Foutse Khomh Polytechnique Montréal |