Write a Blog >>
ASE 2020
Mon 21 - Fri 25 September 2020 Melbourne, Australia
Wed 23 Sep 2020 01:30 - 01:50 at Kangaroo - Software Engineering for AI (2) Chair(s): Aldeida Aleti

Neural networks are becoming a popular tool for solving many real-world problems such as object recognition and machine translation, thanks to its exceptional performance as an end-to-end solution. However, neural networks are complex black-box models, which hinders humans from interpreting and consequently trusting them in making critical decisions. Towards interpreting neural networks, several approaches have been proposed to extract simple deterministic models from neural networks. The results are not encouraging (e.g., low accuracy and limited scalability), fundamentally due to the limited expressiveness of such simple models.

In this work, we propose an approach to extract probabilistic automata for interpreting an important class of neural networks, i.e., recurrent neural networks. Our work distinguishes itself from existing approaches in two important ways. One is that probability is used to compensate for the loss of expressiveness. This is inspired by the observation that human reasoning is often `probabilistic’. The other is that we adaptively identify the right level of abstraction so that a simple model is extracted in a request-specific way. We conduct experiments on several real-world datasets using state-of-the-art architectures including GRU and LSTM. The result shows that our approach significantly improves existing approaches in terms of accuracy or scalability. Lastly, we demonstrate the usefulness of the extracted models through detecting adversarial texts.

Wed 23 Sep

Displayed time zone: (UTC) Coordinated Universal Time change

01:10 - 02:10
Software Engineering for AI (2) Research Papers / Industry Showcase at Kangaroo
Chair(s): Aldeida Aleti Monash University
01:10
20m
Talk
Audee: Automated Testing for Deep Learning Frameworks
Research Papers
Qianyu Guo College of Intelligence and Computing, Tianjin University, Xiaofei Xie Nanyang Technological University, Yi Li Nanyang Technological University, Xiaoyu Zhang Xi'an Jiaotong University, Yang Liu Nanyang Technological University, Singapore, Xiaohong Li TianJin University, Chao Shen Xi'an Jiaotong University
01:30
20m
Talk
Towards Interpreting Recurrent Neural Networks through Probabilistic Abstraction
Research Papers
Guoliang Dong Computer College of Zhejiang University, Jingyi Wang Zhejiang University, Jun Sun Singapore Management University, Yang Zhang Zhejiang University, Xinyu Wang Zhejiang University, Dai Ting Huawei International Pte Ltd, Jin Song Dong National University of Singapore, Xingen Wang Zhejiang University
01:50
20m
Talk
Towards Building Robust DNN Applications: An Industrial Case Study of Evolutionary Data Augmentation
Industry Showcase
Haruki Yokoyama Fujitsu Laboratories Ltd., Satoshi Onoue Fujitsu Ltd., Shinji Kikuchi Fujitsu Laboratories Ltd.