Write a Blog >>
ISSTA 2018
Sun 15 - Sat 21 July 2018 Amsterdam, Netherlands
co-located with ECOOP and ISSTA 2018
Mon 16 Jul 2018 16:40 - 17:00 at Zurich II - Machine Learning Chair(s): Alex Orso

We have recently witnessed tremendous success of Machine Learning (ML) in practical applications. Computer vision, speech recognition and language translation have all seen a near human level performance. We expect, in the near future, most business applications will have some form of ML. However, verifying the correctness of such applications is extremely challenging and would be very expensive if we follow today’s testing methodologies. In this work, we present an articulation of the challenges in verifying ML based applications. We then present our solution approach, based on the concept of Metamorphic Testing, which aims to identify implementation bugs in ML based image classifiers. We have developed metamorphic relations for an application using Support Vector Machine and an application using Deep Learning. Empirical validation showed that our approach was able to catch 71% of the implementation bugs in the ML applications.

Conference Day
Mon 16 Jul

Displayed time zone: Amsterdam, Berlin, Bern, Rome, Stockholm, Vienna change

16:00 - 17:30
Machine LearningISSTA Technical Papers at Zurich II
Chair(s): Alex OrsoGeorgia Institute of Technology
16:00
20m
Talk
Compiler Fuzzing through Deep LearningDistinguished Paper
ISSTA Technical Papers
Chris CumminsUniversity of Edinburgh, Pavlos PetoumenosUniversity of Edinburgh, Alastair MurrayCodeplay Software, Hugh LeatherUniversity of Edinburgh
16:20
20m
Talk
Deep Specification Mining
ISSTA Technical Papers
Tien-Duy B. LeSchool of Information Systems, Singapore Management University, David LoSingapore Management University
16:40
20m
Talk
Identifying Implementation Bugs in Machine Learning based Image Classifiers using Metamorphic Testing
ISSTA Technical Papers
Anurag DwarakanathAccenture Labs, Manish AhujaAccenture Labs, Samarth SikandAccenture Labs, Raghotham M RaoAccenture Labs, R.P. Jagadeesh Chandra BoseAccenture Labs, Neville DubashAccenture Labs, Sanjay Podder
17:00
20m
Talk
An Empirical Study on TensorFlow Program Bugs
ISSTA Technical Papers
Yuhao ZhangPeking University, Yifan ChenPeking University, Shing-Chi CheungDepartment of Computer Science and Engineering, The Hong Kong University of Science and Technology, Yingfei XiongPeking University, Lu ZhangPeking University
Pre-print
17:20
10m
Q&A in groups
ISSTA Technical Papers