A Static Analyzer for Detecting Tensor Shape Errors in Deep Neural Network Training Code
We present an automatic static analyzer PyTea that detects tensor-shape errors in PyTorch code. The tensor-shape error is critical in the deep neural net code; much of the training cost and intermediate results are to be lost once a tensor shape mismatch occurs in the midst of the training phase. Given the input PyTorch source, PyTea statically traces every possible execution path, collects tensor shape constraints required by the tensor operation sequence of the path, and decides if the constraints are unsatisfiable (hence a shape error can occur). PyTea’s scalability and precision hinges on the characteristics of real-world PyTorch applications: the number of execution paths after PyTea’s conservative pruning rarely explodes and loops are simple enough to be circumscribed by our symbolic abstraction. We tested PyTea against the projects in the official PyTorch repository and some tensor-error code questioned in the StackOverflow. PyTea successfully detects tensor shape errors in these codes, each within a few seconds.
Wed 11 MayDisplayed time zone: Eastern Time (US & Canada) change
03:00 - 04:00 | |||
03:00 5mPoster | A Static Analyzer for Detecting Tensor Shape Errors in Deep Neural Network Training Code Posters Ho Young Jhoo Seoul National University, Sehoon Kim Seoul National University, Woosung Song Seoul National University, Kyuyeon Park Seoul National University, DongKwon Lee Seoul National University, South Korea, Kwangkeun Yi Seoul National University, South Korea Pre-print | ||
03:05 5mPoster | Garuda: Heap aware symbolic execution Posters | ||
03:10 5mPoster | The Symptoms, Causes, and Repairs of Workarounds in Apache Issue Trackers Posters Aoyang Yan Shanghai Jiao Tong University, Hao Zhong Shanghai Jiao Tong University, Daohan Song Shanghai Jiao Tong University, Li Jia Shanghai Jiao Tong University | ||
03:15 5mPoster | CrystalBLEU: Precisely and Efficiently Measuring the Similarity of Code Posters | ||
03:20 5mPoster | CRISCE: Towards Generating Test Cases from Accident Sketches Posters Vuong Nguyen University of Passau, Alessio Gambi University of Passau, Jasim Ahmed University of Passau, Gordon Fraser University of Passau | ||
03:25 5mPoster | Deep Learning-based Production and Test Bug Report Classification using Source Files Posters Misoo Kim Sungkyunkwan University, Youngkyoung Kim Sungkyunkwan University, Eunseok Lee Sungkyunkwan University |