DiffWatch: Watch Out for the Evolving Differential Testing in Deep Learning Libraries
Thu 26 May 2022 13:50 - 14:10 at Room 301+302 - Demos 2 Chair(s): August Shi
Testing deep learning libraries is ultimately important for ensuring the quality and safety of many deep learning applications. As differential testing is commonly used to help the creation of test oracles, its maintenance poses new challenges. In this tool demo paper, we present DiffWatch, a fully automated tool for Python, which identifies differential test practices in DLLs and continuously monitors new changes of external libraries that may trigger the updates of the identified differential tests. Our evaluation on four DLLs demonstrates that DiffWatch can detect differential testing with a high accuracy. In addition, we demonstrate usage examples to show DiffWatch’s capability of monitoring the development of external libraries and alert the maintainers of DLLs about new changes that may trigger the updates of differential test practices. In short, DiffWatch can help developers adequately react to the code evolution of external libraries. DiffWatch is publicly available and a demo video can be found at https://www.youtube.com/watch?v=gR7m5QQuSqE
Thu 12 MayDisplayed time zone: Eastern Time (US & Canada) change
11:00 - 12:00 | Software Testing 3DEMO - Demonstrations at ICSE Demo room 1 Chair(s): Wei Yang University of Texas at Dallas | ||
11:00 15mDemonstration | DiffWatch: Watch Out for the Evolving Differential Testing in Deep Learning Libraries DEMO - Demonstrations Pre-print Media Attached | ||
11:15 15mDemonstration | VRTest: An Extensible Framework for Automatic Testing of Virtual Reality Scenes DEMO - Demonstrations Xiaoyin Wang University of Texas at San Antonio Pre-print Media Attached | ||
11:30 15mDemonstration | SynTest-Solidity: Automated Test Case Generation and Fuzzing for Smart Contracts DEMO - Demonstrations Mitchell Olsthoorn Delft University of Technology, Dimitri Stallenberg Delft University of Technology, Arie van Deursen Delft University of Technology, Netherlands, Annibale Panichella Delft University of Technology DOI Pre-print Media Attached |
Thu 26 MayDisplayed time zone: Eastern Time (US & Canada) change
13:30 - 15:00 | |||
13:30 20mDemonstration | SynTest-Solidity: Automated Test Case Generation and Fuzzing for Smart Contracts DEMO - Demonstrations Mitchell Olsthoorn Delft University of Technology, Dimitri Stallenberg Delft University of Technology, Arie van Deursen Delft University of Technology, Netherlands, Annibale Panichella Delft University of Technology DOI Pre-print Media Attached | ||
13:50 20mDemonstration | DiffWatch: Watch Out for the Evolving Differential Testing in Deep Learning Libraries DEMO - Demonstrations Pre-print Media Attached | ||
14:10 20mDemonstration | iPFlakies: A Framework for Detecting and Fixing Python Order-Dependent Flaky Tests DEMO - Demonstrations Ruixin Wang Zhejiang University, Yang Chen Huazhong University of Science and Technology, Wing Lam University of Illinois at Urbana-Champaign Pre-print Media Attached |