Write a Blog >>
ASE 2021
Sun 14 - Sat 20 November 2021 Australia
Wed 17 Nov 2021 08:00 - 08:20 at Kangaroo - Bugs I Chair(s): Elena Sherman

Static bug detectors aim at helping developers to automatically find and prevent bugs. In this experience paper, we study the effectiveness of static bug detectors at identifying Null Pointer Dereferences or Null Pointer Exceptions (NPEs). NPEs pervade all programming domains from systems to web development. Specifically, our study measures the effectiveness of five Java static bug detectors: CheckerFramework, Eradicate, Infer, NullAway, and SpotBugs. We conduct our study on 102 real-world and reproducible NPEs from 42 open-source projects found in the BugSwarm and Defects4J datasets. We apply two known methods to determine whether a bug is found by a given tool, and introduce two new methods that leverage stack trace and code coverage information. Additionally, we provide a categorization of the tool’s capabilities and the bug characteristics to better understand the strengths and weaknesses of the tools. Overall, the tools under study only find 30 out of 102 bugs (29.4%), with the majority found by Eradicate. Based on our observations, we identify and discuss opportunities to make the tools more effective and useful.

Wed 17 Nov

Displayed time zone: Hobart change

08:00 - 09:00
Bugs IResearch Papers / Industry Showcase / Tool Demonstrations at Kangaroo
Chair(s): Elena Sherman Boise State University
Research paper
On the Real-World Effectiveness of Static Bug Detectors at Finding Null Pointer Exceptions
Research Papers
David A Tomassi University of California, Davis, Cindy Rubio-González University of California at Davis
Subtle Bugs Everywhere: Generating Documentation for Data Wrangling Code
Research Papers
Chenyang Yang Peking University, Shurui Zhou University of Toronto, Jin L.C. Guo McGill University, Christian Kästner Carnegie Mellon University
Reducing Time-To-Fix For Fuzzer Bugs
Industry Showcase
Rui Abreu Faculty of Engineering, University of Porto, Portugal, Franjo Ivančić Google, Filip Niksic Google, Hadi Ravanbakhsh Google, Ramesh Viswanathan Google
Shaker: a Tool for Detecting More Flaky Tests Faster
Tool Demonstrations
Marcello Cordeiro Federal University of Pernambuco, Denini Silva Federal University of Pernambuco, Leopoldo Teixeira Federal University of Pernambuco, Breno Miranda Federal University of Pernambuco, Marcelo d'Amorim Federal University of Pernambuco
Link to publication