Write a Blog >>
ICSE 2021
Mon 17 May - Sat 5 June 2021

Automated static analysis tools (ASATs) have become a major part of the software development workflow. Acting on the generated warnings, i.e., changing the code indicated in the warning, should be part of, at latest, the code review phase. Despite this being a best practice in software development, there is still a lack of empirical research regarding the usage of ASATs in the wild. In this work, we want to study ASAT warning trends in software via the example of PMD as an ASAT and its usage in open source projects. We analyzed the commit history of 54 projects (with 112,266 commits in total), taking into account 193 PMD rules and 61 PMD releases. We investigate trends of ASAT warnings over up to 17 years for the selected study subjects regarding changes of warning types, short and long term impact of ASAT use, and changes in warning severities. We found that large global changes in ASAT warnings are mostly due to coding style changes regarding braces and naming conventions. We also found that, surprisingly, the influence of the presence of PMD in the build process of the project on warning removal trends for the number of warnings per lines of code is small and not statistically significant. Regardless, if we consider defect density as a proxy for external quality, we see a positive effect if PMD is present in the build configuration of our study subjects.

Conference Day
Wed 26 May

Displayed time zone: Amsterdam, Berlin, Bern, Rome, Stockholm, Vienna change

11:20 - 12:20
2.1.5. Code Review: Observational StudiesJournal-First Papers at Blended Sessions Room 5 +12h
Chair(s): Sira VegasUniversidad Politecnica de Madrid
11:20
20m
Paper
Review Dynamics and Their Impact on Software QualityJournal-First
Journal-First Papers
Patanamon ThongtanunamUniversity of Melbourne, Ahmed E. HassanSchool of Computing, Queen's University
DOI Pre-print Media Attached
11:40
20m
Paper
Code Reviews with Divergent Review Scores: An Empirical Study of the OpenStack and Qt CommunitiesJournal-First
Journal-First Papers
Toshiki HiraodTosh Inc.,, Shane McIntosh, Akinori IharaWakayama University, Kenichi MatsumotoNara Institute of Science and Technology
DOI Pre-print Media Attached
12:00
20m
Paper
A Longitudinal Study of Static Analysis Warning Evolution and the Effects of PMD on Software Quality in Apache Open Source ProjectsJournal-First
Journal-First Papers
Alexander TrautschUniversity of Göttingen, Steffen HerboldUniversity of Göttingen, Jens GrabowskiUniversity of Göttingen
Link to publication DOI Pre-print Media Attached