Write a Blog >>
ISSTA 2020
Sat 18 - Wed 22 July 2020
Tue 21 Jul 2020 12:50 - 13:10 at Zoom - BUG LOCALIZATION AND TEST ISOLATION Chair(s): Mattia Fazzini

Testing is the most common approach used in industry for checking software correctness. Developers frequently practice reliable testing-executing individual tests in isolation from each other-to avoid test failures caused by test-order dependencies and shared state pollution (e.g., when tests mutate static fields). A common way of doing this is by running each test as a separate process. Unfortunately, this is known to introduce substantial overhead. This experience report describes our efforts to better understand the sources of this overhead and to create a system to confirm the minimal overhead possible. We found that different build systems use different mechanisms for communicating between these multiple processes, and that because of this design decision, some build systems could be faster than others. Through this inquiry we discovered a significant performance bug in Apache Maven’s test running code, which slowed down test execution by on average 300 milliseconds per-test when compared to a competing build system, Ant. When used for testing real projects, this can result in a significant reduction in testing time. We submitted a patch for this bug which has been integrated into the Apache Maven build system, and describe our ongoing efforts to improve Maven’s test execution tooling.

Conference Day
Tue 21 Jul

Displayed time zone: Tijuana, Baja California change

12:10 - 13:10
Chair(s): Mattia FazziniUniversity of Minnesota

Public Live Stream/Recording. Registered participants should join via the Zoom link distributed in Slack.

Scaffle: Bug Localization on Millions of Files
Technical Papers
Michael PradelUniversity of Stuttgart, Vijayaraghavan MuraliFacebook, Inc., Rebecca QianFacebook, Inc., Mateusz MachalicaFacebook, Inc., Erik Meijer, Satish ChandraFacebook
DOI Media Attached
Abstracting Failure-Inducing InputsArtifacts Evaluated – ReusableArtifacts AvailableArtifacts Evaluated – FunctionalACM SIGSOFT Distinguished Paper Award
Technical Papers
Rahul GopinathCISPA Helmholtz Center for Information Security, Alexander KampmannCISPA Helmholtz Center for Information Security, Nikolas HavrikovCISPA Helmholtz Center for Information Security, Ezekiel O. SoremekunCISPA Helmholtz Center for Information Security, Andreas ZellerCISPA Helmholtz Center for Information Security
DOI Pre-print Media Attached
Debugging the Performance of Maven’s Test Isolation: Experience Report
Technical Papers
Pengyu NieThe University of Texas at Austin, Ahmet CelikFacebook, Matthew Coley, Aleksandar Milicevic, Jonathan BellNortheastern University, Milos GligoricThe University of Texas at Austin