Write a Blog >>
ASE 2020
Mon 21 - Fri 25 September 2020 Melbourne, Australia
Tue 22 Sep 2020 16:20 - 16:40 at Koala - Maintenance and Evolution (3) Chair(s): Yongjie Zheng

The research community has long recognized a complex interrelationship between test set size, test adequacy criteria, and test effectiveness in terms of fault detection. However, there is substantial confusion about the role and importance of controlling for test set size when assessing and comparing test adequacy criteria. This paper makes the following contributions: (1) A review of contradictory analyses of the relationship between fault detection, test set size, and test adequacy criteria. Specifically, this paper addresses the supposed contradiction of prior work and explains why test set size is neither a confounding variable, as previously suggested, nor an independent variable that should be experimentally manipulated. (2) An explication and discussion of the experimental design and sampling strategies of prior work, together with a discussion of conceptual and statistical problems, and specific guidelines for future work. (3) A methodology for comparing test-adequacy criteria on an equal basis, which accounts for test set size by treating it as a covariate. (4) An empirical evaluation that compares the effectiveness of coverage-based and mutation-based testing to one another and random testing. Additionally, this paper proposes probabilistic coupling, a methodology for approximating the representativeness of a set of test goals for a given set of real faults.

Tue 22 Sep

Displayed time zone: (UTC) Coordinated Universal Time change

16:00 - 17:00
Maintenance and Evolution (3)Research Papers / Tool Demonstrations at Koala
Chair(s): Yongjie Zheng California State University San Marcos
16:00
20m
Talk
Subdomain-Based Generality-Aware Debloating
Research Papers
Qi Xin Georgia Institute of Technology, Myeongsoo Kim Georgia Institute of Technology, Qirun Zhang Georgia Institute of Technology, USA, Alessandro Orso Georgia Tech
16:20
20m
Talk
Revisiting the relationship between fault detection, test adequacy criteria, and test set size.
Research Papers
Yiqun Chen University of Washington, Rahul Gopinath CISPA Helmholtz Center for Information Security, Anita Tadakamalla George Mason University, USA, Michael D. Ernst University of Washington, USA, Reid Holmes University of British Columbia, Gordon Fraser University of Passau, Paul Ammann George Mason University, USA, René Just University of Washington, USA
16:40
10m
Talk
WASim: Understanding WebAssembly Applications through Classification
Tool Demonstrations
Alan Romano University at Buffalo, SUNY, Weihang Wang University at Buffalo, SUNY
16:50
10m
Talk
Sosed: a tool for finding similar software projects
Tool Demonstrations
Egor Bogomolov JetBrains Research, Yaroslav Golubev JetBrains Research, Artyom Lobanov JetBrains Research, Vladimir Kovalenko JetBrains Research, JetBrains N.V., Timofey Bryksin JetBrains Research, Saint Petersburg State University