Empirical evaluation of mutation-based test case prioritization techniques
Tue 27 Oct 2020 01:15 - 01:45 at Farfetch (D. Maria) - Journal First 1 Chair(s): Fabiano Ferrari
In this paper, we propose a new test case prioritization technique that combines both mutation‐based and diversity‐aware approaches. The diversity‐aware mutation‐based technique relies on the notion of mutant distinguishment, which aims to distinguish one mutant’s behaviour from another, rather than from the original program. The relative cost and effectiveness of the mutation‐based prioritization techniques (i.e., using both the traditional mutant kill and the proposed mutant distinguishment) are empirically investigated with 352 real faults and 553,477 developer‐written test cases. The empirical evaluation considers both the traditional and the diversity‐aware mutation criteria in various settings: single‐objective greedy, hybrid, and multi‐objective optimization. The results show that there is no single dominant technique across all the studied faults. To this end, the reason why each one of the mutation‐based prioritization criteria performs poorly is discussed, using a graphical model called Mutant Distinguishment Graph that demonstrates the distribution of the fault‐detecting test cases with respect to mutant kills and distinguishment.
Mon 26 OctDisplayed time zone: Lisbon change
13:45 - 15:15 | Journal First 1Journal-First Papers at Farfetch (D. Maria) +11h Chair(s): Maurício Aniche Delft University of Technology, Netherlands | ||
13:45 30mTalk | Modeling Foundations for Executable Model-Based Testing of Self-Healing Cyber-Physical Systems Journal-First Papers Tao Ma Simula Research Laboratory, Shaukat Ali Simula Research Laboratory, Tao Yue Nanjing University of Aeronautics and Astronautics Link to publication DOI | ||
14:15 30mTalk | Empirical evaluation of mutation-based test case prioritization techniques Journal-First Papers Donghwan Shin University of Luxembourg, Shin Yoo Korea Advanced Institute of Science and Technology, Mike Papadakis University of Luxembourg, Luxembourg, Doo-Hwan Bae Korea Advanced Institute of Science and Technology Link to publication DOI | ||
14:45 30mTalk | Are Unit and Integration Test Definitions Still Valid for Modern Java Projects? An Empirical Study on Open-Source Projects Journal-First Papers Fabian Trautsch University of Göttingen, Steffen Herbold University of Göttingen, Jens Grabowski University of Göttingen Link to publication DOI |
Tue 27 OctDisplayed time zone: Lisbon change
00:45 - 02:15 | Journal First 1Journal-First Papers at Farfetch (D. Maria) Chair(s): Fabiano Ferrari Federal University of São Carlos | ||
00:45 30mTalk | Modeling Foundations for Executable Model-Based Testing of Self-Healing Cyber-Physical Systems Journal-First Papers Tao Ma Simula Research Laboratory, Shaukat Ali Simula Research Laboratory, Tao Yue Nanjing University of Aeronautics and Astronautics Link to publication DOI | ||
01:15 30mTalk | Empirical evaluation of mutation-based test case prioritization techniques Journal-First Papers Donghwan Shin University of Luxembourg, Shin Yoo Korea Advanced Institute of Science and Technology, Mike Papadakis University of Luxembourg, Luxembourg, Doo-Hwan Bae Korea Advanced Institute of Science and Technology Link to publication DOI | ||
01:45 30mTalk | Are Unit and Integration Test Definitions Still Valid for Modern Java Projects? An Empirical Study on Open-Source Projects Journal-First Papers Fabian Trautsch University of Göttingen, Steffen Herbold University of Göttingen, Jens Grabowski University of Göttingen Link to publication DOI |