Write a Blog >>
ASE 2020
Mon 21 - Fri 25 September 2020 Melbourne, Australia
Wed 23 Sep 2020 09:50 - 10:10 at Koala - Configuration Management (1) Chair(s): Carmine Vassallo

Performance bugs are often hard to detect due to their non fail-stop symptoms. Existing debugging techniques can only detect performance bugs with known patterns (e.g., inefficient loops). The key reason behind this incapability is the lack of a general test oracle. Here, we argue that the performance expectation of configuration can serve as a strong oracle candidate for performance bug detection. First, prior work shows that most performance bugs are related to configurations. Second, the configuration change reflects users’ expectation on performance changes. If the actual performance behaves differently from the users’ expectation, the related code snippet is likely to be problematic.

In this paper, we first conducted a comprehensive study on 173 real-world configuration-related performance bugs (CPBugs) from 12 representative software systems. We then derived seven configuration-related performance properties, which can serve as test oracles in performance testing. Guided by the study, we designed and evaluated an automated performance testing framework, CP-Detector, for detecting real-world configuration-related performance bugs. CP-Detector was evaluated on 12 open-source projects. The results showed that it detected 43 out of 61 existing bugs and reported 13 new bugs.

Wed 23 Sep
Times are displayed in time zone: (UTC) Coordinated Universal Time change

09:10 - 10:10
Configuration Management (1)Research Papers at Koala
Chair(s): Carmine VassalloUniversity of Zurich, Switzerland
09:10
20m
Talk
Automated Implementation of Windows-related Security-Configuration Guides
Research Papers
Patrick StöckleTechnical University of Munich, Bernd GrobauerSiemens AG, Alexander PretschnerTechnical University of Munich
Link to publication DOI Pre-print
09:30
20m
Talk
Identifying Software Performance Changes Across Variants and Versions
Research Papers
Stefan MühlbauerLeipzig University, Sven ApelSaarland University, Germany, Norbert SiegmundLeipzig University
DOI Pre-print
09:50
20m
Talk
CP-Detector: Using Configuration-related Performance Properties to Expose Performance Bugs
Research Papers
Haochen HeNational University of Defense Technology, Zhouyang JiaNational University of Defense Technology, Shanshan LiNational University of Defense Technology, China, Erci XuNational University of Defense Technology, Tingting YuUniversity of Kentucky, Yue YuCollege of Computer, National University of Defense Technology, Changsha 410073, China, Ji WangNational University of Defense Technology, Xiangke LiaoNational University of Defense Technology, China
DOI Pre-print