Challenges and Opportunities: An In-Depth Empirical Study on Configuration Error Injection Testing
Sat 17 Jul 2021 01:50 - 02:10 at ISSTA 1 - Session 21 (time band 2) Testing 3 Chair(s): Rohan Padhye
Configuration error injection
testing (CEIT) could
systematically evaluate software reliability and diagnosability
to runtime configuration errors.
This paper explores the challenges and opportunities
of applying CEIT technique.
We build an extensible, highly-modularized CEIT framework named CeitInspector to
experiment
with various CEIT techniques.
Using CeitInspector, we quantitatively measure the effectiveness and efficiency of
CEIT using six mature and widely-used
server applications.
During this process, we find a fair number of test cases are left unstudied
by the prior research work.
The injected configuration errors in these cases often indicate latent misconfigurations,
which might be ticking time bombs in the system and lead to severe damage.
We conduct an in-depth study regarding these cases to reveal the root causes,
and explore possible remedies.
Finally, we come up with actionable suggestions guided by our study
to improve the effectiveness and efficiency of
the existing CEIT techniques.
| Challenges and Opportunities: An In-Depth Empirical Study on Configuration Error Injection Testing [Slides] (Wang_ISSTA2021.pdf) | 1.8MiB |
Thu 15 JulDisplayed time zone: Brussels, Copenhagen, Madrid, Paris change
19:00 - 20:20 | Session 12 (time band 1) Configuration and Dependency Technical Papers at ISSTA 2 Chair(s): Jonathan Bell Northeastern University | ||
19:00 20mTalk | Fixing Dependency Errors for Python Build Reproducibility Technical Papers Suchita Mukherjee University of California at Davis, Abigail Almanza University of California at Davis, Cindy Rubio-González University of California at Davis DOI | ||
19:20 20mTalk | Test-Case Prioritization for Configuration TestingACM SIGSOFT Distinguished Paper Technical Papers Runxiang Cheng University of Illinois at Urbana-Champaign, Lingming Zhang University of Illinois at Urbana-Champaign, Darko Marinov University of Illinois at Urbana-Champaign, Tianyin Xu University of Illinois at Urbana-Champaign DOI | ||
19:40 20mTalk | The Impact of Tool Configuration Spaces on the Evaluation of Configurable Taint Analysis for Android Technical Papers DOI Pre-print | ||
20:00 20mTalk | Challenges and Opportunities: An In-Depth Empirical Study on Configuration Error Injection Testing Technical Papers Wang Li National University of Defense Technology, Zhouyang Jia National University of Defense Technology, Shanshan Li National University of Defense Technology, Yuanliang Zhang National University of Defense Technology, Teng Wang National University of Defense Technology, Erci Xu National University of Defense Technology, Ji Wang National University of Defense Technology, Liao Xiangke National University of Defense Technology DOI File Attached | ||
Sat 17 JulDisplayed time zone: Brussels, Copenhagen, Madrid, Paris change
01:10 - 02:30 | Session 21 (time band 2) Testing 3Technical Papers at ISSTA 1 Chair(s): Rohan Padhye Carnegie Mellon University | ||
01:10 20mTalk | Continuous Test Suite Failure Prediction Technical Papers DOI Media Attached | ||
01:30 20mTalk | Toward Optimal MC/DC Test Case Generation Technical Papers Sangharatna Godboley National Institute of Technology Warangal, Joxan Jaffar National University of Singapore, Rasool Maghareh Huawei, Arpita Dutta National University of Singapore DOI | ||
01:50 20mTalk | Challenges and Opportunities: An In-Depth Empirical Study on Configuration Error Injection Testing Technical Papers Wang Li National University of Defense Technology, Zhouyang Jia National University of Defense Technology, Shanshan Li National University of Defense Technology, Yuanliang Zhang National University of Defense Technology, Teng Wang National University of Defense Technology, Erci Xu National University of Defense Technology, Ji Wang National University of Defense Technology, Liao Xiangke National University of Defense Technology DOI File Attached | ||
02:10 20mTalk | Test-Case Prioritization for Configuration TestingACM SIGSOFT Distinguished Paper Technical Papers Runxiang Cheng University of Illinois at Urbana-Champaign, Lingming Zhang University of Illinois at Urbana-Champaign, Darko Marinov University of Illinois at Urbana-Champaign, Tianyin Xu University of Illinois at Urbana-Champaign DOI | ||