Write a Blog >>
ICSE 2021
Mon 17 May - Sat 5 June 2021

Combinatorial interaction testing (CIT) is an important technique for testing highly configurable software systems with demonstrated effectiveness in practice. The goal of CIT is to generate test cases covering the interactions of configuration options, under certain hard constraints. In this context, constrained covering arrays (CCAs) are frequently used as test cases in CIT. Constrained Covering Array Generation (CCAG) is an NP-hard combinatorial optimization problem, solving which requires an effective method for generating small CCAs. In particular, effectively solving t-way CCAG with t>=4 is even more challenging. Inspired by the success of automated algorithm configuration and automated algorithm selection in solving combinatorial optimization problems, in this paper, we investigate the efficacy of automated algorithm configuration and automated algorithm selection for the CCAG problem, and propose a novel, automated CCAG approach called AutoCCAG. Extensive experiments on public benchmarks show that AutoCCAG can find much smaller-sized CCAs than current state-of-the-art approaches, indicating the effectiveness of AutoCCAG. More encouragingly, to our best knowledge, our paper reports the first results for CCAG with a high coverage strength (i.e., 5-way CCAG) on public benchmarks. Our results demonstrate that AutoCCAG can bring considerable benefits in testing highly configurable software systems.

Conference Day
Wed 26 May

Displayed time zone: Amsterdam, Berlin, Bern, Rome, Stockholm, Vienna change

12:55 - 13:55
2.2.2. Configuration of Software Systems: TestingTechnical Track / SEIP - Software Engineering in Practice at Blended Sessions Room 2 +12h
Chair(s): Antonia BertolinoCNR-ISTI
12:55
20m
Paper
An Evolutionary Study of Configuration Design and Implementation in Cloud SystemsArtifact ReusableTechnical Track
Technical Track
Yuanliang ZhangNational University of Defense Technology, Haochen HeNational University of Defense Technology, Owolabi LegunsenCornell University, Shanshan LiNational University of Defense Technology, Wei DongNational University of Defense Technology, Tianyin XuUniversity of Illinois Urbana-Champaign
Pre-print Media Attached
13:15
20m
Paper
AutoCCAG: An Automated Approach to Constrained Covering Array GenerationTechnical Track
Technical Track
Chuan LuoMicrosoft Research, China, Jinkun LinState Key Laboratory of Computer Science, Institute of Software, Chinese Academy of Sciences, China, Shaowei CaiInstitute of Software at Chinese Academy of Sciences, China, Xin ChenMicrosoft Research, China, Bing HeMicrosoft Research, China, Bo QiaoMicrosoft Research, Beijing, China, Pu ZhaoMicrosoft Research, Beijing, China, Qingwei LinMicrosoft Research, Beijing, China, Hongyu ZhangThe University of Newcastle, Wei WuL3S Research Center, Leibniz University Hannover, Germany, Saravanakumar RajmohanMicrosoft Office, United States, Dongmei ZhangMicrosoft Research
Pre-print Media Attached
13:35
20m
Paper
ConfigFix: Interactive Configuration Conflict Resolution for the Linux KernelSEIP
SEIP - Software Engineering in Practice
Patrick FranzChalmers | University of Gothenburg, Thorsten BergerChalmers | University of Gothenburg, Ibrahim FayazVecScan AB (Vector Sweden), Sarah NadiUniversity of Alberta, Evgeny GroshevChalmers | University of Gothenburg
Pre-print Media Attached

Conference Day
Thu 27 May

Displayed time zone: Amsterdam, Berlin, Bern, Rome, Stockholm, Vienna change

00:55 - 01:55
2.2.2. Configuration of Software Systems: TestingSEIP - Software Engineering in Practice / Technical Track at Blended Sessions Room 2
00:55
20m
Paper
An Evolutionary Study of Configuration Design and Implementation in Cloud SystemsArtifact ReusableTechnical Track
Technical Track
Yuanliang ZhangNational University of Defense Technology, Haochen HeNational University of Defense Technology, Owolabi LegunsenCornell University, Shanshan LiNational University of Defense Technology, Wei DongNational University of Defense Technology, Tianyin XuUniversity of Illinois Urbana-Champaign
Pre-print Media Attached
01:15
20m
Paper
AutoCCAG: An Automated Approach to Constrained Covering Array GenerationTechnical Track
Technical Track
Chuan LuoMicrosoft Research, China, Jinkun LinState Key Laboratory of Computer Science, Institute of Software, Chinese Academy of Sciences, China, Shaowei CaiInstitute of Software at Chinese Academy of Sciences, China, Xin ChenMicrosoft Research, China, Bing HeMicrosoft Research, China, Bo QiaoMicrosoft Research, Beijing, China, Pu ZhaoMicrosoft Research, Beijing, China, Qingwei LinMicrosoft Research, Beijing, China, Hongyu ZhangThe University of Newcastle, Wei WuL3S Research Center, Leibniz University Hannover, Germany, Saravanakumar RajmohanMicrosoft Office, United States, Dongmei ZhangMicrosoft Research
Pre-print Media Attached
01:35
20m
Paper
ConfigFix: Interactive Configuration Conflict Resolution for the Linux KernelSEIP
SEIP - Software Engineering in Practice
Patrick FranzChalmers | University of Gothenburg, Thorsten BergerChalmers | University of Gothenburg, Ibrahim FayazVecScan AB (Vector Sweden), Sarah NadiUniversity of Alberta, Evgeny GroshevChalmers | University of Gothenburg
Pre-print Media Attached