ICSE 2026
Sun 12 - Sat 18 April 2026 Rio de Janeiro, Brazil

Designing A/B testing experiments is relatively easy if you have plenty of subjects. What if you have many more design knobs than just two conditions or can only ask relatively few developers/users to test your solutions? This technical briefing will help ICSE atten- dees to gain an hands-on understanding of designing combinatorial experiments in Software Engineering. It will be useful for PhD students, researchers and industrial practitioners with all levels of experience, including those conducting experimental studies with human subjects for the first time. The briefing is based on the significant experience of the research group and will draw on plenty of examples. The briefing includes interactive hands-on ex- ercises with the learning objectives of designing, conducting and analyzing one’s own experimental study. The scientific underpin- ning are partly available in the paper “Addressing Combinatorial Experiments and Scarcity of Subjects by Provably Orthogonal and Crossover Experimental Designs”(JSS’24)