ICSE 2026
Sun 12 - Sat 18 April 2026 Rio de Janeiro, Brazil

This program is tentative and subject to change.

Designing A/B testing experiments is relatively easy if you have plenty of subjects. What if you have many more design knobs than just two conditions or can only ask relatively few developers/users to test your solutions? This technical briefing will help ICSE atten- dees to gain an hands-on understanding of designing combinatorial experiments in Software Engineering. It will be useful for PhD students, researchers and industrial practitioners with all levels of experience, including those conducting experimental studies with human subjects for the first time. The briefing is based on the significant experience of the research group and will draw on plenty of examples. The briefing includes interactive hands-on ex- ercises with the learning objectives of designing, conducting and analyzing one’s own experimental study. The scientific underpin- ning are partly available in the paper “Addressing Combinatorial Experiments and Scarcity of Subjects by Provably Orthogonal and Crossover Experimental Designs”(JSS’24)

This program is tentative and subject to change.

Tue 14 Apr

Displayed time zone: Brasilia, Distrito Federal, Brazil change

14:00 - 15:30
Tutorial: Beyond A/B Testing - Orthogonal and Experimental Designs (Part 1)Tutorials and Technical Briefings at Bora Bora V
Chair(s): Paris Avgeriou University of Groningen, The Netherlands, Uirá Kulesza Federal University of Rio Grande do Norte
14:00
90m
Talk
Tutorial: Beyond A/B Testing - Orthogonal and Experimental Designs
Tutorials and Technical Briefings
Fabio Massacci University of Trento; Vrije Universiteit Amsterdam, Aurora Papotti Vrije Universiteit Amsterdam, Katja Tuma Eindhoven University of Technology
16:00 - 17:30
Tutorial: Beyond A/B Testing - Orthogonal and Experimental Designs (Part 2)Tutorials and Technical Briefings at Bora Bora V
Chair(s): Paris Avgeriou University of Groningen, The Netherlands, Uirá Kulesza Federal University of Rio Grande do Norte
16:00
90m
Talk
Tutorial: Beyond A/B Testing - Orthogonal and Experimental Designs
Tutorials and Technical Briefings
Fabio Massacci University of Trento; Vrije Universiteit Amsterdam, Aurora Papotti Vrije Universiteit Amsterdam, Katja Tuma Eindhoven University of Technology