Tutorial: Beyond A/B Testing - Orthogonal and Experimental Designs
This program is tentative and subject to change.
Tue 14 Apr 2026 16:00 - 17:30 at Bora Bora V - Tutorial: Beyond A/B Testing - Orthogonal and Experimental Designs (Part 2) Chair(s): Paris Avgeriou, Uirá Kulesza
Designing A/B testing experiments is relatively easy if you have plenty of subjects. What if you have many more design knobs than just two conditions or can only ask relatively few developers/users to test your solutions? This technical briefing will help ICSE atten- dees to gain an hands-on understanding of designing combinatorial experiments in Software Engineering. It will be useful for PhD students, researchers and industrial practitioners with all levels of experience, including those conducting experimental studies with human subjects for the first time. The briefing is based on the significant experience of the research group and will draw on plenty of examples. The briefing includes interactive hands-on ex- ercises with the learning objectives of designing, conducting and analyzing one’s own experimental study. The scientific underpin- ning are partly available in the paper “Addressing Combinatorial Experiments and Scarcity of Subjects by Provably Orthogonal and Crossover Experimental Designs”(JSS’24)
This program is tentative and subject to change.
Tue 14 AprDisplayed time zone: Brasilia, Distrito Federal, Brazil change
14:00 - 15:30 | Tutorial: Beyond A/B Testing - Orthogonal and Experimental Designs (Part 1)Tutorials and Technical Briefings at Bora Bora V Chair(s): Paris Avgeriou University of Groningen, The Netherlands, Uirá Kulesza Federal University of Rio Grande do Norte | ||
14:00 90mTalk | Tutorial: Beyond A/B Testing - Orthogonal and Experimental Designs Tutorials and Technical Briefings Fabio Massacci University of Trento; Vrije Universiteit Amsterdam, Aurora Papotti Vrije Universiteit Amsterdam, Katja Tuma Eindhoven University of Technology | ||
16:00 - 17:30 | Tutorial: Beyond A/B Testing - Orthogonal and Experimental Designs (Part 2)Tutorials and Technical Briefings at Bora Bora V Chair(s): Paris Avgeriou University of Groningen, The Netherlands, Uirá Kulesza Federal University of Rio Grande do Norte | ||
16:00 90mTalk | Tutorial: Beyond A/B Testing - Orthogonal and Experimental Designs Tutorials and Technical Briefings Fabio Massacci University of Trento; Vrije Universiteit Amsterdam, Aurora Papotti Vrije Universiteit Amsterdam, Katja Tuma Eindhoven University of Technology | ||