ESEIW 2024
Sun 20 - Fri 25 October 2024 Barcelona, Spain

This program is tentative and subject to change.

Context Continuous experimentation (CE) is used by many companies with internet-facing products to improve their business models and software solutions based on user data. Some companies deliberately adopt a systematic experiment-driven approach to software develop- ment while some companies use CE in a more ad-hoc fashion.

Objective The goal of this study is to identify factors for success in CE that explain the variations in the utility and efficacy of CE between different companies.

Method We conducted a multi-case study of 12 companies involved with CE and performed 27 interviews with practitioners at these companies. Based on that empirical data, we then built a theory of factors at play in CE.

Results We introduce a theory of Factors Affecting Continuous Experimentation (FACE). The theory includes three factors, namely 1) processes and infrastructure for CE, 2) the user problem complexity of the product offering, and 3) incentive structures for CE. The theory explains how these factors affect the effectiveness of CE and its ability to achieve problem-solution and product-market fit.

Conclusions Our theory may inspire practitioners to assess an organisation’s potential for adopting CE and to identify factors that pose challenges in gaining value from CE practices. Our results also provide a basis for defining practitioner guidelines and a starting point for further research on how contextual factors affect CE and how these may be mitigated.

This program is tentative and subject to change.

Fri 25 Oct

Displayed time zone: Brussels, Copenhagen, Madrid, Paris change

16:00 - 17:10
Relationships and theory buildingESEM Journal-First Papers / ESEM Technical Papers at Multimedia (B3 Building - Hall)
Chair(s): Rogardt Heldal Western Norway University of Applied Science
16:00
20m
Full-paper
Gamification of a BPMN Modeling Course: an Analysis of Effectiveness and Student Perception
ESEM Technical Papers
Giacomo Garaccione Politecnico di Torino, Riccardo Coppola Politecnico di Torino, Luca Ardito Politecnico di Torino, Marco Torchiano Politecnico di Torino
16:20
20m
Full-paper
Data Analysis Tools Affect Outcomes of Eye-Tracking Studies
ESEM Technical Papers
Timon Dörzapf Saarland University, Saarland Informatics Campus, Norman Peitek Saarland University, Marvin Wyrich Saarland University, Sven Apel Saarland University
16:40
15m
Journal Early-Feedback
A Theory of Factors Affecting Continuous Experimentation (FACE)
ESEM Journal-First Papers
Rasmus Ros Theca Systems, Elizabeth Bjarnason Lund University, Sweden, Per Runeson Lund University
16:55
15m
Journal Early-Feedback
It’s about time: How to study intertemporal choice in systems design
ESEM Journal-First Papers
Fabian Fagerholm Aalto University, Andres De los Ríos , Carol Cárdenas-Castro S4N, Jenny Gil S4N, Alexander Chatzigeorgiou University of Macedonia, Apostolos Ampatzoglou University of Macedonia, Christoph Becker University of Toronto