ICST 2025
Mon 31 March - Fri 4 April 2025 Naples, Italy
Tue 1 Apr 2025 11:00 - 11:20 at Room A - CI at scale

In the dynamic environment of Meta, where thousands of developers manage repositories with millions of files, the DevInfra organization plays a crucial role in enhancing developer efficiency. This presentation outlines the development and implementation of top-level metrics that guide the prioritization of initiatives within DevInfra, ensuring efforts are focused on areas that significantly impact developer satisfaction. By leveraging the STEDII framework, which emphasizes Sensitivity, Trustworthiness, Efficiency, Debuggability, Interpretability, Actionability, Inclusivity, and Fairness, we established a set of reliable metrics validated through longitudinal studies and regular Developer Experience Surveys. Our approach addresses the limitations of high-level survey data by providing actionable insights through metrics. We introduced a common framework for debugging metrics, employing full, partial, and uniform blame models to attribute responsibility for negative experiences. Furthermore, the integration of these metrics with A/B testing systems allows for the assessment of potential changes before deployment, ensuring that modifications lead to genuine enhancements in developer experience. This presentation details the journey of developing these metrics, offering a replicable model for other organizations aiming to improve developer satisfaction through data-driven decision-making.

Tue 1 Apr

Displayed time zone: Amsterdam, Berlin, Bern, Rome, Stockholm, Vienna change

:
:
:
: