Fair Developer Score: Build-Adjusted Measurement of Effort and Impact
Assessing developer productivity in expansive software endeavors has become a pressing concern for both academia and industry, as organizations seek reliable ways to understand how engineering effort translates into business value. Traditional metrics—such as commit frequency, lines of code, or code churn—have been widely adopted but remain problematic, since they conflate inconsequential edits with architecturally significant reshaping and provide little insight into task-level contributions. To address this limitation, we introduce a commit-centric analytic framework that leverages clustering to reconfigure disbursed commit logs into coherent parcels, termed builds, that align more closely with the functional level of development tasks. Unlike prior approaches that combine heterogeneous signals such as issues, reviews, or communication logs, our method relies solely on the structural and temporal properties of commits, making it lightweight and broadly applicable. Each build is evaluated along two orthogonal axes: developer effort and build importance. Effort operationalizes the scale and character of contributions, considering code proprietorship, scope, architectural centrality, novelty, and cadence. Importance quantifies the build’s systemic consequence, integrating scale of alteration, distribution of changes, architectural centrality, complexity, task priority, and proximity to release milestones. The fusion of these axes produces the Fair Developer Score, a composite benchmark reconciling personal exertion with organizational value. Validation employs multiple strategies: correlation with process metrics such as pull-request lead time, rollback incidence, and rework ratios; distributional contrasts between central and peripheral developers; predictive regression to test explanatory power for future activity and defect-prone work; and quasi-experimental A/B designs to gauge responsiveness to environmental shifts. These protocols substantiate the reliability of the framework, confirming that the metric captures both the magnitude of development effort and its impact on the project.
Sun 16 NovDisplayed time zone: Seoul change
16:00 - 18:00 | |||
16:00 15mTalk | Fair Developer Score: Build-Adjusted Measurement of Effort and Impact Intelligent SE 2025 Xinzhou Wang Northwestern University, Jiancong Zhu Northwestern University, Jinghan Feng Northwestern University, Zixuan Zhang Northwestern University, Joshua Rauvola University of Chicago, Devon Delgado Digital Emissions, Ahmad Antar Digital Emissions, Abid Ali Northwestern University | ||
16:15 15mTalk | Optimizing LLM Code Suggestions: Feedback-Driven Timing with Lightweight State Bounds Intelligent SE 2025 Mohammad Nour Al Awad ITMO University, Sergey Ivanov ITMO University, Olga Tikhonova ITMO University | ||
16:30 15mTalk | Exploring the SECURITY.md in the Dependency Chain: Preliminary Analysis of the PyPI Ecosystem Intelligent SE 2025 Chayanid Termphaiboon Mahidol University, Raula Gaikovina Kula The University of Osaka, Youmei Fan Nara Institute of Science and Technology, Morakot Choetkiertikul Mahidol University, Thailand, Chaiyong Rakhitwetsagul Mahidol University, Thailand, Thanwadee Sunetnanta Mahidol University, Kenichi Matsumoto Nara Institute of Science and Technology | ||
16:45 15mTalk | Towards MPC-driven Software Adaptation: A Dual-Layer Approach Combining ICNN-based Modeling and Delta-based Tuning Intelligent SE 2025 Yitong Shi Institute of Science Tokyo, Chenyu Hu Institute of Science Tokyo, Mingyue Zhang Southwest University, NIANYU LI ZGC Lab, China, Jialong Li Waseda University, Japan, Kenji Tei Institute of Science Tokyo | ||
17:00 15mTalk | Explainable AI for Issue Classification: A Multi-class Study with LIME and SHAP Intelligent SE 2025 | ||