Fri 6 Sep 2024 14:25 - 14:45 at LT1 - Session 12: Ethics and AI Chair(s): Andreas Bexell

Bias is an inherent threat to human decision-making, including in decisions made during software development. Extensive research has demonstrated the presence of biases at various stages of the software development life-cycle. Notably, code reviews are highly susceptible to prejudice-induced biases, and individuals are often unaware of these biases as they occur. Developing methods to automatically detect these biases is crucial for addressing the associated challenges. Recent advancements in visual data analytics have shown promising results in detecting potential biases by analyzing user interaction patterns. In this project, we propose a controlled experiment to extend this approach to detect potentially biased outcomes in code reviews by observing how reviewers interact with the code. We employ the “spotlight model of attention”, a cognitive framework where a reviewer’s gaze is tracked to determine their focus areas on the review screen. This focus, identified through gaze tracking, serves as an indicator of the reviewer’s areas of interest or concern. We plan to analyze the sequence of gaze focus using advanced sequence modeling techniques, including Markov Models, Recurrent Neural Networks (RNNs), and Conditional Random Fields (CRF). These techniques will help us identify patterns that may suggest biased interactions. We anticipate that the ability to automatically detect potentially biased interactions in code reviews will significantly reduce unnecessary push-backs, enhance operational efficiency, and foster greater diversity and inclusion in software development. This approach not only helps in identifying biases but also in creating a more equitable development environment by mitigating these biases effectively

Fri 6 Sep

Displayed time zone: London change

14:00 - 15:30
Session 12: Ethics and AIPPIG papers at LT1
Chair(s): Andreas Bexell Ericsson
14:00
25m
Talk
Educational Tools for Probabilistic Machine Learning Curriculum in Schools
PPIG papers
Josephine Rey University of Cambridge, Alan Blackwell University of Cambridge, Xinyue Li Cambridge University Press and Assessment, Gemma Penson University of Cambridge, Hong Ge University of Cambridge, Helen Arnold Freelance
14:25
20m
Short-paper
Proposed Experiment on Automatic Bias Detection in Source Code Review
PPIG papers
Yoseph Berhanu Alebachew Virginia Tech, Chris Brown Virginia Tech
Link to publication Pre-print
14:45
20m
Talk
Ethical Integration in Computer Science Education: Leveraging Open Educational Resources and Generative Artificial Intelligence for Enhanced Learning
PPIG papers
Ranjidha Rajan Department of Computer Science, MSU Denver, Renato Cortinovis Independent researcher
15:05
25m
Talk
Intention is All You Need
PPIG papers
Advait Sarkar Microsoft Research and University of Cambridge
Pre-print