Write a Blog >>
ICSE 2021
Sun 16 May - Sat 5 June 2021

This program is tentative and subject to change.

Wed 26 May 2021 18:50 - 19:10 at Blended Sessions Room 2 - 2.5.2. Developers: Experiments Chair(s): Sira Vegas

Static code analysis tools and integrated development environments present developers with quality-related software metrics, some of which are on how understandable their source code is. Software metrics influence overarching strategic decisions that impact the future of companies and the prioritization of everyday software development tasks. Several software metrics, however, lack in validation: we just choose to trust that they reflect what they are supposed to measure. Some of them were even shown to not measure the quality aspects they intend to measure. Yet, they influence us through biases in our cognitive-driven actions. In particular, they might anchor us in our decisions. Whether the anchoring effect exists with software metrics has not been studied yet.

We conduct a randomized and double-blind experiment to investigate the extent to which a displayed metric value for source code comprehensibility anchors developers in their subjective rating of source code comprehensibility, whether performance is affected by the anchoring effect when working on comprehension tasks, and which individual characteristics might play a role in the anchoring effect. We found that the displayed value of a comprehensibility metric has a significant and large anchoring effect on a developer’s code comprehensibility rating. The effect does not seem to affect the time or correctness when working on comprehension questions related to the code snippet under study. Since the anchoring effect is one of the most robust cognitive biases, and we have limited understanding of the consequences of the demonstrated manipulation of developers by non-validated metrics, we call for an increased awareness of the responsibility in code quality reporting and for corresponding tools to be based on scientific evidence.

This program is tentative and subject to change.

Wed 26 May
Times are displayed in time zone: Amsterdam, Berlin, Bern, Rome, Stockholm, Vienna change

18:50 - 19:50
2.5.2. Developers: ExperimentsTechnical Track / Journal-First Papers at Blended Sessions Room 2
Chair(s): Sira VegasUniversidad Politecnica de Madrid
18:50
20m
Paper
The Mind Is a Powerful Place: How Showing Code Comprehensibility Metrics Influences Code UnderstandingTechnical Track
Technical Track
Marvin WyrichUniversity of Stuttgart, Andreas PreikschatUniversity of Stuttgart, Daniel GraziotinUniversity of Stuttgart, Stefan WagnerUniversity of Stuttgart
Pre-print
19:10
20m
Paper
Program Comprehension and Code Complexity Metrics: An fMRI StudyArtifact ReusableTechnical TrackArtifact Available
Technical Track
Norman PeitekLeibniz Institute for Neurobiology, Sven ApelSaarland University, Chris ParninNorth Carolina State University, André BrechmannLeibniz Institute for Neurobiology, Janet SiegmundChemnitz University of Technology
Pre-print
19:30
20m
Paper
Comparing Block-based Programming Models for Two-armed RobotsJournal-First
Journal-First Papers
Nico RitschelThe University of British Columbia, Vladimir KovalenkoTU Delft, Reid HolmesUniversity of British Columbia, Ronald GarciaUniversity of British Columbia, David C. ShepherdVirginia Commonwealth University
Link to publication DOI Pre-print