Put The "Code" Back in "Code Comprehension Study"
This program is tentative and subject to change.
Despite numerous code comprehension studies, there is no consensus on what code features affect comprehensibility for software engineers. Results in these studies often contradict each other, even using similar methodologies or datasets. These contradictions make it difficult for both researchers and practitioners to derive replicable findings into code comprehension. Most prior studies employ controlled experiments with synthetic code, student subjects, single languages, short methods, and small sample sizes; these design decisions threaten their authenticity and generalizability. In this work, we approach code comprehension with a different set of restrictions: we examine 604k methods, across all method lengths, from real open open-source code systems across five programming languages, but do not control nor observe the environment in which the developers actually comprehended the code. We argue that we can still derive insight into comprehensibility since developers wrote, evolved, and reviewed the source code we examine, and that this means someone found the code comprehensible. Our methodology provides insight into reasons for prior inconsistencies and demon- strates the influence of experimental design decisions on results while providing actionable insights for software engineers who are trying to write comprehensible code. We find that Length—the number of lines of code in a method—heavily correlates with prior comprehension metrics and may be a confounder of prior results. We also find that comment presence serves as a useful comprehension metric: across all languages and projects, comments co-locate with large, complex, and hard-to-read code.
This program is tentative and subject to change.
Sun 12 AprDisplayed time zone: Brasilia, Distrito Federal, Brazil change
14:00 - 15:30 | Session 2 - Human AspectsResearch Track / Tool Demonstration / ICPC Program / Early Research Achievements (ERA) / Journal First at Europa II Chair(s): Alexander Serebrenik Eindhoven University of Technology, Masud Rahman Dalhousie University | ||
14:00 10mTalk | Do Developers Read Type Information? An Eye-Tracking Study on TypeScript Research Track Samuel W. Flint Dakota State University, Robert Dyer University of Nebraska-Lincoln, Bonita Sharif University of Nebraska-Lincoln, USA Pre-print Media Attached | ||
14:10 10mTalk | Eye-Tracking Insights into the Effects of Type Annotations and Identifier Naming Research Track Nils Alznauer University of Bern, Norman Peitek Saarland University, Youssef Abdelsalam Saarland University, Annabelle Bergum Saarland University, Marvin Wyrich Saarland University, Sven Apel Saarland University Pre-print | ||
14:20 5mTalk | Attention to Innovation: Linking Developer Gaze and Coding Approaches Early Research Achievements (ERA) Yahya Lafhal Polytechnique Montreal, Zohreh Sharafi Polytechnique Montréal, Mahta Amini Polytechnique Montréal | ||
14:25 10mTalk | Understanding the Low Inter-Rater Agreement on Aggressiveness on the Linux Kernel Mailing List Journal First Thomas Bock Carnegie Mellon University, Niklas Schneider Saarland University, Angelika Schmid IBM, Sven Apel Saarland University, Janet Siegmund Chemnitz University of Technology Link to publication Media Attached | ||
14:35 10mTalk | Grasping AI Reliance in Program Comprehension and Coding through the AIRELI Persona Taxonomy Research Track Tarek Alakmeh University of Zurich, Norman Anderson University of Victoria, Victoria Jackson University of Southampton, Guilherme Vaz Pereira School of Technology, PUCRS, Brazil, Umit Akirmak University of Victoria, Anthony Estey University of British Columbia, Rafael Prikladnicki School of Technology at PUCRS University, Andre van der Hoek University of California, Irvine, Margaret-Anne Storey University of Victoria, Thomas Fritz University of Zurich | ||
14:45 10mTalk | Put The "Code" Back in "Code Comprehension Study" Research Track | ||
14:55 10mTalk | The Way of Types: A Report on Developer Experience with Type-Driven Development Research Track Sára Juhošová Delft University of Technology, Andy Zaidman TU Delft, Jesper Cockx Delft University of Technology Pre-print | ||
15:05 10mTalk | Understanding Codebase like a Professional! Human-AI Collaboration for Code Comprehension Research Track Jie (Sophia) Gao The Johns Hopkins University, Yue Xue MetaTrust Labs, Xiaofei Xie Singapore Management University, Junming Cao Fudan University, SoeMin THANT Singapore-MIT Alliance for Research and Technology, Erika Lee University of California San Diego, Bowen Xu North Carolina State University | ||
15:15 5mTalk | Hyalinos: From Type Inference to Community Knowledge Tool Demonstration Larisa Safina INRIA Lillle - Nord Europe | ||
15:21 9mLive Q&A | Joint QA and Discussion ICPC Program | ||