AI-Assisted Code Review as a Scaffold for Code Quality and Self-Regulated Learning: An Experience Report
This program is tentative and subject to change.
Code review is central to software engineering education but hard to scale in capstones due to tight deadlines, uneven peer feedback, and limited prior experience. We investigate an LLM-as-reviewer integrated directly into GitHub pull requests (human-in-the-loop) across two cohorts (>100 students, 2023–2024). Using a mixed-methods design—GitHub data, reflective reports, and a targeted survey—we examine engagement and responsiveness as behavioural indicators of self-regulated learning processes. Quantitatively, the 2024 cohort produced more iterative activity (1176 vs. 581 PRs), while technical issues observed in 2023 (227 failed AI attempts) dropped to zero after tool and instructional refinements. Despite different adoption levels (teams using the tool: 93% vs. 50%), responsiveness was stable: 32% (2023) and 33% (2024) of successfully AI-reviewed PRs were followed by subsequent commits on the same PR. Qualitatively, students used the LLM’s structured comments to focus reviews and discuss code quality, while guidance reduced over-reliance. We contribute: (i) an in-workflow design for an AI reviewer that scaffolds learning while mitigating cognitive offloading; (ii) a repeated cross-sectional comparison across two cohorts in authentic settings; (iii) a mixed-methods analysis combining objective GitHub metrics with student self-reports; and (iv) evidence-based pedagogical recommendations for responsible, student-led AI-assisted review.
This program is tentative and subject to change.
Thu 16 AprDisplayed time zone: Brasilia, Distrito Federal, Brazil change
11:00 - 12:30 | Education 4Software Engineering Education and Training (SEET) at Oceania VI Chair(s): Andreia Malucelli Pontifícia Universidade Católica do Paraná | ||
11:00 15mTalk | Exploring the Community of Inquiry in Online Computing Education: Student Perceptions and Opportunities for Generative AI Software Engineering Education and Training (SEET) | ||
11:15 15mTalk | Prompting Without Principles: Are Students Transferring Software Engineering Knowledge to LLM Use? Software Engineering Education and Training (SEET) Leonardo Da Silva Sousa Carnegie Mellon University, USA, Ipek Ozkaya Carnegie Mellon University, James Ivers Carnegie Mellon University, Celina Cywinska Carnegie Mellon University, Bingyu Xie Carnegie Mellon University, Mena Kostial Carnegie Mellon University Software Engineering Institute, Tapajit Dey Carnegie Mellon University Software Engineering Institute, Robert Edman Carnegie Mellon Software Engineering Institute | ||
11:30 15mTalk | "Can you feel the vibes?": An exploration of novice programmer engagement with vibe coding Software Engineering Education and Training (SEET) Kiev Gama Universidade Federal de Pernambuco, Filipe Calegario Universidade Federal de Pernambuco, Victoria Jackson University of Southampton, Alexander Nolte Eindhoven University of Technology, Luiz Morais Universidade Federal de Pernambuco, Vinicius Cardoso Garcia Universidade Federal de Pernambuco | ||
11:45 15mTalk | The Clash of Codes: From Peer-to-Peer Duplication to AI-Generation in Introductory Programming Assignments Software Engineering Education and Training (SEET) Jose Maria Zuzarte Reis Claver Vrije Universiteit Amsterdam, i Mahbod Tajdin Vrije Universiteit Amsterdam, Mauricio Verano Merino Vrije Universiteit Amsterdam | ||
12:00 15mTalk | AI-Assisted Code Review as a Scaffold for Code Quality and Self-Regulated Learning: An Experience Report Software Engineering Education and Training (SEET) Eduardo Araujo Oliveira The University of Melbourne, Michael Fu The University of Melbourne, Patanamon Thongtanunam University of Melbourne, Sonsoles López-Pernas University of Eastern Finland, Mohammed Saqr University of Eastern Finland | ||
12:15 15mTalk | Amplifiers or Equalizers? A Longitudinal Study of LLM Evolution in Software Engineering Project-Based Learning Software Engineering Education and Training (SEET) | ||