Amplifiers or Equalizers? A Longitudinal Study of LLM Evolution in Software Engineering Project-Based Learning
As LLMs reshape software development, integrating LLM-augmented practices into SE education has become imperative. While existing studies explore LLMs’ educational use in introductory programming or isolated SE tasks, their impact in more open-ended Project-Based Learning (PBL) remains unexplored. This paper introduces a two-year longitudinal study comparing a 2024 (using early free LLMs) and 2025 (using latest paid LLMs) cohort. Our findings reveal the latest powerful LLMs’ dual role: they act as “equalizers,” boosting average performance even for programming-weak students, providing opportunities for more authentic SE practices; yet also as “amplifiers,” dramatically widening absolute performance gaps, creating new pedagogical challenges for addressing educational inequities.
Thu 16 AprDisplayed time zone: Brasilia, Distrito Federal, Brazil change
11:00 - 12:30 | Education 4Software Engineering Education and Training (SEET) at Oceania VI Chair(s): Andreia Malucelli Pontifícia Universidade Católica do Paraná | ||
11:00 15mTalk | Exploring the Community of Inquiry in Online Computing Education: Student Perceptions and Opportunities for Generative AI Software Engineering Education and Training (SEET) | ||
11:15 15mTalk | Prompting Without Principles: Are Students Transferring Software Engineering Knowledge to LLM Use? Software Engineering Education and Training (SEET) Leonardo Da Silva Sousa Carnegie Mellon University, USA, Ipek Ozkaya Carnegie Mellon University, James Ivers Carnegie Mellon University, Celina Cywinska Carnegie Mellon University, Bingyu Xie Carnegie Mellon University, Mena Kostial Carnegie Mellon University Software Engineering Institute, Tapajit Dey Carnegie Mellon University Software Engineering Institute, Robert Edman Carnegie Mellon Software Engineering Institute | ||
11:30 15mTalk | "Can you feel the vibes?": An exploration of novice programmer engagement with vibe coding Software Engineering Education and Training (SEET) Kiev Gama Universidade Federal de Pernambuco, Filipe Calegario Universidade Federal de Pernambuco, Victoria Jackson University of Southampton, Alexander Nolte Eindhoven University of Technology, Luiz Morais Universidade Federal de Pernambuco, Vinicius Cardoso Garcia Universidade Federal de Pernambuco | ||
11:45 15mTalk | The Clash of Codes: From Peer-to-Peer Duplication to AI-Generation in Introductory Programming Assignments Software Engineering Education and Training (SEET) Jose Maria Zuzarte Reis Claver Vrije Universiteit Amsterdam, i Mahbod Tajdin Vrije Universiteit Amsterdam, Mauricio Verano Merino Vrije Universiteit Amsterdam Pre-print | ||
12:00 15mTalk | AI-Assisted Code Review as a Scaffold for Code Quality and Self-Regulated Learning: An Experience Report Software Engineering Education and Training (SEET) Eduardo Araujo Oliveira The University of Melbourne, Michael Fu The University of Melbourne, Patanamon Thongtanunam University of Melbourne, Sonsoles López-Pernas University of Eastern Finland, Mohammed Saqr University of Eastern Finland | ||
12:15 15mTalk | Amplifiers or Equalizers? A Longitudinal Study of LLM Evolution in Software Engineering Project-Based Learning Software Engineering Education and Training (SEET) | ||