The Clash of Codes: From Peer-to-Peer Duplication to AI-Generation in Introductory Programming Assignments
Generative AI tools such as ChatGPT, GitHub Copilot, and Gemini have rapidly transformed programming education by providing instant code generation and problem-solving support. This study analyzes the possible impact of these tools on an introductory Python programming course through an observational analysis through two different cohorts in 2022 and 2024. In total, we analyzed a corpus of 1,614 submissions from three assignments. To study the possible influence of AI gen AI tools, we created baseline solutions for each assignment using ChatGPT and Gemini. Then, we study code similarity between the baseline and the students’ submissions and and syntax errors across both cohorts. The results show that in Assignment 2, there was a decrease of 60.11% in peer-to-peer duplication between 2022 and 2024. For 2024 submissions, we observe substantial similarity to fixed AI baselines. Although this pattern is consistent with the convergence toward AI-generated solutions, we lack direct measures of tool use and make no causal claims. The number of syntax errors did not show statistically significant differences over the years. These findings suggest a shift in programming education, from direct student copying toward solutions that increasingly resemble AI-generated outputs, emphasizing the need for updated assessments and policies to promote fairness, integrity, and meaningful learning in introductory programming courses.
Thu 16 AprDisplayed time zone: Brasilia, Distrito Federal, Brazil change
11:00 - 12:30 | Education 4Software Engineering Education and Training (SEET) at Oceania VI Chair(s): Andreia Malucelli Pontifícia Universidade Católica do Paraná | ||
11:00 15mTalk | Exploring the Community of Inquiry in Online Computing Education: Student Perceptions and Opportunities for Generative AI Software Engineering Education and Training (SEET) | ||
11:15 15mTalk | Prompting Without Principles: Are Students Transferring Software Engineering Knowledge to LLM Use? Software Engineering Education and Training (SEET) Leonardo Da Silva Sousa Carnegie Mellon University, USA, Ipek Ozkaya Carnegie Mellon University, James Ivers Carnegie Mellon University, Celina Cywinska Carnegie Mellon University, Bingyu Xie Carnegie Mellon University, Mena Kostial Carnegie Mellon University Software Engineering Institute, Tapajit Dey Carnegie Mellon University Software Engineering Institute, Robert Edman Carnegie Mellon Software Engineering Institute | ||
11:30 15mTalk | "Can you feel the vibes?": An exploration of novice programmer engagement with vibe coding Software Engineering Education and Training (SEET) Kiev Gama Universidade Federal de Pernambuco, Filipe Calegario Universidade Federal de Pernambuco, Victoria Jackson University of Southampton, Alexander Nolte Eindhoven University of Technology, Luiz Morais Universidade Federal de Pernambuco, Vinicius Cardoso Garcia Universidade Federal de Pernambuco | ||
11:45 15mTalk | The Clash of Codes: From Peer-to-Peer Duplication to AI-Generation in Introductory Programming Assignments Software Engineering Education and Training (SEET) Jose Maria Zuzarte Reis Claver Vrije Universiteit Amsterdam, i Mahbod Tajdin Vrije Universiteit Amsterdam, Mauricio Verano Merino Vrije Universiteit Amsterdam Pre-print | ||
12:00 15mTalk | AI-Assisted Code Review as a Scaffold for Code Quality and Self-Regulated Learning: An Experience Report Software Engineering Education and Training (SEET) Eduardo Araujo Oliveira The University of Melbourne, Michael Fu The University of Melbourne, Patanamon Thongtanunam University of Melbourne, Sonsoles López-Pernas University of Eastern Finland, Mohammed Saqr University of Eastern Finland | ||
12:15 15mTalk | Amplifiers or Equalizers? A Longitudinal Study of LLM Evolution in Software Engineering Project-Based Learning Software Engineering Education and Training (SEET) | ||