ICSE 2024
Fri 12 - Sun 21 April 2024 Lisbon, Portugal
Fri 19 Apr 2024 14:45 - 15:00 at Grande Auditório - LLM, NN and other AI technologies 6 Chair(s): Bowen Xu

Practical programming assignments are critical parts of programming courses in Computer Science education. Students are expected to translate programming concepts learned from lectures into executable implementations that solve the tasks outlined in the assignments. These implementations are primarily assessed based on their functional correctness, ensuring that students’ code produces the expected output when provided with specific inputs.

However, functional correctness is not the only metric that evaluates the quality of a source code program. Runtime efficiency is a metric that is less frequently evaluated in programming courses, yet it holds significant importance in the context of professional software development. To investigate this gap and its potential ramifications, we conducted a large-scale empirical study on the time efficiency of 250 programming assignments that are evaluated solely on functional correctness. The results demonstrate that students’ programming assignments exhibit significant variance in terms of execution time, with much of this variance being reducible by leveraging automated tools such as PMD, IntelliJ IDEA and ChatGPT. We further identified 27 recurring inefficient code patterns and their fixes, providing actionable guidelines for educators to enhance the organization and integration of code performance topics throughout the programming course curriculum.

Fri 19 Apr

Displayed time zone: Lisbon change

14:00 - 15:30
LLM, NN and other AI technologies 6Software Engineering Education and Training / Research Track / Software Engineering in Practice at Grande Auditório
Chair(s): Bowen Xu North Carolina State University
14:00
15m
Talk
Make LLM a Testing Expert: Bringing Human-like Interaction to Mobile GUI Testing via Functionality-aware Decisions
Research Track
Zhe Liu Institute of Software, Chinese Academy of Sciences, Chunyang Chen Technical University of Munich (TUM), Junjie Wang Institute of Software, Chinese Academy of Sciences, Mengzhuo Chen Institute of Software, Chinese Academy of Sciences, Boyu Wu University of Chinese Academy of Sciences, Beijing, China, Xing Che Institute of Software, Chinese Academy of Sciences, Dandan Wang Institute of Software, Chinese Academy of Sciences, Qing Wang Institute of Software, Chinese Academy of Sciences
14:15
15m
Talk
Automated Detection of AI-Obfuscated Plagiarism in Modeling Assignments
Software Engineering Education and Training
Timur Sağlam Karlsruhe Institute of Technology (KIT), Sebastian Hahner Karlsruhe Institute of Technology (KIT), Larissa Schmid Karlsruhe Institute of Technology, Erik Burger Karlsruhe Institute of Technology (KIT)
DOI Pre-print
14:30
15m
Talk
AI-Tutoring in Software Engineering Education
Software Engineering Education and Training
Eduard Frankford University of Innsbruck, Clemens Sauerwein University of Innsbruck, Patrick Bassner Technical University of Munich, Stephan Krusche Technical University of Munich, Ruth Breu University of Innsbruck
DOI Pre-print
14:45
15m
Talk
Beyond Functional Correctness: An Exploratory Study on the Time Efficiency of Programming Assignments
Software Engineering Education and Training
Yida Tao Southern University of Science and Technology, Wenyan Chen Southern University of Science and Technology, Qingyang Ye Southern University of Science and Technology, Yao Zhao Southern University of Science and Technology
15:00
15m
Talk
Does ChatGPT Help With Introductory Programming?An Experiment of Students Using ChatGPT in CS1
Software Engineering Education and Training
Yuankai Xue Vanderbilt University, Hanlin Chen Vanderbilt University, Gina Bai North Carolina State University, Robert Tairas Vanderbilt University, Yu Huang Vanderbilt University
15:15
15m
Talk
A New Frontier of AI: On-Device AI Training and Personalization
Software Engineering in Practice
Jijoong Moon Samsung Electronics, Hyun Suk Lee Samsung Electronics, Jiho Chu Samsung Electronics, Donghak Park Samsung Electronics, Seungbaek Hong Samsung Electronics, Hyungjun Seo Samsung Electronics, Donghyeon Jeong Samsung Electronics, Sungsik Kong Samsung Electronics, MyungJoo Ham Samsung Electronics
Pre-print