ICSE 2025
Sat 26 April - Sun 4 May 2025 Ottawa, Ontario, Canada
Mon 28 Apr 2025 16:40 - 17:00 at 106 - Student Perceptions Chair(s): Rafal Wlodarski

A few years after their release, Large Language Models (LLMs)-based tools are becoming an essential component of software education, as calculators are used in math courses. When learning software engineering (SE), the challenge is the extent to which LLMs are suitable and easy to use for different software development tasks. In this paper, we report the findings and lessons learned from using LLM-based tools—ChatGPT in particular—in five SE courses from four universities. After instructing students on the LLM potentials in SE and about prompting strategies, we ask participants to complete a survey and be involved in semi-structured interviews. The collected results report (i) indications about the usefulness of the LLM for different tasks, (ii) challenges to prompt the LLM, i.e., interact with it, (iii) challenges to adapt the generated artifacts to their own needs, and (iv) wishes about some valuable features students would like to see in LLM-based tools. Although results vary among different courses, also because of students’ seniority and course goals, the perceived usefulness is greater for low-level phases (e.g., coding or debugging/fault localization) than for analysis and design phases. Interaction and code adaptation challenges vary among tasks and are mostly related to the need for task-specific prompts, as well as better specification of the development context.

Mon 28 Apr

Displayed time zone: Eastern Time (US & Canada) change

16:00 - 17:30
Student PerceptionsCSEE&T at 106
Chair(s): Rafal Wlodarski Carnegie Mellon Silicon Valley
16:00
20m
Talk
Student Perceptions of Group Formation in Software Engineering Courses
CSEE&T
Fabian Fagerholm Aalto University, Stanislav Chren Aalto University, Lassi Haaranen Aalto University
Pre-print
16:20
20m
Talk
Understanding Students’ Experience and Perception of Gender Bias in a Software Engineering Education Environment
CSEE&T
Tanjila Kanij , Jonny PJ Low Monash University, John Grundy Monash University
Pre-print
16:40
20m
Talk
Students' Perception of ChatGPT in Software Engineering: Lessons Learned from Five Courses
CSEE&T
Luciano Baresi Politecnico di Milano, Andrea De Lucia University of Salerno, Antinisca Di Marco University of L'Aquila, Massimiliano Di Penta University of Sannio, Italy, Davide Di Ruscio University of L'Aquila, Leonardo Mariani University of Milano-Bicocca, Daniela Micucci University of Milano-Bicocca, Italy, Fabio Palomba University of Salerno, Maria Teresa Rossi University of Milano Bicocca, Italy, Fiorella Zampetti University of Sannio, Italy
Hide past events