Students' Perception of ChatGPT in Software Engineering: Lessons Learned from Five Courses
A few years after their release, Large Language Models (LLMs)-based tools are becoming an essential component of software education, as calculators are used in math courses. When learning software engineering (SE), the challenge is the extent to which LLMs are suitable and easy to use for different software development tasks. In this paper, we report the findings and lessons learned from using LLM-based tools—ChatGPT in particular—in five SE courses from four universities. After instructing students on the LLM potentials in SE and about prompting strategies, we ask participants to complete a survey and be involved in semi-structured interviews. The collected results report (i) indications about the usefulness of the LLM for different tasks, (ii) challenges to prompt the LLM, i.e., interact with it, (iii) challenges to adapt the generated artifacts to their own needs, and (iv) wishes about some valuable features students would like to see in LLM-based tools. Although results vary among different courses, also because of students’ seniority and course goals, the perceived usefulness is greater for low-level phases (e.g., coding or debugging/fault localization) than for analysis and design phases. Interaction and code adaptation challenges vary among tasks and are mostly related to the need for task-specific prompts, as well as better specification of the development context.
Mon 28 AprDisplayed time zone: Eastern Time (US & Canada) change
16:00 - 17:30 | |||
16:00 20mTalk | Student Perceptions of Group Formation in Software Engineering Courses CSEE&T Fabian Fagerholm Aalto University, Stanislav Chren Aalto University, Lassi Haaranen Aalto University Pre-print | ||
16:20 20mTalk | Understanding Students’ Experience and Perception of Gender Bias in a Software Engineering Education Environment CSEE&T Pre-print | ||
16:40 20mTalk | Students' Perception of ChatGPT in Software Engineering: Lessons Learned from Five Courses CSEE&T Luciano Baresi Politecnico di Milano, Andrea De Lucia University of Salerno, Antinisca Di Marco University of L'Aquila, Massimiliano Di Penta University of Sannio, Italy, Davide Di Ruscio University of L'Aquila, Leonardo Mariani University of Milano-Bicocca, Daniela Micucci University of Milano-Bicocca, Italy, Fabio Palomba University of Salerno, Maria Teresa Rossi University of Milano Bicocca, Italy, Fiorella Zampetti University of Sannio, Italy |