CSEE&T 2023
Mon 7 - Wed 9 August 2023 Tokyo, Japan

In recent years, artificial intelligence (AI) has been increasingly used in education and supports teachers in creating educational material and students in their learning progress. AI-driven learning support has recently been further strengthened by the release of ChatGPT, in which users can retrieve explanations for various concepts in a few minutes through chat. However, to what extent the use of AI models, such as ChatGPT, is suitable for the creation of didactically and content-wise good exercises for programming courses is not yet known. Therefore, in this paper, we investigate the use of AI-generated exercises for beginner and intermediate programming courses in higher education using ChatGPT. We created 12 exercise sheets with ChatGPT for a beginner to intermediate programming course focusing on the objects-first approach. We report our process, prompts, and experience using ChatGPT for this task and outline good practices we identified. The generated exercises are assessed and revised, primarily using ChatGPT, until they met the requirements of the programming course. We assessed the quality of these exercises by using them in our course at the University of Education Ludwigsburg and let the students evaluate them. Results indicate the quality of the generated exercises and the time-saving for creating them using ChatGPT. However, our experience showed that while it is fast to generate a good version of an exercise, almost every exercise requires minor manual changes to improve its quality.

Wed 9 Aug

Displayed time zone: Osaka, Sapporo, Tokyo change

10:15 - 11:55
[Research Track Short Papers] Data Science and AIResearch Papers at Room B114 - B115
Chair(s): D. Moritz Marutschke Kyoto University of Advanced Science
10:15
20m
Short-paper
Developing a Data Science Course to Support Software Engineering Students
Research Papers
10:35
20m
Short-paper
Investigating the Use of AI-Generated Exercises for Beginner and Intermediate Programming Courses: A ChatGPT Case Study
Research Papers
Sandro Speth University of Stuttgart, Institute of Software Engineering, Niklas Meissner Institute of Software Engineering, University of Stuttgart, Steffen Becker University of Stuttgart
Link to publication DOI File Attached
10:55
20m
Short-paper
PSAbot: A Chatbot System for the Analysis of Posts on Stack Overflow
Research Papers
An-Chi Shau National Taiwan Ocean University, Yan-Cih Liang National Taiwan Ocean University, Wan-Jung Hsieh National Yang Ming Chiao Tung University, Xiang-Ling Lin National Yang Ming Chiao Tung University, Shang-Pin Ma National Taiwan Ocean University
11:15
20m
Short-paper
Recommendations for programming exercises to overcome ChatGPT
Research Papers
Jonnathan Berrezueta-Guzman , Stephan Krusche Technische Universität München
Pre-print File Attached
11:35
20m
Short-paper
Toward AI-assisted Exercise Creation for First Course in Programming through Adversarial Examples of AI Models
Research Papers
Wing-Kwong Chan City University of Hong Kong, Hong Kong, Y.T. Yu City University of Hong Kong, Jacky Keung City University of Hong Kong, Victor C.S. Lee The University of Hong Kong