Investigating the Use of AI-Generated Exercises for Beginner and Intermediate Programming Courses: A ChatGPT Case Study
In recent years, artificial intelligence (AI) has been increasingly used in education and supports teachers in creating educational material and students in their learning progress. AI-driven learning support has recently been further strengthened by the release of ChatGPT, in which users can retrieve explanations for various concepts in a few minutes through chat. However, to what extent the use of AI models, such as ChatGPT, is suitable for the creation of didactically and content-wise good exercises for programming courses is not yet known. Therefore, in this paper, we investigate the use of AI-generated exercises for beginner and intermediate programming courses in higher education using ChatGPT. We created 12 exercise sheets with ChatGPT for a beginner to intermediate programming course focusing on the objects-first approach. We report our process, prompts, and experience using ChatGPT for this task and outline good practices we identified. The generated exercises are assessed and revised, primarily using ChatGPT, until they met the requirements of the programming course. We assessed the quality of these exercises by using them in our course at the University of Education Ludwigsburg and let the students evaluate them. Results indicate the quality of the generated exercises and the time-saving for creating them using ChatGPT. However, our experience showed that while it is fast to generate a good version of an exercise, almost every exercise requires minor manual changes to improve its quality.
Wed 9 AugDisplayed time zone: Osaka, Sapporo, Tokyo change
10:15 - 11:55 | [Research Track Short Papers] Data Science and AIResearch Papers at Room B114 - B115 Chair(s): D. Moritz Marutschke Kyoto University of Advanced Science | ||
10:15 20mShort-paper | Developing a Data Science Course to Support Software Engineering Students Research Papers | ||
10:35 20mShort-paper | Investigating the Use of AI-Generated Exercises for Beginner and Intermediate Programming Courses: A ChatGPT Case Study Research Papers Sandro Speth University of Stuttgart, Institute of Software Engineering, Niklas Meissner Institute of Software Engineering, University of Stuttgart, Steffen Becker University of Stuttgart Link to publication DOI File Attached | ||
10:55 20mShort-paper | PSAbot: A Chatbot System for the Analysis of Posts on Stack Overflow Research Papers An-Chi Shau National Taiwan Ocean University, Yan-Cih Liang National Taiwan Ocean University, Wan-Jung Hsieh National Yang Ming Chiao Tung University, Xiang-Ling Lin National Yang Ming Chiao Tung University, Shang-Pin Ma National Taiwan Ocean University | ||
11:15 20mShort-paper | Recommendations for programming exercises to overcome ChatGPT Research Papers Pre-print File Attached | ||
11:35 20mShort-paper | Toward AI-assisted Exercise Creation for First Course in Programming through Adversarial Examples of AI Models Research Papers Wing-Kwong Chan City University of Hong Kong, Hong Kong, Y.T. Yu City University of Hong Kong, Jacky Keung City University of Hong Kong, Victor C.S. Lee The University of Hong Kong |