CSEE&T 2023
Mon 7 - Wed 9 August 2023 Tokyo, Japan

Large language models, such as ChatGPT, possess the potential to revolutionize educational practices across various domains. Nonetheless, the deployment of these models can inadvertently foster academic dishonesty due to their facile accessibility. In practical courses like programming, where hands-on experience is crucial for learning, relying solely on ChatGPT can hinder students’ ability to engage with the exercises, consequently impeding the attainment of learning outcomes. This paper conducts an experimental analysis of GPT 3.5 and GPT 4, gauging their proficiencies and constraints in resolving a compendium of 22 programming exercises. We discern and categorize exercises based on ChatGPT’s ability to furnish viable solutions, alongside those that remain unaddressed. Moreover, an evaluation of the malleability of the solutions proposed by ChatGPT is undertaken. Subsequently, we propound a series of recommendations aimed at curtailing undue dependence on ChatGPT, thereby fostering authentic competency development in programming. The efficaciousness of these recommendations is underpinned by their integration into the design and delivery of an examination as part of the corresponding course.

Recommendations for programming exercises to overcome ChatGPT (berrezueta2023cseet.pdf)260KiB

Wed 9 Aug

Displayed time zone: Osaka, Sapporo, Tokyo change

10:15 - 11:55
[Research Track Short Papers] Data Science and AIResearch Papers at Room B114 - B115
Chair(s): D. Moritz Marutschke Kyoto University of Advanced Science
10:15
20m
Short-paper
Developing a Data Science Course to Support Software Engineering Students
Research Papers
10:35
20m
Short-paper
Investigating the Use of AI-Generated Exercises for Beginner and Intermediate Programming Courses: A ChatGPT Case Study
Research Papers
Sandro Speth University of Stuttgart, Institute of Software Engineering, Niklas Meissner Institute of Software Engineering, University of Stuttgart, Steffen Becker University of Stuttgart
File Attached
10:55
20m
Short-paper
PSAbot: A Chatbot System for the Analysis of Posts on Stack Overflow
Research Papers
An-Chi Shau National Taiwan Ocean University, Yan-Cih Liang National Taiwan Ocean University, Wan-Jung Hsieh National Yang Ming Chiao Tung University, Xiang-Ling Lin National Yang Ming Chiao Tung University, Shang-Pin Ma National Taiwan Ocean University
11:15
20m
Short-paper
Recommendations for programming exercises to overcome ChatGPT
Research Papers
Jonnathan Berrezueta-Guzman , Stephan Krusche Technische Universität München
Pre-print File Attached
11:35
20m
Short-paper
Toward AI-assisted Exercise Creation for First Course in Programming through Adversarial Examples of AI Models
Research Papers
Wing-Kwong Chan City University of Hong Kong, Hong Kong, Y.T. Yu City University of Hong Kong, Jacky Keung City University of Hong Kong, Victor C.S. Lee The University of Hong Kong