An Experience Report on a Pedagogically Controlled, Curriculum-Constrained AI Tutor for SE Education
The integration of artificial intelligence (AI) into education continues to evoke both promise and skepticism. While past waves of technological optimism often fell short, recent advances in large language models (LLMs) have revived the vision of scalable, individualized tutoring. This paper presents the design and pilot evaluation of RockStartIT Tutor, an AI-powered assistant developed for a digital programming and computational thinking course within the RockStartIT initiative. Powered by GPT-4 via OpenAI’s Assistant API, the tutor employs a novel prompting strategy and a modular, semantically tagged knowledge base to deliver context-aware, personalized, and curriculum-constrained support for secondary school students.
We evaluated the system using the Technology Acceptance Model (TAM) with 13 students and teachers. Learners appreciated the low-stakes environment for asking questions and receiving scaffolded guidance. Educators emphasized the system’s potential to reduce cognitive load during independent tasks and complement classroom teaching. Key challenges include prototype limitations, a small sample size, and the need for long-term studies with the target age group.
Our findings highlight a pragmatic approach to AI integration that requires no model training, using structure and prompts to shape behavior. We position AI tutors not as teacher replacements but as enabling tools that extend feedback access, foster inquiry, and support what schools do best: help students learn.
Fri 17 AprDisplayed time zone: Brasilia, Distrito Federal, Brazil change
14:00 - 15:30 | Education 8Software Engineering Education and Training (SEET) at Oceania VI Chair(s): Fabio Kon University of São Paulo | ||
14:00 15mTalk | Beyond Answer Engines: LLMs as Reasoning Partners in Data Structures and Algorithms Education Software Engineering Education and Training (SEET) Saad Zafar Khan University of Calgary, Desiree Leal University of Calgary, Lucas Valença University of Calgary, Ahmad Abdellatif University of Calgary, Mea Wang University of Calgary, Diwakar Krishnamurthy University of Calgary, Ronnie de Souza Santos University of Calgary | ||
14:15 15mTalk | The Boundary-Spanning Assistant: Understanding the Role and Usage patterns of LLMs in Project-Based Software Engineering Software Engineering Education and Training (SEET) Anh Nguyen-Duc University of South Eastern Norway, Kai-Kristian Kemell Tampere University, Aparna Chirumamilla NTNU | ||
14:30 15mTalk | An Experience Report on a Pedagogically Controlled, Curriculum-Constrained AI Tutor for SE Education Software Engineering Education and Training (SEET) Lucia Happe Karlsruhe Institute of Technology, Dominik Fuchß Karlsruhe Institute of Technology (KIT), Luca Hüttner Karlsruhe Institute of Technology (KIT), Kai Marquardt Karlsruhe Institute of Technology (KIT), Anne Koziolek Karlsruhe Institute of Technology DOI Pre-print | ||
14:45 15mTalk | Enhancing Debugging Skills With AI-Powered Assistance: A Real-Time Tool for Debugging Support Software Engineering Education and Training (SEET) Elizaveta Artser JetBrains Research, Daniil Karol Researcher at Education Research at JetBrains Research, Anna Potriasaeva JetBrains Research, Aleksei Rostovskii JetBrains Research, Katsiaryna Dzialets JetBrains, Ekaterina Koshchenko JetBrains Research, Xiaotian Su ETH Zurich, April Wang ETH Zürich, Anastasiia Birillo JetBrains Research | ||
15:00 15mTalk | Learning to Program Alongside AI: Critical Thinking, AI Ethics, and Gendered Patterns of German Secondary School Students Software Engineering Education and Training (SEET) Isabella Graßl Technical University of Darmstadt | ||