C-Pack of IPAs: A C90 Program Benchmark of Introductory Programming Assignments
Given the vast number of students enrolled in Massive Open Online Courses (MOOCs), there has been a notable surge in automated program repair techniques tailored for introductory programming assignments (IPAs). These techniques leverage correct student implementations to provide automated, comprehensive, and personalized feedback to the students. This paper presents C-Pack-IPAs, a publicly available benchmark comprising student-program submissions for 25 distinct IPAs. C-Pack-IPAs contains semantically correct, semantically incorrect, and syntactically incorrect programs, along with a dedicated test suite for each IPA. Hence, C-Pack-IPAs serves as a valuable resource for evaluating the progress of novel automated program repair frameworks, addressing both semantic and syntactic aspects, with a specific focus on providing feedback to novice programmers. Notably, some semantically incorrect programs in C-Pack-IPAs have been manually fixed and annotated with diverse program features, enhancing their utility for the development of various program analysis frameworks. Moreover, we conducted evaluations on C-Pack-IPAs using two leading semantic program repair tools tailored for IPAs, Clara and Verifix.
Sat 20 AprDisplayed time zone: Lisbon change
11:00 - 12:30 | |||
11:00 60mKeynote | Lessons from Industry on Automated Program Repair APR Serkan Kirbas Bloomberg LP | ||
12:00 15mTalk | BUGFIX: towards a common language and framework for the Automatic Program Repair community APR Viktoryia Kananchuk , Li Huang Constructor Institute Schaffhausen, Bertrand Meyer Constructor Institute Schaffhausen | ||
12:15 15mTalk | C-Pack of IPAs: A C90 Program Benchmark of Introductory Programming Assignments APR Pedro Orvalho INESC-ID, Instituto Superior Técnico, Universidade de Lisboa, Mikoláš Janota Czech Technical University in Prague, Vasco Manquinho INESC-ID; Universidade de Lisboa Pre-print |