ICPC 2026
Sun 12 - Mon 13 April 2026 Rio de Janeiro, Brazil
co-located with ICSE 2026

Unit testing is essential for verifying the functional correctness of code modules (e.g., classes, methods), but manual test development is often labour-intensive and time-consuming. Unit tests generated by tools that employ traditional approaches, such as search-based software testing (SBST), lack readability, naturalness, and practical usability. LLMs have recently provided promising results and become integral to developers’ daily practices. Consequently, software repositories now include a mix of human-written tests, LLM-generated tests, and those from tools employing traditional approaches such as SBST. While LLMs’ zero-shot capabilities have been widely studied, their few-shot learning potential for unit test generation remains underexplored. Few-shot prompting enables LLMs to learn from examples in the prompt, and automatically retrieving such examples could enhance test suites. This study investigates how the origin of few-shot examples—human, SBST, or LLM—affects the quality of generated tests. We conducted experiments on HumanEval and ClassEval datasets using GPT-4.o, which is integrated into GitHub Copilot and widely used among developers. During our experiments, we evaluated the functional correctness, coverage, and quality of generated tests and their contribution to improving existing test suites. We also assessed retrieval-based methods for selecting relevant examples. Our results show that LLMs can generate high-quality tests via few-shot prompting, with human-written examples producing the best coverage and correctness. Additionally, selecting examples based on the combined similarity of problem description and code consistently yields the most effective few-shot prompts.

Mon 13 Apr

Displayed time zone: Brasilia, Distrito Federal, Brazil change

14:00 - 15:30
Session 6 - LLM-based Code Generation and UnderstandingResearch Track / ICPC Program at Europa II
Chair(s): Banani Roy University of Saskatchewan
14:00
10m
Talk
Evaluating the Impact of Post-Training Quantization on Large Language Models for Code Generation
Research Track
Alessandro Giagnorio Software Institute @ Università della Svizzera italiana, Antonio Mastropaolo William and Mary, USA, Saima Afrin William and Mary, USA, Massimiliano Di Penta University of Sannio, Italy, Gabriele Bavota Software Institute @ Università della Svizzera Italiana
Pre-print
14:10
10m
Talk
Guidelines to Prompt Large Language Models for Code Generation: An Empirical Characterization
Research Track
Alessandro Midolo University of Catania, Alessandro Giagnorio Software Institute @ Università della Svizzera italiana, Fiorella Zampetti University of Sannio, Italy, Rosalia Tufano Università della Svizzera Italiana, Gabriele Bavota Software Institute @ Università della Svizzera Italiana, Massimiliano Di Penta University of Sannio, Italy
Pre-print
14:20
10m
Talk
From Generation to Reasoning: Chain-of-Thought Guided Merge Conflict Resolution
Research Track
Chunyou Peng Southwest University, Zhengnan Zhang Southwest University, China, Shmuel Tyszberowicz The Academic College of Tel-Aviv Yaffo, Zhiming Liu Southwest University, Bo Liu Southwest University
14:30
10m
Talk
Algorithm-Based Pipeline for Reliable and Intent-Preserving Code Translation with LLMs
Research Track
Shahriar Rumi Dipto University of Saskatchewan, Saikat Mondal University of Saskatchewan, Chanchal K. Roy University of Saskatchewan
Pre-print Media Attached File Attached
14:40
10m
Research paper
Leveraging Change Types and Contexts to Guide LLMs for Automated Test Code Updating
Research Track
Taicheng Huang Sun Yat-sen University, Xiangping Chen Sun Yat-sen University, Yuan Huang Sun Yat-sen University, Changlin Yang Sun Yat-sen University
Media Attached
14:50
10m
Talk
Automated Test Suite Enhancement Using Large Language Models with Few-shot Prompting
Research Track
Alex Chudic US Booking Services Ltd. (freetobook), Gül Calikli University of Glasgow
Pre-print File Attached
15:00
10m
Talk
Palm: Path-aware LLM-based Test Generation with Comprehension
Research Track
Yaoxuan Wu UCLA, Xiaojie Zhou UCLA, Ahmad Humayun Virginia Tech, Muhammad Ali Gulzar Virginia Tech, Miryung Kim UCLA and Amazon Web Services
Link to publication Media Attached
15:10
20m
Live Q&A
Joint QA and Discussion
ICPC Program