FORGE 2025
Sun 27 - Mon 28 April 2025 Ottawa, Ontario, Canada
co-located with ICSE 2025

This program is tentative and subject to change.

This study examines code issue detection and revision automation by integrating Large Language Models (LLMs) such as OpenAI’s GPT-3.5 Turbo and GPT-4o into software development workflows. A static code analysis framework detects issues such as bugs, vulnerabilities, and code smells within a large-scale software project. Detailed information on each issue was extracted and organized to facilitate automated code revision through LLMs. An iterative prompt engineering process is applied to ensure that prompts are structured to produce accurate and organized outputs aligned with the project’s requirements. Retrieval-augmented generation (RAG) is implemented to enhance the relevance and precision of the revisions, enabling LLM to access and integrate real-time external knowledge. The issue of LLM hallucinations where the model generates plausible but incorrect outputs is addressed by a custom-built “Code Comparison App,” which identifies and corrects erroneous changes before applying them to the codebase. Subsequent scans using the static code analysis framework revealed a significant reduction in code issues, demonstrating the effectiveness of combining LLMs, static analysis, and RAG to improve code quality, streamline the software development process, and reduce time and resource expenditure.

This program is tentative and subject to change.

Sun 27 Apr

Displayed time zone: Eastern Time (US & Canada) change

16:00 - 17:30
Session2: FM for Software Quality Assurance & TestingResearch Papers / Data and Benchmarking at 207
16:00
12m
Long-paper
Augmenting Large Language Models with Static Code Analysis for Automated Code Quality Improvements
Research Papers
Seyed Moein Abtahi Ontario Tech University, Akramul Azim Ontario Tech University
16:12
12m
Long-paper
Benchmarking Prompt Engineering Techniques for Secure Code Generation with GPT Models
Research Papers
Marc Bruni University of Applied Sciences and Arts Northwestern Switzerland, Fabio Gabrielli University of Applied Sciences and Arts Northwestern Switzerland, Mohammad Ghafari TU Clausthal, Martin Kropp University of Applied Sciences and Arts Northwestern Switzerland
Pre-print
16:24
12m
Long-paper
Vulnerability-Triggering Test Case Generation from Third-Party Libraries
Research Papers
Yi Gao Zhejiang University, Xing Hu Zhejiang University, Zirui Chen , Tongtong Xu Nanjing University, Xiaohu Yang Zhejiang University
16:36
6m
Short-paper
Microservices Performance Testing with Causality-enhanced Large Language Models
Research Papers
Cristian Mascia University of Naples Federico II, Roberto Pietrantuono Università di Napoli Federico II, Antonio Guerriero Università di Napoli Federico II, Luca Giamattei Università di Napoli Federico II, Stefano Russo Università di Napoli Federico II
16:42
6m
Short-paper
MaRV: A Manually Validated Refactoring Dataset
Data and Benchmarking
Henrique Gomes Nunes Universidade Federal de Minas Gerais, Tushar Sharma Dalhousie University, Eduardo Figueiredo Federal University of Minas Gerais
16:48
6m
Short-paper
PyResBugs: A Dataset of Residual Python Bugs for Natural Language-Driven Fault Injection
Data and Benchmarking
Domenico Cotroneo University of Naples Federico II, Giuseppe De Rosa University of Naples Federico II, Pietro Liguori University of Naples Federico II
16:54
6m
Short-paper
The Heap: A Contamination-Free Multilingual Code Dataset for Evaluating Large Language Models
Data and Benchmarking
Jonathan Katzy Delft University of Technology, Răzvan Mihai Popescu Delft University of Technology, Arie van Deursen TU Delft, Maliheh Izadi Delft University of Technology
17:00
12m
Long-paper
ELDetector: An Automated Approach Detecting Endless-loop in Mini Programs
Research Papers
Nan Hu Xi’an Jiaotong University, Ming Fan Xi'an Jiaotong University, Jingyi Lei Xi'an Jiaotong University, Jiaying He Xi'an Jiaotong University, Zhe Hou China Mobile System Integration Co.
17:12
12m
Long-paper
Testing Android Third Party Libraries with LLMs to Detect Incompatible APIs
Research Papers
Tarek Mahmud Texas State University, bin duan University of Queensland, Meiru Che Central Queensland University, Anne Ngu Texas State University, Guowei Yang University of Queensland
:
:
:
: