FSE 2025
Mon 23 - Fri 27 June 2025 Trondheim, Norway
co-located with ISSTA 2025
Wed 25 Jun 2025 14:00 - 14:20 at Cosmos Hall - LLM for SE 4 Chair(s): Ting Su

Large Language Models (LLMs) have significantly impacted numerous domains, including Software Engineering (SE). Many recent publications have explored LLMs applied to various SE tasks. Nevertheless, a comprehensive understanding of the application, effects, and possible limitations of LLMs on SE is still in its early stages. To bridge this gap, we conducted a systematic literature review (SLR) on LLM4SE, with a particular focus on understanding how LLMs can be exploited to optimize processes and outcomes. We selected and analyzed 395 research papers from January 2017 to January 2024 to answer four key research questions (RQs). In RQ1, we categorize different LLMs that have been employed in SE tasks, characterizing their distinctive features and uses. In RQ2, we analyze the methods used in data collection, preprocessing, and application, highlighting the role of well-curated datasets for successful LLM for SE implementation. RQ3 investigates the strategies employed to optimize and evaluate the performance of LLMs in SE. Finally, RQ4 examines the specific SE tasks where LLMs have shown success to date, illustrating their practical contributions to the field. From the answers to these RQs, we discuss the current state-of-the-art and trends, identifying gaps in existing research, and highlighting promising areas for future study. Our artifacts are publicly available at https://github.com/security-pride/LLM4SE_SLR.

Wed 25 Jun

Displayed time zone: Amsterdam, Berlin, Bern, Rome, Stockholm, Vienna change

14:00 - 15:20
LLM for SE 4Research Papers / Journal First at Cosmos Hall
Chair(s): Ting Su East China Normal University
14:00
20m
Talk
Large Language Models for Software Engineering: A Systematic Literature Review
Journal First
Xinyi Hou Huazhong University of Science and Technology, Yanjie Zhao Huazhong University of Science and Technology, Yue Liu Monash University, Zhou Yang Singapore Management University; University of Alberta, Kailong Wang Huazhong University of Science and Technology, Li Li Beihang University, Xiapu Luo Hong Kong Polytechnic University, David Lo Singapore Management University, John Grundy Monash University, Haoyu Wang Huazhong University of Science and Technology
14:20
20m
Talk
Calibration of Large Language Models on Code Summarization
Research Papers
Yuvraj Virk UC Davis, Prem Devanbu University of California at Davis, Toufique Ahmed IBM Research
DOI
14:40
20m
Talk
Code Red! On the Harmfulness of Applying Off-the-shelf Large Language Models to Programming Tasks
Research Papers
Ali Al-Kaswan Delft University of Technology, Netherlands, Sebastian Deatc Delft University of Technology, Begüm Koç Delft University of Technology, Arie van Deursen TU Delft, Maliheh Izadi Delft University of Technology
DOI Pre-print
15:00
20m
Talk
PATCH: Empowering Large Language Model with Programmer-Intent Guidance and Collaborative-Behavior Simulation for Automatic Bug Fixing
Journal First
Yuwei Zhang Institute of Software Chinese Academy of Sciences, Zhi Jin Peking University, xingying Beijing University of Posts and Telecommunications, Ge Li Peking University, Fang Liu Beihang University, Jiaxin Zhu Institute of Software at Chinese Academy of Sciences, Wensheng Dou Institute of Software Chinese Academy of Sciences, Jun Wei Institute of Software at Chinese Academy of Sciences; University of Chinese Academy of Sciences

Information for Participants
Wed 25 Jun 2025 14:00 - 15:20 at Cosmos Hall - LLM for SE 4 Chair(s): Ting Su
Info for room Cosmos Hall:

This is the main event hall of Clarion Hotel, which will be used to host keynote talks and other plenary sessions. The FSE and ISSTA banquets will also happen in this room.

The room is just in front of the registration desk, on the other side of the main conference area. The large doors with numbers “1” and “2” provide access to the Cosmos Hall.

:
:
:
: