Sun 27 AprDisplayed time zone: Eastern Time (US & Canada) change
09:00 - 10:30 | FORGE2025 Opening / KeynoteKeynotes at 207 Chair(s): David Lo Singapore Management University, Denys Poshyvanyk William & Mary | ||
09:00 10mDay opening | Introduction from The Chairs Keynotes Xin Xia Huawei, David Lo Singapore Management University, Cuiyun Gao Harbin Institute of Technology, Denys Poshyvanyk William & Mary | ||
09:10 60mKeynote | Keynote: LLMs (for code) are often wrong. What to do? Keynotes Prem Devanbu University of California at Davis |
11:00 - 12:30 | |||
11:00 60mKeynote | Keynote: Trust No Bot? Forging Confidence in AI for Software Engineering Keynotes Thomas Zimmermann University of California, Irvine | ||
12:00 30mPanel | Panel Discussion Panel |
13:30 - 14:00 | |||
14:00 - 15:30 | Session1: FM for Code Generation Research Papers / Data and Benchmarking at 207 Chair(s): Lili Wei McGill University | ||
14:00 12mLong-paper | RepoHyper: Search-Expand-Refine on Semantic Graphs for Repository-Level Code Completion Research Papers Huy Nhat Phan FPT Software AI Center, Hoang Nhat Phan Nanyang Technological University, Tien N. Nguyen University of Texas at Dallas, Nghi D. Q. Bui Salesforce Research | ||
14:12 12mLong-paper | SoTaNa: An Open-Source Software Engineering Instruction-Tuned Model Research Papers Ensheng Shi Xi’an Jiaotong University, Yanlin Wang Sun Yat-sen University, Fengji Zhang Microsoft Research Asia, Bei Chen Microsoft Research Asia, Hongyu Zhang Chongqing University, Yanli Wang Sun Yat-sen University, Daya Guo Sun Yat-sen University, Lun Du Microsoft Research, Shi Han Microsoft Research, Dongmei Zhang Microsoft Research, Hongbin Sun Xi’an Jiaotong University | ||
14:24 12mLong-paper | Automated Codebase Reconciliation using Large Language Models Research Papers Aneri Gandhi University of Toronto, Sanjukta De Advanced Micro Devices, Marsha Chechik University of Toronto, Vinay Pandit Advanced Micro Devices, Max Kiehn Advanced Micro Devices, Matthieu Chan Chee Advanced Micro Devices, Yonas Bedasso Advanced Micro Devices | ||
14:36 12mLong-paper | AI-Powered, But Power-Hungry? Energy Efficiency of LLM-Generated Code Research Papers Lola Solovyeva University of Twente, Sophie Weidmann University of Twente, Fernando Castor University of Twente | ||
14:48 6mShort-paper | SwiftEval: Developing a Language-Specific Benchmark for LLM-generated Code Evaluation Data and Benchmarking | ||
14:54 6mShort-paper | SE Arena: An Interactive Platform for Evaluating Foundation Models in Software Engineering Research Papers Zhimin Zhao Queen's University | ||
15:00 12mLong-paper | PerfCodeGen: Improving Performance of LLM Generated Code with Execution Feedback Research Papers Yun Peng The Chinese University of Hong Kong, Akhilesh Deepak Gotmare Salesforce Research, Michael Lyu The Chinese University of Hong Kong, Caiming Xiong Salesforce Research, Silvio Savarese Salesforce Research, Doyen Sahoo Salesforce Research | ||
15:12 6mShort-paper | HyRACC: A Hybrid Retrieval-Augmented Framework for More Efficient Code Completion Research Papers Chuanyi Li Nanjing University, Jiwei Shang Nanjing University, Yi Feng Nanjing University, Bin Luo Nanjing University | ||
15:18 6mShort-paper | OptCodeTrans: Boost LLMs on Low-Resource Programming Language Translation Research Papers Jianbo Lin Nanjing University, Yi Shen Nanjing University, Chuanyi Li Nanjing University, Changan Niu Software Institute, Nanjing University, Bin Luo Nanjing University |
16:00 - 17:30 | Session2: FM for Software Quality Assurance & TestingResearch Papers / Data and Benchmarking at 207 Chair(s): Feifei Niu University of Ottawa | ||
16:00 12mLong-paper | Augmenting Large Language Models with Static Code Analysis for Automated Code Quality Improvements Research Papers | ||
16:12 12mLong-paper | Benchmarking Prompt Engineering Techniques for Secure Code Generation with GPT Models Research Papers Marc Bruni University of Applied Sciences and Arts Northwestern Switzerland, Fabio Gabrielli University of Applied Sciences and Arts Northwestern Switzerland, Mohammad Ghafari TU Clausthal, Martin Kropp University of Applied Sciences and Arts Northwestern Switzerland Pre-print | ||
16:24 12mLong-paper | Vulnerability-Triggering Test Case Generation from Third-Party Libraries Research Papers Yi Gao Zhejiang University, Xing Hu Zhejiang University, Zirui Chen , Tongtong Xu Nanjing University, Xiaohu Yang Zhejiang University | ||
16:36 6mShort-paper | Microservices Performance Testing with Causality-enhanced Large Language Models Research Papers Cristian Mascia University of Naples Federico II, Roberto Pietrantuono Università di Napoli Federico II, Antonio Guerriero Università di Napoli Federico II, Luca Giamattei Università di Napoli Federico II, Stefano Russo Università di Napoli Federico II | ||
16:42 6mShort-paper | MaRV: A Manually Validated Refactoring Dataset Data and Benchmarking Henrique Gomes Nunes Universidade Federal de Minas Gerais, Tushar Sharma Dalhousie University, Eduardo Figueiredo Federal University of Minas Gerais | ||
16:48 6mShort-paper | PyResBugs: A Dataset of Residual Python Bugs for Natural Language-Driven Fault Injection Data and Benchmarking Domenico Cotroneo University of Naples Federico II, Giuseppe De Rosa University of Naples Federico II, Pietro Liguori University of Naples Federico II | ||
16:54 6mShort-paper | The Heap: A Contamination-Free Multilingual Code Dataset for Evaluating Large Language Models Data and Benchmarking Jonathan Katzy Delft University of Technology, Răzvan Mihai Popescu Delft University of Technology, Arie van Deursen TU Delft, Maliheh Izadi Delft University of Technology | ||
17:00 12mLong-paper | ELDetector: An Automated Approach Detecting Endless-loop in Mini Programs Research Papers Nan Hu Xi’an Jiaotong University, Ming Fan Xi'an Jiaotong University, Jingyi Lei Xi'an Jiaotong University, Jiaying He Xi'an Jiaotong University, Zhe Hou China Mobile System Integration Co. | ||
17:12 12mLong-paper | Testing Android Third Party Libraries with LLMs to Detect Incompatible APIs Research Papers Tarek Mahmud Texas State University, Bin Duan University of Queensland, Meiru Che Central Queensland University, Anne Ngu Texas State University, Guowei Yang University of Queensland |
Mon 28 AprDisplayed time zone: Eastern Time (US & Canada) change
09:00 - 10:30 | FORGE2025 Keynote & Session3: Collaborative Software DevelopmentResearch Papers / Keynotes at 207 Chair(s): Xin Xia Huawei, Yuan Tian Queen's University, Kingston, Ontario | ||
09:00 60mKeynote | Keynote: Large language models for agentic software engineering Keynotes Graham Neubig Carnegie Mellon University | ||
10:00 12mLong-paper | AgileCoder: Dynamic Collaborative Agents for Software Development based on Agile Methodology Research Papers Minh Nguyen Huynh FPT Software AI Center, Thang Phan Chau FPT Software AI Center, Phong X. Nguyen FPT Software AI Center, Nghi D. Q. Bui Salesforce Research | ||
10:12 12mLong-paper | Enhancing Pull Request Reviews: Leveraging Large Language Models to Detect Inconsistencies Between Issues and Pull Requests Research Papers Ali Tunahan Işık Bilkent University, Hatice Kübra Çağlar Bilkent University, Eray Tüzün Bilkent University |
14:00 - 15:30 | |||
14:00 45mKeynote | Industry Keynote: One shall not live on LLM alone Keynotes Darya Rovdo JetBrains | ||
14:45 45mKeynote | Industry Keynote: AI in Software Engineering at Google Keynotes Satish Chandra Google, Inc |
16:00 - 17:30 | FORGE2025 Tutorial & Session5: FM EvaluationKeynotes / Tutorials / Research Papers at 207 Chair(s): Xin Xia Huawei | ||
16:00 12mLong-paper | Cyber-Attack Detection and Localization for SCADA system of CPSs Research Papers Dan Li Sun Yat-sen University, Junnan Tang Sun Yat-Sen University, Shunyu Wu Sun Yat-Sen University, Zibin Zheng Sun Yat-sen University, See-Kiong Ng National University of Singapore | ||
16:12 12mLong-paper | A Comprehensive Study of Bug Characteristics on Foundation Language Models Research Papers Junxiao Han Hangzhou City University, Guanqi Wang Zhejiang University, Jiakun Liu Singapore Management University, Lingfeng Bao Zhejiang University, Xing Hu Zhejiang University, Jinling Wei Hangzhou City University, Shuiguang Deng Zhejiang University; Alibaba-Zhejiang University Joint Institute of Frontier Technologies | ||
16:24 12mLong-paper | Testing Refactoring Engine via Historical Bug Report driven LLM Research Papers Haibo Wang Concordia University, Zhuolin Xu Concordia University, Shin Hwei Tan Concordia University Pre-print | ||
16:36 45mTutorial | Beyond Code Generation: Evaluating and Improving LLMs for Code Intelligence Tutorials Fatemeh Hendijani Fard Department of Computer Science, Mathematics, Physics and Statistics, University of British Columbia, Okanagan Campus | ||
17:21 9mKeynote | Industry Keynote: Enhancing Software Engineering with Large Language Models: Insights, Challenges, and Future Directions Keynotes Dong Qiu Waterloo Research Center, Huawei Canada |
17:30 - 18:00 | |||
17:30 30mDay closing | Closing session of FORGE 2025 Research Papers |
Accepted Papers
Title | |
---|---|
Towards Generating App Feature Descriptions Automatically with LLMs: the Setapp Case Study Industry Papers |
Call for Papers
We are excited to invite submissions for the Industry Track of FORGE 2025. The Industry Track aims to bridge the gap between academic research and real-world industry practices in the deployment of Large Language Models (LLMs) and foundational models in Software Engineering (SE). This track will serve as a platform for fostering collaboration between industry stakeholders and academic experts, highlighting the latest innovations, practical insights, and emerging challenges in the fields:
- Real-world deployment of LLMs in SE tasks: Explore how LLMs are being used to solve pressing SE problems, providing key insights into the challenges and opportunities that arise during real-world adoption.
- Tools, best practices, and design principles for LLMs in SE: Identify and share practical tools, frameworks, and best practices that can help streamline LLM deployment in industrial settings.
- Demo papers with verifiable business or real-world impact: We welcome submissions that showcase demonstrated and measurable business or practical impact from LLM deployments. Submissions can range from early prototypes to production-ready systems.
- Open-source and open-access solutions: We also encourage papers describing publicly available open-source or open-access systems, libraries, and resources that contribute to the broader SE and LLM communities.
FORGE 2025 will be held on Sun 27 - Mon 28 April 2025, in Ottawa, Ontario, Canada.
Topics of Interest
We encourage submissions in the following areas:
- Practical and efficient training, inference, and serving of foundational models (FMs) for SE tasks with a focus on speed, scale, and cost-efficiency
- Privacy, security, ethics, and bias considerations in the application of FMs for SE tasks
- Debugging, monitoring, and continuous maintenance of FM-driven SE applications
- Industrial-scale data preparation, feature selection, and feature extraction for FM deployment in SE tasks
- Case studies and lessons learned from real-world, end-to-end production of FM pipelines in SE environments
- Emerging applications of FM agents in SE applications
- Open-source and open-access systems, libraries, and tools for foundational model applications in SE
- Opinion or vision papers offering insights into the future of foundational models in SE applications
How to Submit
We welcome submissions that explore the application of foundation models in software engineering within an industrial context.
Submitted papers should not exceed 4 pages for the main text, inclusive of all figures, tables, and appendices. Two more pages containing only references are permitted.
All submissions must be in PDF. The page limit is strict, and it will not be possible to purchase additional pages at any point in the process (including after acceptance).
Submissions must conform to the IEEE conference proceedings template, specified in the IEEE Conference Proceedings Formatting Guidelines (title in 24pt font and full text in 10pt type, LaTeX users must use \documentclass[10pt,conference]{IEEEtran} without including the compsoc or compsocconf options).
Note, we use double-anonymous reviewing. Be sure to remove the list of authors from the submitted paper. If citing your own prior work, please do so in the third person to obscure the relationship you have with it. For advice, guidance, and explanation about the double-anonymous review process, see ICSE Research Track’s Q&A page.
All papers must be written in English. The authors are strongly encouraged to use the HotCRP format checker on their submissions. Note that the format checker is not perfect. In particular, it can complain about small fonts in figures, footnotes, or references. As long as the main text follows the requested format, and the figures are readable, the paper will not be rejected for format violations. If you have any concerns, please contact the program chairs.
All papers should be made accessible to people with disabilities. Some guidelines from the SIGACCESS community are available here: https://assets21.sigaccess.org/creating_accessible_pdfs.html.
Please submit your paper on HotCRP: https://forge2025-industry-track.hotcrp.com/
Evaluation Criteria
Each paper submitted to the Industry Track of FORGE 2025 will be evaluated based on the following criteria:
- Relevance to Industry: The direct applicability of the work to the defined Industry Track topics and its connection to practical challenges and solutions in the industrial application of foundation models for software engineering.
- Practical Impact and Value: The extent to which the work addresses real-world problems, offers practical solutions, or provides valuable insights for industry practitioners, with clear potential for impact.
- Technical Soundness: The technical rigor and competence of the work, demonstrating a clear understanding of the underlying technologies and methodologies.
- Novelty: The degree of innovation or originality in the work, including novel applications of established research or entirely new contributions. While not a primary criterion, it’s still considered valuable.
- Presentation: The clarity and effectiveness of the paper’s exposition, ensuring the problem, approach, results, and implications are well-articulated and easily understood.
Reviewers will carefully consider all of the above criteria during the review process, and authors should take great care in clearly addressing them all. The paper should clearly explain and justify the claimed contributions. Each paper will be handled by an area chair who will ensure reviewing consistency among papers submitted within that area.