FORGE 2025 - Keynotes

Keynote1: Trust No Bot? Forging Confidence in AI for Software Engineering

Abstract: The truth is out there… and so is the AI revolution. Foundation models and AI-driven tools are transforming software engineering, offering unprecedented efficiencies while introducing new uncertainties. As developers, we find ourselves in uncharted territory: these tools promise to accelerate productivity and reshape our workflows, but can we really trust them? Like any good investigator, we must question the systems we rely on. Are AI-based tools reliable, transparent, and aligned with developer needs? Or are they inscrutable black boxes with hidden risks? Trust isn’t just a nice-to-have—it’s the key factor determining whether AI integration succeeds or spirals into skepticism. In this keynote, I will uncover the evolving role of AI in software engineering and explore how we can build, measure, and foster trust in these tools. I will also reveal why the FORGE community is uniquely positioned to lead this charge, ensuring that AI becomes a trusted partner—not an unsolved mystery. After all, when it comes to AI in software development… should we trust no bot? (This abstract came to life with a little help from ChatGPT and a lot of love for The X-Files.)

Prof. Thomas Zimmermann

Thomas Zimmermann is a Chancellor's Professor and Donald Bren Chair at the University of California, Irvine. He works on cutting-edge research and innovation in data science, machine learning, software engineering, and digital games. He has over 15 years of experience in the field, with more than 100 publications that have been cited over 30,000 times. His research mission is to empower software developers and organizations to build better software and services with AI. He is best known for his pioneering work on systematic mining of software repositories and his empirical studies of software development in industry. He has contributed to several Microsoft products and tools, such as Visual Studio, GitHub, and Xbox. He is an ACM Fellow, an IEEE Fellow, and recipient of the IE. Further details can be found on: https://thomas-zimmermann.com/

Keynote 2

Prof. Prem Devanbu, the “father” of Naturalness of Code, is a Distinguished Research Professor on the Faculty of the Computer Science Department at the University of California at Davis. He works in the areas of empirical software engineering, and Software Engineering applications of ML. Devanbu was elected ACM Fellow in 2018 and has received multiple awards, including the 2021 ACM SIGSOFT Outstanding Research Award, the 2024 IEEE Harlan Mills Award, and the 2022 Humboldt Research Award. Further details can be found on: https://www.cs.ucdavis.edu/~devanbu/

Keynote 3

Prof. Graham Neubig, the “father” of OpenDevin, is an Associate Professor at the Carnegie Mellon University, Language Technology Institute in the School of Computer Science. He leads NeuLab and is also chief scientist at All Hands AI. His research focuses on machine learning and natural language processing. In particular, he is interested in basic research and applications of large language models, with a particular focus on question answering, code generation, multilingual processing, and evaluation/interpretability. Further details can be found on: https://www.phontron.com/

Industry Keynote 1

Darya Rovdo, based in The Hague, NL, is a Machine Learning Engineer at JetBrains. With a background in software engineering, she understands the development process from both perspectives - building software and enhancing it with AI. Her main focus is on making product features as effective and useful as possible, favouring simple, practical solutions over unnecessary complexity. Further details can be found on: https://nl.linkedin.com/in/darya-rovdo-85aa9111a

Industry Keynote 2

Dong Qiu is currently a Director of Waterloo Research Centre. His research interests span software analysis and testing, regression testing and monitoring in web services & SOA, database applications and programming languages. Further details can be found on: https://dong-qiu.github.io/

This program is tentative and subject to change.

Time Zone

The program is currently displayed in (GMT-04:00) Eastern Time (US & Canada).

Use conference time zone: (GMT-04:00) Eastern Time (US & Canada)Select other time zone

The GMT offsets shown reflect the offsets at the moment of the conference.

Time Band

By setting a time band, the program will dim events that are outside this time window. This is useful for (virtual) conferences with a continuous program (with repeated sessions).
The time band will also limit the events that are included in the personal iCalendar subscription service.

Display full programSpecify a time band

Save

You're viewing the program in a time zone which is different from your device's time zone change time zone

Sun 27 Apr
Displayed time zone: Eastern Time (US & Canada) change

09:00 - 10:30	FORGE2025 Opening / KeynoteKeynotes at 207

09:00 10m Day opening		Introduction from The Chairs Keynotes
09:10 60m Keynote		Keynote Keynotes Prem Devanbu University of California at Davis

11:00 - 12:30	FORGE2025 Panel / KeynoteKeynotes / at 207

11:00 60m Keynote		Keynote Keynotes Graham Neubig Carnegie Mellon University
12:00 30m Panel		Panel Discussion Panel

Mon 28 Apr
Displayed time zone: Eastern Time (US & Canada) change

09:00 - 10:30	FORGE2025 Keynote & Session3: Collaborative Software DevelopmentKeynotes / Research Papers at 207

09:00 60m Keynote		Keynote: Trust No Bot? Forging Confidence in AI for Software Engineering Keynotes Thomas Zimmermann University of California, Irvine
10:00 12m Long-paper		AgileCoder: Dynamic Collaborative Agents for Software Development based on Agile Methodology Research Papers Minh Nguyen Huynh FPT Software AI Center, Thang Phan Chau FPT Software AI Center, Phong X. Nguyen FPT Software AI Center, Nghi D. Q. Bui Salesforce Research
10:12 12m Long-paper		Enhancing Pull Request Reviews: Leveraging Large Language Models to Detect Inconsistencies Between Issues and Pull Requests Research Papers Ali Tunahan Işık Bilkent University, Hatice Kübra Çağlar Bilkent University, Eray Tüzün Bilkent University

14:00 - 15:30	FORGE2025 KeynoteKeynotes at 207

14:00 45m Keynote		Industry Keynote Keynotes Dong Qiu Huawei Technologies
14:45 45m Keynote		Industry Keynote Keynotes Darya Rovdo JetBrains

16:00 - 17:30	FORGE2025 Tutorial & Session5: FM EvaluationKeynotes / Tutorials / Research Papers at 207

16:00 45m Tutorial		Beyond Code Generation: Evaluating and Improving LLMs for Code Intelligence Tutorials Fatemeh Hendijani Fard University of British Columbia
16:45 12m Long-paper		A Comprehensive Study of Bug Characteristics on Foundation Language Models Research Papers Junxiao Han , Guanqi Wang Zhejiang University, Jiakun Liu Singapore Management University, Lingfeng Bao Zhejiang University, Xing Hu Zhejiang University, Jinling Wei Hangzhou City University, Shuiguang Deng Zhejiang University; Alibaba-Zhejiang University Joint Institute of Frontier Technologies
16:57 12m Long-paper		Cyber-Attack Detection and Localization for SCADA system of CPSs Research Papers Dan Li Sun Yat-sen University, Junnan Tang Sun Yat-Sen University, Shunyu Wu Sun Yat-Sen University, Zibin Zheng Sun Yat-sen University, See-Kiong Ng National University of Singapore
17:09 12m Long-paper		Testing Refactoring Engine via Historical Bug Report driven LLM Research Papers Haibo Wang , Zhuolin Xu Concordia University, Shin Hwei Tan Concordia University Pre-print
17:21 9m Day closing		Closing Session Keynotes

Accepted Papers

	Title
	Closing Session Keynotes

14:00 - 15:30	Session1: FM for Code Generation Research Papers / Data and Benchmarking at 207

14:00 12m Long-paper		PerfCodeGen: Improving Performance of LLM Generated Code with Execution Feedback Research Papers Yun Peng The Chinese University of Hong Kong, Akhilesh Deepak Gotmare Salesforce Research, Michael Lyu The Chinese University of Hong Kong, Caiming Xiong Salesforce Research, Silvio Savarese Salesforce Research, Doyen Sahoo Salesforce Research
14:12 12m Long-paper		RepoHyper: Search-Expand-Refine on Semantic Graphs for Repository-Level Code Completion Research Papers Huy Nhat Phan FPT Software AI Center, Hoang Nhat Phan Nanyang Technological University, Tien N. Nguyen University of Texas at Dallas, Nghi D. Q. Bui Salesforce Research
14:24 12m Long-paper		SoTaNa: An Open-Source Software Engineering Instruction-Tuned Model Research Papers Ensheng Shi Xi’an Jiaotong University, Yanlin Wang Sun Yat-sen University, Fengji Zhang Microsoft Research Asia, Bei Chen Microsoft Research Asia, Hongyu Zhang Chongqing University, yanli wang Sun Yat-sen University, Daya Guo Sun Yat-sen University, Lun Du Microsoft Research, Shi Han Microsoft Research, Dongmei Zhang Microsoft Research, Hongbin Sun Xi’an Jiaotong University
14:36 12m Long-paper		Automated Codebase Reconciliation using Large Language Models Research Papers Aneri Gandhi University of Toronto, Sanjukta De Advanced Micro Devices, Marsha Chechik University of Toronto, Vinay Pandit Advanced Micro Devices, Max Kiehn Advanced Micro Devices, Matthieu Chan Chee Advanced Micro Devices, Yonas Bedasso Advanced Micro Devices
14:48 12m Long-paper		AI-Powered, But Power-Hungry? Energy Efficiency of LLM-Generated Code Research Papers Lola Solovyeva University of Twente, Sophie Weidmann University of Twente, Fernando Castor University of Twente
15:00 6m Short-paper		HyRACC: A Hybrid Retrieval-Augmented Framework for More Efficient Code Completion Research Papers Chuanyi Li Nanjing University, Jiwei Shang Nanjing University, Yi Feng Nanjing University, Bin Luo Nanjing University
15:06 6m Short-paper		OptCodeTrans: Boost LLMs on Low-Resource Programming Language Translation Research Papers Jianbo Lin Nanjing University, Yi Shen Nanjing University, Chuanyi Li Nanjing University, Changan Niu Software Institute, Nanjing University, Bin Luo Nanjing University
15:12 6m Short-paper		SwiftEval: Developing a Language-Specific Benchmark for LLM-generated Code Evaluation Data and Benchmarking Ivan Petrukha MacPaw, Yana Kurliak MacPaw, Nataliia Stulova MacPaw
15:18 6m Short-paper		SE Arena: An Interactive Platform for Evaluating Foundation Models in Software Engineering Research Papers Zhimin Zhao Queen's University

16:00 - 17:30	Session2: FM for Software Quality Assurance & TestingResearch Papers / Data and Benchmarking at 207

16:00 12m Long-paper		Augmenting Large Language Models with Static Code Analysis for Automated Code Quality Improvements Research Papers Seyed Moein Abtahi Ontario Tech University, Akramul Azim Ontario Tech University
16:12 12m Long-paper		Benchmarking Prompt Engineering Techniques for Secure Code Generation with GPT Models Research Papers Marc Bruni University of Applied Sciences and Arts Northwestern Switzerland, Fabio Gabrielli University of Applied Sciences and Arts Northwestern Switzerland, Mohammad Ghafari TU Clausthal, Martin Kropp University of Applied Sciences and Arts Northwestern Switzerland Pre-print
16:24 12m Long-paper		ELDetector: An Automated Approach Detecting Endless-loop in Mini Programs Research Papers Nan Hu Xi’an Jiaotong University, Ming Fan Xi'an Jiaotong University, Jingyi Lei Xi'an Jiaotong University, Jiaying He Xi'an Jiaotong University, Zhe Hou China Mobile System Integration Co.
16:36 12m Long-paper		Testing Android Third Party Libraries with LLMs to Detect Incompatible APIs Research Papers Tarek Mahmud Texas State University, bin duan University of Queensland, Meiru Che Central Queensland University, Anne Ngu Texas State University, Guowei Yang University of Queensland
16:48 12m Long-paper		Vulnerability-Triggering Test Case Generation from Third-Party Libraries Research Papers Yi Gao Zhejiang University, Xing Hu Zhejiang University, Zirui Chen , Tongtong Xu Nanjing University, Xiaohu Yang Zhejiang University
17:00 6m Short-paper		Microservices Performance Testing with Causality-enhanced Large Language Models Research Papers Cristian Mascia University of Naples Federico II, Roberto Pietrantuono Università di Napoli Federico II, Antonio Guerriero Università di Napoli Federico II, Luca Giamattei Università di Napoli Federico II, Stefano Russo Università di Napoli Federico II
17:06 6m Short-paper		MaRV: A Manually Validated Refactoring Dataset Data and Benchmarking Henrique Gomes Nunes Universidade Federal de Minas Gerais, Tushar Sharma Dalhousie University, Eduardo Figueiredo Federal University of Minas Gerais
17:12 6m Short-paper		PyResBugs: A Dataset of Residual Python Bugs for Natural Language-Driven Fault Injection Data and Benchmarking Domenico Cotroneo University of Naples Federico II, Giuseppe De Rosa University of Naples Federico II, Pietro Liguori University of Naples Federico II
17:18 6m Short-paper		The Heap: A Contamination-Free Multilingual Code Dataset for Evaluating Large Language Models Data and Benchmarking Jonathan Katzy Delft University of Technology, Răzvan Mihai Popescu Delft University of Technology, Arie van Deursen TU Delft, Maliheh Izadi Delft University of Technology

11:00 - 12:30	Session4: Human-AI Collaboration & Legal Aspects of using FMResearch Papers / Industry Papers at 207

11:00 12m Long-paper		Extracting Fix Ingredients using Language Models Research Papers Julian Prenner Free University of Bozen-Bolzano, Romain Robbes Univ. Bordeaux, CRNS
11:12 12m Long-paper		CodeFlow: Program Behavior Prediction with Dynamic Dependencies Learning Research Papers Cuong Chi Le FPT Software AI Center, Hoang Nhat Phan Nanyang Technological University, Huy Nhat Phan FPT Software AI Center, Tien N. Nguyen University of Texas at Dallas, Nghi D. Q. Bui Salesforce Research
11:24 12m Long-paper		Addressing Specific and Complex Scenarios in Semantic Parsing Research Papers Yu Wang Nanjing University, Ming Fan Xi'an Jiaotong University, Ting Liu Xi'an Jiaotong University
11:36 12m Long-paper		Skill over Scale: The Case for Medium, Domain-Specific Models for SE Research Papers Manisha Mukherjee Carnegie Mellon University, Vincent J. Hellendoorn Carnegie Mellon University Pre-print
11:48 12m Long-paper		Resource-Efficient & Effective Code Summarization Research Papers Saima Afrin William & Mary, Joseph Call William & Mary, Khai Nguyen William & Mary, Oscar Chaparro William & Mary, Antonio Mastropaolo William and Mary, USA
12:00 6m Short-paper		How Developers Interact with AI: A Taxonomy of Human-AI Collaboration in Software Engineering Research Papers Christoph Treude Singapore Management University, Marco Gerosa Northern Arizona University Pre-print
12:06 6m Short-paper		"So what if I used GenAI?” - Legal Implications of Using GenAI in Software Engineering Research Research Papers Gouri Ginde (Deshpande) University of Calgary
12:12 6m Short-paper		Evaluating the Ability of GPT-4o to Generate Verifiable Specifications in VeriFast Research Papers Marilyn Rego Purdue University, Wen Fan Purdue University, Xin Hu Univeristy of Michigan - Ann Arbor, Sanya Dod , Zhaorui Ni Purdue University, Danning Xie Purdue University, Jenna DiVincenzo (Wise) Purdue University, Lin Tan Purdue University
12:18 6m Short-paper		Towards Generating App Feature Descriptions Automatically with LLMs: the Setapp Case Study Industry Papers Yevhenii Peteliev MacPaw, Ivan Synytsia MacPaw, Nataliia Stulova MacPaw

KeynotesFORGE 2025

Keynote 2

Keynote 3

Industry Keynote 1

Industry Keynote 2

This program is tentative and subject to change.

Sun 27 Apr
Displayed time zone: Eastern Time (US & Canada) change

Mon 28 Apr
Displayed time zone: Eastern Time (US & Canada) change

Accepted Papers

Tracks

	12:30 - 14:00	FORGE2025 PosterResearch Papers at Canada Hall 3 Poster Area

KeynotesFORGE 2025

Keynote 2

Keynote 3

Industry Keynote 1

Industry Keynote 2

This program is tentative and subject to change.

Program Display Configuration

Sun 27 AprDisplayed time zone: Eastern Time (US & Canada) change

Mon 28 AprDisplayed time zone: Eastern Time (US & Canada) change

Accepted Papers

Sun 27 Apr
Displayed time zone: Eastern Time (US & Canada) change

Mon 28 Apr
Displayed time zone: Eastern Time (US & Canada) change