Multi-Agent Debate Strategies to Enhance Requirements Engineering with Large Language Models
Context: Large Language Model (LLM) agents are becoming widely used for various Requirements Engineering (RE) tasks. Research on improving their accuracy mainly focuses on prompt engineering, model fine-tuning, and retrieval augmented generation. However, these methods often treat models as isolated black boxes - relying on single-pass outputs without iterative refinement or collaboration, limiting robustness and adaptability. Objective: We propose that, just as human debates enhance accuracy and reduce bias in RE tasks by incorporating diverse perspectives, different LLM agents debating and collaborating may achieve similar improvements. Our goal is to investigate whether Multi-Agent Debate (MAD) strategies can enhance RE performance. Method: We conducted a systematic study of existing MAD strategies across various domains to identify their key characteristics. To assess their applicability in RE, we implemented and tested a preliminary MAD-based framework for RE classification. Results: Our study identified and categorized several MAD strategies, leading to a taxonomy outlining their core attributes. Our preliminary evaluation demonstrated the feasibility of applying MAD to RE classification. Conclusions: MAD presents a promising approach for improving LLM accuracy in RE tasks. This study provides a foundational understanding of MAD strategies, offering insights for future research and refinements in RE applications.
Fri 5 SepDisplayed time zone: Brussels, Copenhagen, Madrid, Paris change
11:00 - 12:30 | Agents in RERE@Next! Papers / Research Papers at Salon de Actos Chair(s): Farnaz Fotrousi Chalmers University of Technology and University of Gothenburg | ||
11:00 30mPaper | From Requirements to Code: Understanding Developer Practices in LLM-Assisted Software Engineering Research Papers Jonathan Ullrich Fraunhofer IESE, Matthias Koch Fraunhofer IESE, Andreas Vogelsang paluno – The Ruhr Institute for Software Technology, University of Duisburg-Essen Pre-print | ||
11:30 20mPaper | Intelligent Agents for Requirements Engineering: Use, Feasibility and Evaluation RE@Next! Papers Jacek Dąbrowski Lero - the Science Foundation Ireland Research Centre for Software, Wanling Cai Lero@Trinity College Dublin, Amel Bennaceur The Open University, UK, Bashar Nuseibeh The Open University, UK, Faeq Alrimawi Lero - the Science Foundation Ireland Research Centre for Software Pre-print | ||
11:50 20mPaper | ReqInOne: A Large Language Model-Based Agent for Software Requirements Specification Generation RE@Next! Papers | ||
12:10 20mPaper | Multi-Agent Debate Strategies to Enhance Requirements Engineering with Large Language Models RE@Next! Papers Marc Oriol Universitat Politècnica de Catalunya, Quim Motger Universitat Politècnica de Catalunya, Jordi Marco Universitat Politècnica de Catalunya, Xavier Franch Universitat Politècnica de Catalunya Pre-print |