LLM-Assisted Requirements Engineering in Agile MDD: Industry Insights and Validation
Despite the growing interest in integrating Large-Language Models (LLMs) within software development, there is limited empirically-grounded guidance for teams to effectively apply this technology in industry. We explore the use of LLMs for generating requirements artifacts within a low-code consultancy organization that builds low-code development applications following a custom Agile model-driven development (Agile MDD) framework. Through the analysis of multiple project cases within the company, we construct a method as an accurate representation of the employed Agile MDD approach. We then identify high-potential use cases for LLM adoption within the Agile MDD method. For these use cases, we engineer reusable LLM prompts that generate requirements artifacts. We validate the generated output for three of such use cases: generation of user stories, of acceptance criteria, and of data models. The team members of four projects were asked to express their opinion on the automatically generated artifacts. The results show high appreciation for the generated artifacts, which were found to be mainly relevant and similar to requirements that were included in the initial specification. The generation of the data model was less positively rated than the other use cases. Besides providing detailed insights on the inclusion of LLMs in the company’s Agile MDD process, we share our results to provide guidance for other software teams seeking to leverage LLMs in Agile MDD.
Wed 3 SepDisplayed time zone: Brussels, Copenhagen, Madrid, Paris change
14:00 - 15:30 | Agile and Model-driven REResearch Papers / Industrial Innovation Track at Salon de Grados Chair(s): Mehrdad Sabetzadeh University of Ottawa | ||
14:00 30mPaper | The Impact of Requirements Artifacts on Efficiency in Agile Development: A Case Study Research Papers Pre-print | ||
14:30 30mPaper | ContCRIA: NLP and MDE-based Contextual Change Request Impact Analysis Industrial Innovation Track Asha Rajbhoj TCS Research, Ajim Pathan TCS Research, Padmalata Nistala , Vinay Kulkarni Tata Consultancy Services Research | ||
15:00 30mPaper | LLM-Assisted Requirements Engineering in Agile MDD: Industry Insights and Validation Industrial Innovation Track Tjerk Spijkman , Fabiano Dalpiaz Utrecht University, Sietse Overbeek Utrecht University, Steffen Beudeker fizor., Bente Molenkamp Utrecht University Pre-print | ||