An AI-Based Approach for Analysing Dependencies among User Stories
This program is tentative and subject to change.
User stories (USs) are a widely used notation for expressing requirements in agile software development. A comprehensive understanding requires assessing not only individual USs, but also analysing the dependencies among them. Recent advances in AI open up new possibilities for automation. Therefore, this paper proposes an AI-based approach to analysing order dependencies. To achieve this, we first semi-formally define plain and hierarchical order dependency, which relate USs based on their actions on semantically equivalent or contained entities. Dependency analysis is realised using a modular, extensible pipeline. Our approach integrates various AI-based methods, including traditional NLP techniques and LLMs, to classify actions and analyse semantic relationships. To facilitate the evaluation process, we create a benchmark dataset comprising both expert-curated and real-world USs, containing 1.499 manually labelled dependencies. We then compare NLP techniques with transformer- and LLM-based methods for the individual analysis steps, evaluating the overall effectiveness and efficiency of our approach. Our results suggest that AI-based dependency analysis is feasible, especially when LLM-based methods are integrated. In realistic backlog settings, we obtain F$_2$ scores of 73% for plain and 89% for hierarchical order dependency. Our approach forms the basis for automated dependency analysis in requirements engineering and enables extensions to cover additional dependency types in the future.
This program is tentative and subject to change.
Thu 20 AugDisplayed time zone: Eastern Time (US & Canada) change
11:00 - 12:30 | LLM Analysis & Multi-Agent REResearch Papers at A-1300 Chair(s): Quim Motger Universitat Politècnica de Catalunya | ||
11:00 30mTalk | An AI-Based Approach for Analysing Dependencies among User Stories Research Papers Lukas Sebastian Hofmann Philipps-Universität Marburg | Universidad Complutense de Madrid, Alexander Lauer Philipps-Universität Marburg, Jens Kosiol Brandenburgische Technische Universität Cottbus-Senftenberg, Philipp Wieber Philipps-Universität Marburg, Daniel Braun Philipps-Universität Marburg, Gabriele Taentzer Philipps-Universität Marburg | ||
11:30 30mTalk | QUARE: Quality-Aware Requirements Engineering through Multi-Agent Dialectic Negotiation Research Papers Haowei Cheng Waseda University, Milhan Kim Waseda University, Foutse Khomh Polytechnique Montréal, Teeradaj Racharak Tohoku University, Nobukazu Yoshioka Waseda University, Japan, Naoyasu Ubayashi Waseda University, Hironori Washizaki Waseda University Pre-print | ||
12:00 30mTalk | Requirements-Sufficiency Gating for LLM-Assisted Automation Research Papers Mohammadamin Madani Faculty of Computer Science, Otto von Guericke University Magdeburg, Maria Chernigovskaya Faculty of Computer Science, Otto von Guericke University Magdeburg, Abdulrahman Nahhas Faculty of Computer Science, Otto von Guericke University Magdeburg, Klaus Turowski Faculty of Computer Science, Otto von Guericke University Magdeburg | ||