MODELS 2024
Sun 22 - Fri 27 September 2024 Linz, Austria
Tue 24 Sep 2024 11:00 - 11:30 at Crash Bandicoot - Session Modelling & AI

User stories, expressed in snippets of natural language text, are commonly used to elicit stakeholder’s needs in agile software development. Requirement engineers model user stories to interpret the relations among goals and requirements. Manual transformation of goal models has challenges such as, difficulty of converting lower-abstraction user stories into higher-level goals, and extraction of goals embedded in user stories depends on the skill of requirements engineers. In this paper we introduce a technique that leverages Large Language Models (LLMs) to automatically generate goal models from user stories. The approach uses Iterative Prompt Engineering that guides LLM to extract intentional elements and generate its XML-compatible representation in Goal-oriented Requirements Language (GRL). The generated models can be visualized using jUCMNav tool. We evaluated our approach using three LLMs- GPT-4, Llama and Cohere. Our qualitative evaluation indicates that GPT-4 or Llama can be used to assist requirements engineers in modeling as they can produce GRL goal models that are understandable. Additionally, these LLMs are capable of exposing soft goals that are not apparent to stakeholders who are new to the domain.

Tue 24 Sep

Displayed time zone: Amsterdam, Berlin, Bern, Rome, Stockholm, Vienna change

11:00 - 12:30
Session Modelling & AI SAM Conference at Crash Bandicoot
11:00
30m
Talk
A Comparative Study of Large Language Models for Goal Model Extraction
SAM Conference
Vaishali Siddeshwar Ontario Tech University, Sanaa Alwidian University of Montreal, Masoud Makrehchi Ontario Tech University
11:30
30m
Talk
Exploring the Fundamentals of Mutations in Deep Neural Networks
SAM Conference
Zaheed Ahmed University of Goettingen, Philip Makedonski University of Goettingen
12:00
30m
Day closing
Closing Ceremony
SAM Conference
Jens Grabowski University of Göttingen, Alois Zoitl LIT CPS Lab, Johannes Kepler University Linz