Augmenting, Not Replacing: The Role of LLMs in Human-Centric Formal RE
Formal methods for requirements engineering have existed for decades; yet, these techniques are rarely used if not required by certification because they are challenging for non-experts (e.g., novices and non-technical stakeholders in multi-disciplinary teams) to interpret and apply. To enable non-experts to participate in collaborative software teams, we envision using artificial intelligence (AI) to assist in interpreting formal notations. Our research project investigates how and to what extent generative AI with large language models (LLMs) can be used to assist non-experts in interpreting formal requirements. In this paper, we conduct an exploratory investigation of both generating translations and interpreting linear temporal logic (LTL) formulae. Specifically, we explore prompting LLMs with sufficient information for the task of generating LTL formula explanations. Given our initial prompt, we complete a classroom study where students learn LTL and then interpret a series of LTL formulae with and without the LLM-generated descriptions. We then improve our approach based on insights from the classroom study, and evaluate the overall quality of our updated prompt and the explanations it generates.
Wed 3 SepDisplayed time zone: Brussels, Copenhagen, Madrid, Paris change
11:00 - 12:30 | Requirements SpecificationResearch Papers / Industrial Innovation Track at Salon de Grados Chair(s): Giovanna Broccia ISTI-CNR, FMT Lab | ||
11:00 30mPaper | Augmenting, Not Replacing: The Role of LLMs in Human-Centric Formal RE Research Papers Sonora Halili Smith College, Paola Spoletini Kennesaw State University, Alicia M. Grubb Smith College | ||
11:30 30mPaper | Exploring the Use of LLMs for Requirements Specification in an IT Consulting Company Industrial Innovation Track Liliana Pasquale University College Dublin & Lero, Azzurra Ragone University of Bari, Emanuele Piemontese University of Bari "A. Moro", Armin Amiri Darban Polytechnic University of Bari Pre-print | ||
12:00 30mPaper | Adopting Use Case Descriptions for Requirements Specification: an Industrial Case Study Research Papers Pre-print | ||