Thu 4 Sep 2025 15:10 - 15:30 at Salon de Grados - LLMs for Verification Chair(s): Muhammad Abbas Khan

Previous work has investigated the adequacy of LLMs to detect inconsistencies in requirements documents, but has also shown their limitations with real case studies. In this paper, we propose a hybrid approach, which exploits traditional clustering techniques to help LLMs focus on potential inconsistencies. The approach was evaluated using a large security requirements document from the RE Open Data Initiative, with injected inconsistencies. Results show that combining LLM-based detection with rule-based clustering enhances both precision and recall.

Thu 4 Sep

Displayed time zone: Brussels, Copenhagen, Madrid, Paris change

14:00 - 15:30
LLMs for VerificationJournal-First / RE@Next! Papers / Research Papers at Salon de Grados
Chair(s): Muhammad Abbas Khan RISE Research Institutes of Sweden
14:00
30m
Paper
LLM-based Satisfiability Checking of String Requirements by Consistent Data and Checker Generation
Research Papers
Boqi Chen McGill University, Aren Babikian University of Toronto, Daniel Varro Linköping University / McGill University, Gunter Mussbacher McGill University, Shuzhao Feng McGill University
14:30
20m
Paper
Supporting Software Formal Verification with Large Language Models: An Experimental Study
RE@Next! Papers
Weiqi Wang University of Manchester, Marie Farrell The University of Manchester, Lucas Cordeiro University of Oxford, Liping Zhao University of Manchester
Pre-print
14:50
20m
Paper
Automatic Instantiation of Assurance Cases from Patterns Using Large Language Models
Journal-First
Oluwafemi Odu York University, Alvine Boaye Belle York University, Song Wang York University, Segla Kpodjedo Ecole de Technologie Superieure, Timothy Lethbridge University of Ottawa, Hadi Hemmati York University
15:10
20m
Paper
Combining Established and Emerging Techniques to Detect Inconsistencies in Requirements
RE@Next! Papers
Alessandro Fantechi University of Florence, Stefania Gnesi Istituto di Scienza e Tecnologie dell'Informazione "Alessandro Faedo" , Laura Semini Università di Pisa - Dipartimento di Informatica