TCSE logo 
 Sigsoft logo
Sustainability badge
Thu 1 May 2025 11:30 - 11:45 at 213 - AI for Requirements Chair(s): Jennifer Horkoff

Natural language processing (NLP) techniques have been widely applied in the requirements engineering (RE) field to support tasks such as classification and ambiguity detection. Despite its empirical vocation, RE research has given limited attention to replication of NLP for RE studies. Replication is hampered by several factors, including the context specificity of the studies, the heterogeneity of the tasks involving NLP, the tasks’ inherent hairiness, and, in turn, the heterogeneous reporting structure. To address these issues, we propose a new artifact, referred to as ID-Card, whose goal is to provide a structured summary of research papers emphasizing replication-relevant information. We construct the ID-Card through a structured, iterative process based on design science. In this article: (i) we report on hands-on experiences of replication; (ii) we review the state-of-the-art and extract replication-relevant information: (iii) we identify, through focus groups, challenges across two typical dimensions of replication: data annotation and tool reconstruction; and (iv) we present the concept and structure of the ID-Card to mitigate the identified challenges. This study aims to create awareness of replication in NLP for RE. We propose an ID-Card that is intended to foster study replication but can also be used in other contexts, e.g., for educational purposes.

Thu 1 May

Displayed time zone: Eastern Time (US & Canada) change

11:00 - 12:30
AI for RequirementsResearch Track / SE In Practice (SEIP) / Journal-first Papers / New Ideas and Emerging Results (NIER) at 213
Chair(s): Jennifer Horkoff Chalmers and the University of Gothenburg
11:00
15m
Talk
From Bugs to Benefits: Improving User Stories by Leveraging Crowd Knowledge with CrUISE-AC
Research Track
Stefan Schwedt Heriot-Watt University, UK, Thomas Ströder FHDW Mettmann
11:15
15m
Talk
LiSSA: Toward Generic Traceability Link Recovery through Retrieval-Augmented GenerationArtifact-FunctionalArtifact-AvailableArtifact-Reusable
Research Track
Dominik Fuchß Karlsruhe Institute of Technology (KIT), Tobias Hey Karlsruhe Institute of Technology (KIT), Jan Keim Karlsruhe Institute of Technology (KIT), Haoyu Liu Karlsruhe Institute of Technology (KIT), Niklas Ewald Karlsruhe Institute of Technology (KIT), Tobias Thirolf Karlsruhe Institute of Technology (KIT), Anne Koziolek Karlsruhe Institute of Technology
Pre-print Media Attached
11:30
15m
Talk
Replication in Requirements Engineering: the NLP for RE Case
Journal-first Papers
Sallam Abualhaija University of Luxembourg, Fatma Başak Aydemir Utrecht University, Fabiano Dalpiaz Utrecht University, Davide Dell'Anna Utrecht University, Alessio Ferrari CNR-ISTI, Xavier Franch Universitat Politècnica de Catalunya, Davide Fucci Blekinge Institute of Technology
11:45
15m
Talk
On the Impact of Requirements Smells in Prompts: The Case of Automated TraceabilityArtifact-FunctionalArtifact-ReusableArtifact-Available
New Ideas and Emerging Results (NIER)
Andreas Vogelsang paluno, University of Duisburg-Essen, Alexander Korn University of Duisburg-Essen, Giovanna Broccia ISTI-CNR, FMT Lab, Alessio Ferrari Consiglio Nazionale delle Ricerche (CNR) and University College Dublin (UCD), Jannik Fischbach Netlight Consulting GmbH and fortiss GmbH, Chetan Arora Monash University
12:00
15m
Talk
NICE: Non-Functional Requirements Identification, Classification, and Explanation Using Small Language ModelsArtifact-AvailableAward Winner
SE In Practice (SEIP)
Gokul Rejithkumar TCS Research, Preethu Rose Anish TCS Research
Pre-print
:
:
:
: