Wed 13 May 2026 12:30 - 13:00 at Edificio 3, Aula 401 - 1a LLMs for Software Engineering Chair(s): Andrea Delgado

Nowadays, many software companies are required to meet high quality standards in the development of their applications. Rather than replacing traditional SAST tools based on fixed rules, approaches such as GemCA leverage a Large Language Model (LLM) to perform semantic reasoning over code in relation to the ISO/IEC 5055:2021 standard, providing a complementary decision-support mechanism for early-stage quality assessment. This paper presents GemCA and reports an empirical analysis evaluating its accuracy on a dataset of known code weaknesses. The goal is to examine the framework’s ability to apply the criteria defined by the ISO/IEC 5055:2021 standard. Results show that GemCA achieves an average accuracy of 81% across 15 repetitions, with significantly higher performance in C# than PHP. However, accuracy varies substantially across weakness categories (p = 0.0000), indicating sensitivity to CWE type and programming language. These findings highlight both the potential and the current limitations of LLM‑based analysis for ISO/IEC 5055:2021 compliance.

Wed 13 May

Displayed time zone: Eastern Time (US & Canada) change

12:30 - 14:00
1a LLMs for Software EngineeringCIbSE 2026 (Main Track) at Edificio 3, Aula 401
Chair(s): Andrea Delgado Universidad de la Republica
12:30
30m
Full-paper
An Empirical Study of LLM-Based Source Code Quality Assessment under ISO/IEC 5055:2021
CIbSE 2026 (Main Track)
Daniel Perez Morera Universidad de Costa Rica, Enrique Vílchez-Lizano Universidad de Costa Rica, Keilor Rodriguez-Artavia Universidad de Costa Rica, Christian Quesada-López Universidad de Costa Rica, Marcelo Jenkins Universidad de Costa Rica
13:00
30m
Full-paper
Engineering an LLM-Based Data Ingestion Process for Semi-Structured Documents: An Empirical Study*
CIbSE 2026 (Main Track)
Sandrelly Luiz Coutinho Universidade Federal de Pernambuco - UFPE, Paulo Jorge Leitão Adeodato Universidade Federal de Pernambuco - UFPE, Bruno Campello de Souza Universidade Federal de Pernambuco - UFPE, Carlos Eduardo B de S Fontes Centro Universitário Maurício de Nassau
13:30
30m
Full-paper
LLM-Assisted INVEST Evaluation and Improvement of User Stories: An Industrial Replication Study
CIbSE 2026 (Main Track)
Erika Hernández Agüero Universidad Estatal a Distancia; Universidad de Costa Rica, Christian Quesada-López Universidad de Costa Rica, José Pablo Chaves Sánchez Universidad Estatal a Distancia