Requirement formalization represents an indispensable component of software analysis. However, due to the specialized expertise required to formulate the requirements, and the prevalent preference for using natural language to describe them, domain experts often need to iteratively refine and extract formal specifications from unstructured natural language descriptions. This process is inherently challenged by the complexity and inherent ambiguity of natural language, making the construction of accurate and complete formal specifications a non-trivial task. To address this issue, this paper proposes TempVeri, a novel and end-to-end framework focusing on translating natural language requirements to formal specifications in temporal logics. One of the core innovations of TempVeri lies in integrating structured prompt engineering with automated function calling to enable high-quality translation of formal specifications. Furthermore, in order to ensure the correctness of the translation, an ``LLM-as-a-Judge'' semantic validation mechanism is further introduced to assess the semantic consistency of the generated outputs. The proposed framework exhibits strong extensibility and portability. We have also integrated the proposed TempVeri framework into a runtime verification tool and evaluated its correctness and effectiveness using a realistic industrial case study. The experimental evaluations demonstrate the superiority of TempVeri in requirement formalization, confirming its practical utility and potential for broader application in software analysis.
Thu 19 MarDisplayed time zone: Athens change
14:00 - 15:30 | Session 5C - Specification-Driven Code and Model DevelopmentIndustrial Track / Early Research Achievement (ERA) Track / Short Papers and Posters Track / Research Track / Registered Report Track at Megaron Gamma Chair(s): Qiaolin Qin Polytechnique Montréal | ||
14:00 15mTalk | Requirement Formalization using Large Language Models Research Track Zhiyuan Hu National University of Defense Technology, Wei Ma Singapore Management University, Qiang Wang Academy of Military Sciences, Lingxiao Jiang Singapore Management University, Dongsheng Li National University of Defense Technology | ||
14:15 15mTalk | Understanding Specification-Driven Code Generation with LLMs: An Empirical Study Design Registered Report Track Giovanni Rosa Universidad Rey Juan Carlos, David Moreno-Lumbreras Universidad Rey Juan Carlos, Gregorio Robles Universidad Rey Juan Carlos, Jesus M. Gonzalez-Barahona Universidad Rey Juan Carlos Pre-print Media Attached | ||
14:30 15mTalk | AI-Assisted Requirements Traceability for Large-Scale Optical Network Systems: An Industrial Experience Report Industrial Track | ||
14:45 15mTalk | From Textual Descriptions to Code: A Filtering Approach for Locating Business Rules Industrial Track Nour Ayachi Univ. Lille, Inria, CNRS, Centrale Lille, UMR 9189 CRIStAL F-59000 Lille, France, Benoit Verhaeghe Berger-Levrault, Christopher Fuhrman École de technologie supérieure, Nicolas Anquetil University of Lille, Lille, France | ||
15:00 7mTalk | Generating User Clones from Questionnaires: A Lightweight Approach to Requirements Elicitation Short Papers and Posters Track Mai Hirabayashi Waseda University, Hironori Washizaki Waseda University, Naoyasu Ubayashi Waseda University, Juichi Takahashi AGEST, Inc, Yohei Takagi AGEST Inc. | ||
15:07 7mTalk | How Well Does Knowledge Injection Enhance LLM-aided Formal Protocol Modeling? Early Research Achievement (ERA) Track Yajia Lin Xidian University, Jie Su Xidian University, Cheng Wen Xidian University, rong wang , Cong Tian Xidian University, Zhenhua Duan Xidian University, Shengchao Qin Xidian University Media Attached | ||
15:14 7mTalk | LLM Driven Business Rule Extraction from Enterprise Applications Early Research Achievement (ERA) Track Shrishti Pradhan TCS Research, Aishwarya Malvade TCS Research, Raveendra Kumar Medicherla TCS Research, Tata Consultancy Services, Manasi Patwardhan TCS Research | ||
15:21 7mTalk | SQL3M: Token Efficient Text-to-SQL Generation Short Papers and Posters Track Ibrahim Ücelehan Johannes Gutenberg University Mainz, Alina Geiger Johannes Gutenberg University Mainz, Dominik Sobania University of Duisburg-Essen, Germany | ||