ADARULE: LLM-Driven Natural Language to LTL Conversion via Pattern-Adaptive Rule Induction
Translating natural language (NL) specifications into Linear Temporal Logic (LTL) formulas is critical for bridging human intent and formal system verification. While large language models (LLMs) have made this task more feasible, adapting NL2LTL systems to different domains remains challenging due to varied linguistic conventions. Existing methods typically rely on manually crafted translation rules or pattern-specific templates, which are costly to construct and do not generalize across domains. A core challenge is that NL–LTL datasets provide paired examples but do not explicitly indicate which linguistic elements reflect pattern-specific translation conventions. To address this problem, we propose ADARULE, a feedback-guided approach for pattern-adaptive NL2LTL translation via automatic rule induction. The key insight is that even without explicit supervision, we can leverage LLMs to perform NL2LTL translation using only basic, general-purpose rules. By comparing the predicted LTL with ground truth LTL formulas, the LLM can identify where the general rules fall short and uses this feedback to induce new translation rules that capture pattern-specific conventions. ADARULE consists of two collaborative LLM-based components: a Translator that performs the NL2LTL conversion, and a Learner that analyzes failed translations to generate corrective rules. These rules are incorporated into the Translator’s prompts to improve future predictions. Through iterative learning, ADARULE progressively adapts to pattern-specific conventions without requiring manual engineering. Experiments on four benchmark NL2LTL datasets and three different foundation LLMs show that ADARULE outperforms the other baselines by at least 21.1% on average, demonstrating the effectiveness of automatic rule induction. Our code is available at https://anonymous.4open.science/r/ADARULE-BBDB.
Wed 15 AprDisplayed time zone: Brasilia, Distrito Federal, Brazil change
11:00 - 12:30 | AI for Software Engineering 2Research Track at Asia IV Chair(s): Mike Papadakis University of Luxembourg | ||
11:00 15mTalk | Evaluating and Improving Automated Repository-Level Rust Issue Resolution with LLM-based Agents Research Track Jiahong Xiang Southern University of Science and Technology, Wenxiao He Southern University of Science and Technology, Xihua Wang Southern University of Science and Technology, Hongliang Tian Ant Group, Yuqun Zhang Southern University of Science and Technology | ||
11:15 15mTalk | SWE-Debate: Competitive Multi-Agent Debate for Software Issue Resolution Research Track Han Li Shanghai Jiao Tong University, China, Yuling Shi Shanghai Jiao Tong University, Shaoxin Lin , Xiaodong Gu Shanghai Jiao Tong University, Heng Lian Xidian University, Wang Xin , Yantao Jia Huawei, huangtao , Qianxiang Wang Huawei Technologies Co., Ltd | ||
11:30 15mTalk | More with Less: An Empirical Study of Turn-Control Strategies for Efficient Coding Agents Research Track | ||
11:45 15mTalk | ADARULE: LLM-Driven Natural Language to LTL Conversion via Pattern-Adaptive Rule Induction Research Track Jiayi Hu East China Normal University, Jingling Sun University of Electronic Science and Technology of China, Chong Wang Nanyang Technological University, Yihao Huang East China Normal University, jincaofeng , Yilongfei Xu East China Normal University, Yong Li Institute of Software, Chinese Academy of Sciences, Kailong Wang Huazhong University of Science and Technology, Weikai Miao Shanghai Key Lab for Trustworthy Computing, School of Computer Science and Software Engineering, East China Normal University, Jin Song Dong National University of Singapore, Geguang Pu East China Normal University, China | ||
12:00 15mTalk | Let the Trial Begin: A Mock-Court Approach to Vulnerability Detection using LLM-Based Agents Research Track Ratnadira Widyasari Singapore Management University, Singapore, Martin Weyssow Singapore Management University, Ivana Clairine Irsan Singapore Management University, Han Wei Ang GovTech, Frank Liauw Government Technology Agency Singapore, Eng Lieh Ouh Singapore Management University, Singapore, Lwin Khin Shar Singapore Management University, Hong Jin Kang University of Sydney, David Lo Singapore Management University | ||
12:15 15mTalk | Agent-Based Ensemble Reasoning for Repository-Level Issue Resolution Research Track Zhao Tian Tianjin University, Pengfei Gao ByteDance, Junjie Chen Tianjin University, Chao Peng ByteDance Pre-print | ||