Constraint Discovery for Structured Generation via LLM-Guided SMT Inference
Large Language Models (LLMs) are increasingly applied to data-centric tasks in software maintenance and evo- lution, such as quality assurance and migration. While recent methods constrain LLM outputs using grammars or regular expressions, these syntactic techniques fail to enforce deeper semantic constraints involving numeric dependencies, conditional logic, and checksums. We present ClauseBandit, a framework that combines LLMs with Satisfiability Modulo Theories (SMT) solvers to generate structured data satisfying such constraints from natural language descriptions. ClauseBandit introduces a Bayesian inference approach that selects the most plausible SMT formula using posterior probabilities derived from formula self- consistency and data likelihoods. Evaluated on 27 structured generation tasks inspired by industrial use-cases, ClauseBandit successfully selected valid SMT formulas for 74.1% of tasks. Our approach enables LLM-based structured generation that goes beyond syntax, producing semantically valid, reusable constraint specifications from natural language.
Fri 12 SepDisplayed time zone: Auckland, Wellington change
15:30 - 16:30 | Session 18 - Quality Assurance 3Industry Track / Research Papers Track at Case Room 2 260-057 Chair(s): Raula Gaikovina Kula The University of Osaka | ||
15:30 15mFull-paper | Evaluation of the Language Server Protocol for Static Dependency Analysis Research Papers Track Pre-print | ||
15:55 15m | Monitoring Continuous Integration Practices in Industry: A Case Study Industry Track Jadson Santos Universidade Federal do Rio Grande do Norte, Daniel Alencar Da Costa University of Otago, Uirá Kulesza Federal University of Rio Grande do Norte | ||
16:10 15m | Constraint Discovery for Structured Generation via LLM-Guided SMT Inference Industry Track Hrishikesh Karmarkar TCS Research, Siddhesh Pagar TCS Research, Supriya Agrawal Tata Consultancy Services Ltd. (TCS), Vaibhavi Joshi TCS Research, Naman Paul TCS Research, Sagar Verma Tata Consultancy Services Ltd. (TCS) |