Detecting Malicious Intents in Smart Contracts with Pre-trained Programming Language Models
Malicious developer intents in smart contracts constitute significant security threats to decentralized applications, leading to substantial economic losses. Prior work introduced SmartIntentNN, a deep learning model for detecting unsafe developer intents. By combining the Universal Sentence Encoder, a K-means clustering-based intent highlighting mechanism, and a Bidirectional Long Short-Term Memory (BiLSTM) network, the model achieved an F1 score of 0.8633 on an evaluation set of 10,000 real-world smart contracts across ten distinct intent categories. This paper presents SmartIntentV2 (Smart Contract Intent Neural Network Version2). The primary enhancement is the integration of a BERT-based pre-trained programming language model, which we domain-adaptively pre-train on a dataset of 16,000 real-world smart contracts using a Masked Language Modeling objective. SmartIntentV2 retains the BiLSTM-based multi-label classification network for intent detection. On the same evaluation set of 10,000 smart contracts, it achieves superior performance with an accuracy of 0.9789, precision of 0.9090, recall of 0.9476, and an F1 score of 0.9279, substantially outperforming its predecessor and other baseline models. Notably, SmartIntentV2 also delivers a 65.5% relative improvement in F1 score over GPT-4.1 on this specialized task. These results establish SmartIntentV2 as a new state-of-the-art model for smart contract intent detection.
Sun 5 JulDisplayed time zone: Eastern Time (US & Canada) change
16:00 - 18:00 | Session 4: Security, Trust, and Verification of LLM-Generated CodePROMISE 2026 at MB 3.430 Chair(s): Zhijie Wang Concordia University | ||
16:00 15mTalk | Model-Driven Automation of Cyber-Physical Systems via AADL and LLMs PROMISE 2026 | ||
16:15 15mTalk | MAS-SRE: A Multi-Agent System for Security Requirements Engineering PROMISE 2026 Savvas Mantzouranidis Blekinge Institute of Technology, Ricardo Britto Ericsson / Blekinge Institute of Technology | ||
16:30 15mTalk | Detecting Malicious Intents in Smart Contracts with Pre-trained Programming Language Models PROMISE 2026 Youwei Huang Independent Researcher, Jianwen Li Carnegie Mellon University, Silicon Valley, Sen Fang North Carolina State University, Yao Li Macau University of Science and Technology, Peng Yang Institute of Intelligent Computing Technology, Suzhou, CAS, Bin Hu Institute of Computing Technology, Chinese Academy of Sciences | ||
16:45 10mTalk | Probabilistic Evidence Aggregation for Source Code Authorship Verification: An Ongoing Set-Based Approach PROMISE 2026 | ||
16:55 5mDay closing | Closing PROMISE 2026 Lili Wei McGill University, Xiaoyu Sun Australian National University, Australia, Csaba Nagy PONTUM Software GmbH | ||