Pre-Filtering Code Suggestions using Developer Behavioral Telemetry to Optimize LLM-Assisted Programming
Large Language Models (LLMs) are increasingly integrated into code editors to provide AI-powered code suggestions. However, a significant proportion of these suggestions are ignored, leading to wasted resources, increased latency, and user frustration. In this work, we introduce a lightweight behavioral pre-filtering mechanism that predicts the likelihood of suggestion acceptance based solely on real-time developer telemetry—such as typing speed, file navigation, and editing activity—before triggering the LLM. Our method was deployed in a production-grade Visual Studio Code plugin used by professional developers in a naturalistic setting over four months. Empirical results show that the acceptance rate improved from 18.4% to 34.2%, while the total number of LLM suggestion requests was reduced by approximately 35%. This demonstrates that behavioral cues alone can be leveraged to meaningfully optimize both user experience and system efficiency in LLM-assisted coding workflows.
Sun 16 NovDisplayed time zone: Seoul change
08:30 - 10:00 | |||
09:05 15mShort-paper | LLM-Assisted Tool for Joint Generation of Formulas and Functions in Rule-Based Verification of Map Transformations ASYDE Ruidi He Technische Universität Clausthal, Yu Zhang Technische Universität Clausthal, Meng Zhang Institut für Software and Systems Engineering, TU Clausthal, Germany, Andreas Rausch | ||
09:20 20mFull-paper | On Effectiveness of Formal Model Repair by Large Language Models ASYDE Sebastião Carvalho Universidade de Lisboa, Instituto Superior Técnico, INESC-ID, Tsutomu Kobayashi Japan Aerospace Exploration Agency (JAXA), Fuyuki Ishikawa National Institute of Informatics | ||
09:40 20mFull-paper | Pre-Filtering Code Suggestions using Developer Behavioral Telemetry to Optimize LLM-Assisted Programming ASYDE Mohammad Nour Al Awad ITMO University, Sergey Ivanov ITMO University, Olga Tikhonova ITMO University | ||