This program is tentative and subject to change.

Fri 9 Oct 2026 14:40 - 15:00 at Grand Ballroom Salons A+B - Session 2

Coding agents now solve programming problems at comparable rates across languages, but reaching a solution is not equally cheap in every language. We study how the choice of programming language affects the tokens an agent spends, and what agent behavior drives the difference. We run four models—Gemma, Qwen, GPT-5.5, and Sonnet—in Python, Java, Rust, and OCaml on MiniLCB, a 100-problem subset of LiveCodeBench, letting each agent iterate against a vis- ible test suite until it passes. After controlling for problem difficulty, OCaml costs significantly more than Python for every model, while the Java and Rust penalties depend on the model.

Why is this the case? To explain where the extra tokens go, we re-execute every intermediate solution an agent writes and abstract each trajectory into a graph over passing and failing test states. We then label the work that drives each transition between states. These trajectory graphs expose the sources of token cost that a raw count hides: agents thrash against an unfamiliar language’s compiler, over-revise solutions that already pass, and reach for a more familiar language to sidestep an unfamiliar one. We propose token efficiency as a second axis for benchmarking multilingual coding agents, complementary to success rate—and, for the tokenmaxxer, a guide to the most expensive language to work in.

This program is tentative and subject to change.

Fri 9 Oct

Displayed time zone: Pacific Time (US & Canada) change

13:30 - 15:00
13:30
20m
Full-paper
FlowCheck: Helping End-users Specify and Verify Intent in Vibe-Coded Web Apps
LMPL
Reya Vir Columbia University, Lydia Chilton Columbia University, Zhuo Zhang Columbia University, Eugene Wu Columbia University
13:50
15m
Short-paper
Type-Carrying Names
LMPL
Xuejing Huang Standard Chartered Bank
14:05
20m
Full-paper
Predicting Program Exit Code with LLMs and Programming Language Semantics
LMPL
Lara Marinov The University of Texas at Austin, Aditya Thimmaiah University of Texas at Austin, Jayanth Srinivasa Cisco, Junyi Jessy Li University of Texas at Austin, USA, Milos Gligoric University of Texas at Austin
14:25
15m
Short-paper
Dissociating language and thought in the brain using LLM-guided program synthesis
LMPL
Kartik Chandra MIT, Pablo Wentz MIT, Mitchell Chan MIT, Jonathan Ragan-Kelley Massachusetts Institute of Technology, Joshua B. Tenenbaum Massachusetts Institute of Technology, Rebecca Saxe MIT
14:40
20m
Full-paper
The Best Programming Language for Tokenmaxxing: An Investigation of Coding Agent Behavior Across Programming Languages
LMPL
Zixuan Wu Northeastern University, Carolyn Jane Anderson Wellesley College, Arjun Guha Northeastern University, USA
Hide past events