ICSE 2026
Sun 12 - Sat 18 April 2026 Rio de Janeiro, Brazil

\textbf{Context.} Autonomous agents powered by Large Language Models (LLMs) are increasingly used for software engineering, but their reliance on large, proprietary models limits deployment on local hardware. This has spurred interest in Small Language Models (SLMs), but their practical effectiveness and efficiency within complex agentic frameworks for automated issue resolution remain poorly understood.

\textbf{Goal.} We investigate the performance, energy efficiency, and resource consumption of four leading agentic issue resolution frameworks when deliberately constrained to using SLMs. Our goal is to understand the viability of these systems for this task in resource-limited settings and characterize the resulting trade-offs.

\textbf{Method.} We conduct a controlled evaluation of four leading agentic frameworks (SWE-Agent, OpenHands, Mini SWE Agent, AutoCodeRover) using two SLMs (Gemma-3 4B, Qwen-3 1.7B) on the SWE-bench Verified Mini benchmark. On fixed hardware, we measure energy, duration, token usage, and memory over 150 runs per configuration.

\textbf{Results.} We find that framework architecture is the primary driver of energy consumption. The most energy-intensive framework, AutoCodeRover (Gemma), consumed 9.4x more energy on average than the least energy-intensive, OpenHands (Gemma). However, this energy is largely wasted. Task resolution rates were near-zero (4% for AutoCodeRover, 0% for all others), demonstrating that current frameworks, when paired with SLMs, consume significant energy on unproductive reasoning loops. The SLM’s limited reasoning was the bottleneck for \textit{success}, but the framework’s design was the bottleneck for \textit{efficiency}.

\textbf{Conclusions.} Current agentic frameworks, designed for powerful LLMs, fail to operate efficiently with SLMs. We find that framework architecture is the primary driver of energy consumption, but this energy is largely wasted due to the SLMs’ limited reasoning. Achieving viable, low-energy solutions requires a paradigm shift from passive orchestration to new architectures that actively manage the SLM’s weaknesses.

Tue 14 Apr

Displayed time zone: Brasilia, Distrito Federal, Brazil change

14:00 - 15:30
Evaluation, Reliability, and Engineering PracticeAGENT at Oceania VIII
Chair(s): Oshani Weerakoon Department of Computing, University of Turku
14:00
30m
Keynote
Keynote: On the Evaluation of AI Coding Agents
AGENT
K: Chao Peng ByteDance
14:30
6m
Talk
Beyond Task Completion: An Assessment Framework for Evaluating Agentic AI Systems
AGENT
Sreemaee Akshathala IIIT Hyderabad, Bassam Adnan IIIT Hyderabad, Mahisha Ramesh IIIT Hyderabad, Karthik Vaidhyanathan IIIT Hyderabad, Basil Muhammed MontyCloud, Kannan Parthasarathy MontyCloud
14:36
6m
Talk
PerfBench: Can Agents Resolve Real-World Performance Bugs?Virtual Attendance
AGENT
Spandan Garg Microsoft Corporation, Roshanak Zilouchian Moghaddam Microsoft, Neel Sundaresan Microsoft
Pre-print Media Attached
14:42
6m
Talk
SWEnergy: An Empirical Study on Energy Efficiency in Agentic Issue Resolution Frameworks with SLMs
AGENT
Arihant Tripathy IIIT Hyderabad, India, Ch Pavan Harshit IIIT Hyderabad, India, Karthik Vaidhyanathan IIIT Hyderabad
14:48
6m
Talk
Context Matters: Evaluating MCP-Based Context-Aware AI — A Case Study of Email Communications in Nonprofit Organizations
AGENT
Nitin Gupta University of Victoria, Jayani Samaraweera University of Victoria, Raaj Chatterjee Meaningful Technology Inc., Riya Shrestha University of Victoria, Trinity West University of Victoria, Dana Damian University of Victoria
14:54
6m
Talk
Toward Agentic Software Project Management: A Vision and Roadmap
AGENT
Lakshana Assalaarachchi Monash University, Australia, Zainab Masood Prince Sultan University, Rashina Hoda Monash University, John Grundy Monash University
15:00
6m
Talk
Not All Problems Are Nails, Not All Tools Should Be Hammers: A Position Paper on Agent Usage in Software Engineering Tasks
AGENT
Juuso Rytilahti Department of Computing, University of Turku, Panu Puhtila University of Turku, Oshani Weerakoon Department of Computing, University of Turku, Erkki Kaila Department of Computing, University of Turku, Tuomas Mäkilä University of Turku
15:06
24m
Live Q&A
Session 3 Joint Q&A
AGENT