ICSE 2026
Sun 12 - Sat 18 April 2026 Rio de Janeiro, Brazil

The Model Context Protocol (MCP) enables large language models to dynamically integrate external organizational context, supporting more context-aware AI applications. We investigate its role in nonprofit email communication by introducing the Knowledge-Aware Nonprofit Tooling Architecture (KANTA), an MCP-based design that connects AI models to nonprofit data and tools, including mission statements, conversation history, and user-uploaded context. In a study with eight professionals from six nonprofits (22 scenarios), participants evaluated three context variants per thread: light (mission only), medium (mission plus current thread), and full (adds email history and uploaded context). They rated clarity, tone/personalization, and likelihood-to-use. Across measures, full-context replies were preferred and received higher satisfaction scores than light and medium. A linear mixed-effects analysis indicated significant improvements for full over lighter variants, and a nonparametric test showed a consistent, marginal trend in the same direction. Qualitative analysis showed participants perceived full-context outputs as “knowing what it’s talking about,” requiring less editing, and better matching relationship tone; suggestions emphasized asking clarifying questions when information was missing and maintaining professional formatting. We discuss how MCP operationalizes contextual grounding within existing nonprofit workflows, why combining MCP with interactive clarification and, where appropriate, retrieval-augmented generation may further improve usability, and limitations of this exploratory sample. Our results offer early evidence that richer, MCP-based context can measurably improve the usefulness of AI-generated nonprofit emails.

Tue 14 Apr

Displayed time zone: Brasilia, Distrito Federal, Brazil change

14:00 - 15:30
Evaluation, Reliability, and Engineering PracticeAGENT at Oceania VIII
Chair(s): Oshani Weerakoon Department of Computing, University of Turku
14:00
30m
Keynote
Keynote: On the Evaluation of AI Coding Agents
AGENT
K: Chao Peng ByteDance
14:30
6m
Talk
Beyond Task Completion: An Assessment Framework for Evaluating Agentic AI Systems
AGENT
Sreemaee Akshathala IIIT Hyderabad, Bassam Adnan IIIT Hyderabad, Mahisha Ramesh IIIT Hyderabad, Karthik Vaidhyanathan IIIT Hyderabad, Basil Muhammed MontyCloud, Kannan Parthasarathy MontyCloud
14:36
6m
Talk
PerfBench: Can Agents Resolve Real-World Performance Bugs?Virtual Attendance
AGENT
Spandan Garg Microsoft Corporation, Roshanak Zilouchian Moghaddam Microsoft, Neel Sundaresan Microsoft
Pre-print Media Attached
14:42
6m
Talk
SWEnergy: An Empirical Study on Energy Efficiency in Agentic Issue Resolution Frameworks with SLMs
AGENT
Arihant Tripathy IIIT Hyderabad, India, Ch Pavan Harshit IIIT Hyderabad, India, Karthik Vaidhyanathan IIIT Hyderabad
Link to publication DOI Pre-print
14:48
6m
Talk
Context Matters: Evaluating MCP-Based Context-Aware AI — A Case Study of Email Communications in Nonprofit Organizations
AGENT
Nitin Gupta University of Victoria, Jayani Samaraweera University of Victoria, Raaj Chatterjee Meaningful Technology Inc., Riya Shrestha University of Victoria, Trinity West University of Victoria, Dana Damian University of Victoria
14:54
6m
Talk
Toward Agentic Software Project Management: A Vision and Roadmap
AGENT
Lakshana Assalaarachchi Monash University, Australia, Zainab Masood Prince Sultan University, Rashina Hoda Monash University, John Grundy Monash University
15:00
6m
Talk
Not All Problems Are Nails, Not All Tools Should Be Hammers: A Position Paper on Agent Usage in Software Engineering Tasks
AGENT
Juuso Rytilahti Department of Computing, University of Turku, Panu Puhtila University of Turku, Oshani Weerakoon Department of Computing, University of Turku, Erkki Kaila Department of Computing, University of Turku, Tuomas Mäkilä University of Turku
15:06
24m
Live Q&A
Session 3 Joint Q&A
AGENT