What Do We Architect When We Architect LLM Agent Systems?
In LLM agent systems, many critical system behaviors no longer originate from hard-coded logic but emerge from model inference, strategy selection, and runtime state. This raises a fundamental question: when behavior is not in the code, what are we actually architecting? Traditional architecture diagrams often omit prompts, yet prompts determine system behavior. They often omit memory, yet memory determines long-term system drift. They often omit policies, yet policies determine whether systems remain safe. We may be drawing incomplete diagrams.
This paper argues that LLM agent architecture requires reasoning about five structural dimensions: control structures (who decides what happens next), knowledge structures (how memory is organized and governed), responsibility structures (who is accountable for what), constraint structures (what behaviors are permitted), and evolution structures (how systems change over time). While components and connectors remain foundational, they may be insufficient to fully characterize these systems; we must also architect the behavior space. We offer not a solution but a coordinate system—a vocabulary to discuss, debate, and develop these architectural foundations.
| What Do We Architect When We Architect LLM Agent Systems? (ICSE26_SABoF_Workshop_Kaixuan.pdf) | 392KiB |
Wed 15 AprDisplayed time zone: Brasilia, Distrito Federal, Brazil change
17:50 - 18:10 | |||
17:50 6mTalk | Reframing Software Architecture and Design Skills in the Era of Generative Artificial Intelligence Software Architecture BoF File Attached | ||
17:56 6mTalk | What Do We Architect When We Architect LLM Agent Systems? Software Architecture BoF Kaixuan Li Nanyang Technological University, Maoyi Xie Nanyang Technological University, Jingquan Ge AUMOVIO-NTU Corporate Lab, Nanyang Technological University, Yang Liu Nanyang Technological University File Attached | ||
18:03 6mTalk | Proofs of Concept as First-Class Architectural Decision Instruments Software Architecture BoF Fabio Petrillo École de technologie supérieure (ÉTS), Montréal -- Université du Québec, Bruno Antognolli École de technologie supérieur | ||