Helping architects to make quality design decisions using LLM-based assistantsShort Paper
Architectural knowledge and more specifically design deci- sions have become first-class entities to be captured routinely in a design process. In recent years, a number of approaches, tools, and formats have been proposed for handling the relevant design decisions for a system. However, the quality of the decisions captured is often low for many reasons. Part of the problem is that reflections intended to criticize, and thus improve, the decisions are seldom made, typically due to poor reflective practices in the architecture team. In this regard, some experiments have shown that poor reflections (e.g., by novice architects) produce low- quality decisions. In order to improve reflective practices and capture better design decisions, we propose an approach that integrates a design assistant for typical reflective tasks of the design process using generative AI techniques. Our assistant, called ArchMind, relies on two information sources: architectural knowledge about existing software patterns, and information about the system under design (e.g., context, requirements, past decisions). Furthermore, the assistant takes advantage of the capabilities of Large Language Models to progressively aid architects in the selection and analysis of alternative decisions, until capturing the chosen decisions in an Architecture Decision Record format. This work describes the assistant prototype and discusses initial results from a comparison with architects’ decisions from a classroom experience.
Wed 4 SepDisplayed time zone: Amsterdam, Berlin, Bern, Rome, Stockholm, Vienna change
11:00 - 12:35 | Technical Session 1: Architecture decision makingResearch Papers at Hollenfels Chair(s): Jasmin Jahic University of Cambridge, UK | ||
11:00 15mShort-paper | Towards Teamwise Informed Decisions On Microservice Security SmellsShort Paper Research Papers Francisco Ponce , Jacopo Soldani University of Pisa, Italy, Hernan Astudillo Universidad Andrés Bello, Chile, Antonio Brogi Università di Pisa | ||
11:15 15mShort-paper | Automated Quality Concerns Extraction from User Stories and Acceptance Criteria for Early Architectural DecisionsShort Paper Research Papers Khubaib Amjad Alam National University of Computer and Emerging Sciences, Hira Asif National University of Computer & emerging Sciences (FAST-NUCES), Irum Inayat Chalmers | University of Gothenburg, Saif-Ur-Rehman Khan Department of Computing, Shifa Tameer-e-Millat University (STMU) | ||
11:30 25mFull-paper | Exploring Architectural Design Decisions in Mailing Lists and their Traceability to Issue TrackersBest Paper Award CandidateArtifact Award CandidateResearch Paper Research Papers Mohamed Soliman Paderborn University | ||
11:55 25mFull-paper | Introducing Architecture Decision Records in Practice: An Action Research StudyExperience Report Research Papers Bardha Ahmeti Chalmers | University of Gothenburg, Maja Linder Chalmers | University of Gothenburg, Raffaela Groner Chalmers | University of Gothenburg, Rebekka Wohlrab Chalmers University of Technology | ||
12:20 15mShort-paper | Helping architects to make quality design decisions using LLM-based assistantsShort Paper Research Papers Andres Diaz Pace UNICEN University, Antonela Tommasel ISISTAN Research Institute, CONICET-UNCPBA, Rafael Capilla Universidad Rey Juan Carlos |