ICSA 2026
Mon 22 - Fri 26 June 2026
Wed 24 Jun 2026 16:20 - 16:40 at Theatre 8 - Trust, Ethics & Value Based Architecting Chair(s): Matteo Esposito

Autonomous systems, whether AI-enabled or not, increasingly operate in ethically sensitive contexts such as healthcare, assistive robotics, and smart environments. These systems are progressively acting on behalf of humans implicitly or explicitly, being humans proactive, reactive, or passive. However, ethical aspects, including both regulatory constraints (hard ethics) and human-dependent ethical preferences (soft ethics), are still insufficiently considered in their design and operation. This leads to a lack of trust and misalignment between system behavior and individuals and organizational values, as trust in autonomous systems requires the integration of ethical considerations alongside technical and legal requirements. In particular, current autonomous systems are typically unable to incorporate humans’ ethical preferences into their decision-making process, or to adapt their behavior at runtime based on evolving contextual and human preferences. This calls for architectural mechanisms that enable systems to monitor contextual dynamics, embed ethical considerations, and continuously align their behavior with both hard and soft ethics. Existing works, including laws, regulatory frameworks, ethical guidelines for AI, and international standards and recommendations, primarily ensure compliance with legal, safety, and societal principles. While they highlight the importance of ethical considerations in autonomous systems, they do not provide concrete guidance on how to operationalise and implement ethical preferences within the software architecture of such systems. Similarly, prior research in machine ethics often focuses on embedding predefined ethical rules or specific ethical theories, which fail to address the variability of human values and the need for systems to adapt to different humans and contexts. This gap between high-level ethical principles and practical system design motivates the need for a reference architecture that helps engineers integrate both regulatory requirements and human-centered ethical adaptation in the development of ethical-aware autonomous systems. In this direction, this paper proposes a \emph{reference architecture for ethical-aware autonomous systems} that explicitly supports runtime adaptation to both hard and soft ethics. The proposed architecture extends the classical MAPE-K feedback loop (Monitor-Analyze-Plan-Execute-Knowledge) into an \emph{E-MAPE-K} loop (\emph{Ethical}-Monitor-Analyze-Plan-Execute-Knowledge), introducing an \emph{Ethic Connector} component responsible for managing ethical profiles, mediating ethical decisions through ethics-driven negotiation, and explainability. Additionally, ethical awareness is embedded across all feedback-loop phases, enabling the Monitor, Analyze, Plan, and Execute components to incorporate ethical reasoning, compliance checking, ethics-driven negotiation, and autonomy adjustment as first-class architectural concerns.

The main contributions of the paper are: - Definition of ethical-aware autonomous systems: We provide a precise conceptual definition of the concept of ethical-aware autonomous systems. - Requirements for ethical-aware autonomous systems: We derive the main requirements useful to identify the main functionalities that ethical-aware autonomous systems should support. The identified requirements are validated with domain experts with background knowledge of autonomous systems, digital ethics, trust, and privacy. - Reference architecture for ethical-aware autonomous systems: We propose a reusable reference architecture for ethical-aware autonomous systems, built on top of the MAPE-K feedback loop. The reference architecture is validated through a scenario-based evaluation in two ethically sensitive domains from the literature, i.e., body sensor networks in healthcare and assistive robotics.

The proposed reference architecture aims to help system and software architects and engineers in designing and developing ethical-aware autonomous systems that should interact and collaborate with humans while respecting values important to individuals, society, and the environment.

Wed 24 Jun

Displayed time zone: Amsterdam, Berlin, Bern, Rome, Stockholm, Vienna change

16:00 - 17:30
Trust, Ethics & Value Based ArchitectingNew and Emerging Ideas / Journal First / Software Architecture in Practice / Research Papers / ‎​ at Theatre 8
Chair(s): Matteo Esposito University of Oulu
16:00
20m
Research paper
Exploring Ethical Values in Software Systems: A Systematic Literature ReviewJournal First
Journal First
Razieh Alidoosti Gran Sasso Science Institute, Vrije Universiteit Amsterdam, Patricia Lago Vrije Universiteit Amsterdam, Maryam Razavian Eindhoven University of Technology, Antony Tang Swinburne University of Technology
DOI
16:20
20m
Research paper
A Reference Architecture for Ethical-Aware Autonomous SystemsJournal First
Journal First
Marco Autili University of L'Aquila, Italy, Martina De Sanctis Gran Sasso Science Institute, Mashal Afzal Memon University of L’Aquila, Italy, Paola Inverardi Gran Sasso Science Institute (GSSI), Patrizio Pelliccione Gran Sasso Science Institute, L'Aquila, Italy, Sara Pettinari Gran Sasso Science Institute
16:40
15m
Paper
Design-First Governance for Reliable AI-Assisted Software DevelopmentDistinguished Paper Award
New and Emerging Ideas
16:55
15m
Short-paper
Designing Value-Based Platforms: Architectural Strategies Derived from the Digital Markets Act
Research Papers
Fabian Stiehle TU Munich, Markus Funke Vrije Universiteit Amsterdam, Patricia Lago Vrije Universiteit Amsterdam, Ingo Weber TU Munich & Fraunhofer, Munich
Pre-print
17:10
15m
Paper
Enhancing Banking Operations Using Design Science Research and Speech-to-Text Processing with Google Gemini
Software Architecture in Practice