Identifying Explanation Needs: Towards a Catalog of User-based Indicators
In today’s digitalized world, where software systems are becoming increasingly ubiquitous and complex, the quality aspect of explainability is gaining relevance. A major challenge in achieving adequate explanations is the elicitation of individual explanation needs, as it may be subject to severe hypothetical or confirmation biases. To address these challenges, we aim to establish user-based indicators concerning user behavior or system events that can be captured at runtime to determine when a need for explanations arises. In this work, we conducted an online study to collect self-reported indicators that could indicate a need for explanation. We compiled a catalog containing 17 relevant indicators concerning user behavior, 8 indicators concerning system events and 14 indicators concerning emotional states or physical reactions. We also analyze the relationships between these indicators and different types of need for expla- nation. The established indicators can be used in the elicitation process through prototypes, as well as after publication to gather requirements from already deployed applications using telemetry and usage data. Moreover, these indicators can be used to trigger explanations at appropriate moments during the runtime.
Wed 3 SepDisplayed time zone: Brussels, Copenhagen, Madrid, Paris change
11:00 - 12:30 | Explainability and Ethics IResearch Papers at Salon de Actos Chair(s): Meira Levy Shenkar College of Engineering, Design, Art | ||
11:00 30mPaper | Where Do Users Draw the Line? Ethical Concerns about Software Research Papers Daan Kieft Vrije Universiteit Amsterdam, Laura Duits Vrije Universiteit Amsterdam, Emitzá Guzmán Vrije Universiteit Amsterdam | ||
11:30 30mPaper | Model Cards Revisited: Bridging the Gap Between Theory and Practice for Ethical AI Requirements Research Papers Tim Puhlfürß University of Hamburg, Walid Maalej University of Hamburg, Julia Butzke University of Hamburg | ||
12:00 30mPaper | Identifying Explanation Needs: Towards a Catalog of User-based Indicators Research Papers Hannah Deters Leibniz University Hannover, Jakob Droste Leibniz Universität Hannover, Martin Obaidi Leibniz Universität Hannover, Laura Reinhardt Leibniz University Hannover, Kurt Schneider Leibniz Universität Hannover, Software Engineering Group Pre-print |