Model Cards Revisited: Bridging the Gap Between Theory and Practice for Ethical AI Requirements
Model cards are the primary documentation framework for developers of artificial intelligence (AI) models to communicate critical information to their users. Users are often developers themselves looking for relevant documentation to ensure that their AI implementation complies with the ethical requirements of existing laws, guidelines, and standards. However, recent studies indicate inadequate model documentation practices. This paper characterizes a gap between recent advancements in requirements engineering for ethical AI and current practices in model documentation, aiming to provide actionable guidance to bridge this gap. We conducted a thematic analysis of 26 guidelines on ethics and AI, three AI documentation frameworks, three quantitative studies of model cards, and ten actual model cards to identify a total of 43 ethical requirements relevant to model documentation. We organize these requirements into a taxonomy featuring four themes and twelve sub-themes representing ethical principles. Our findings indicate that model developers predominantly emphasize model capabilities and reliability in the documentation while overlooking other ethical aspects, such as explainability, user autonomy, and fairness. This underscores the necessity for enhanced support in documenting ethical AI considerations and advocates for a revised model card framework that represents a holistic approach to ethical AI requirements.
Wed 3 SepDisplayed time zone: Brussels, Copenhagen, Madrid, Paris change
11:00 - 12:30 | Explainability and Ethics IResearch Papers at Salon de Actos Chair(s): Meira Levy Shenkar College of Engineering, Design, Art | ||
11:00 30mPaper | Where Do Users Draw the Line? Ethical Concerns about Software Research Papers Daan Kieft Vrije Universiteit Amsterdam, Laura Duits Vrije Universiteit Amsterdam, Emitzá Guzmán Vrije Universiteit Amsterdam | ||
11:30 30mPaper | Model Cards Revisited: Bridging the Gap Between Theory and Practice for Ethical AI Requirements Research Papers Tim Puhlfürß University of Hamburg, Walid Maalej University of Hamburg, Julia Butzke University of Hamburg | ||
12:00 30mPaper | Identifying Explanation Needs: Towards a Catalog of User-based Indicators Research Papers Hannah Deters Leibniz University Hannover, Jakob Droste Leibniz Universität Hannover, Martin Obaidi Leibniz Universität Hannover, Laura Reinhardt Leibniz University Hannover, Kurt Schneider Leibniz Universität Hannover, Software Engineering Group Pre-print |