Human-aligned AI Model Cards with Weighted Hierarchy Architecture
The proliferation of Large Language Models (LLMs) has led to a burgeoning ecosystem of specialized, domain-specific models. While this rapid growth accelerates innovation, it has simultaneously created significant challenges in effective model discovery and adoption. Users often struggle to navigate this fragmented landscape due to inconsistent, incomplete, and imbalanced documentation across platforms. Existing documentation frameworks, such as Model Cards and FactSheets, have advanced efforts toward standardize reporting, which are still often static, largely qualitative, and not always well suited for rigorous cross-model comparison lacking quantitative mechanisms. This gap exacerbates model underutilization and impedes responsible adoption. To address these gaps, we introduce the Comprehensive Responsible AI Model Card Framework (CRAI-MCF), a novel framework that transitions from static disclosures to actionable, human-aligned documentation. Grounded in Value Sensitive Design, CRAI-MCF is built upon an empirical analysis of 240 open-source projects, distilling 217 parameters into an eight-module, value-aligned architecture. Our framework introduces a quantitative sufficiency criterion to operationalize documentation sufficiency and support more rigorous cross-model documentation comparison within a unified scheme. By integrating technical, ethical, and operational dimensions, CRAI-MCF provides a structured and extensible template for authoring, organizing, and maintaining LLM documentation, with scoring used as a lightweight aid for prioritization and sufficiency checking.
Thu 9 JulDisplayed time zone: Eastern Time (US & Canada) change
14:00 - 15:30 | SE and AI 3Tool Demonstrations / Ideas, Visions and Reflections / Industry Papers / Journal-First Paper / Research Papers at MB 3.210 Chair(s): Earl T. Barr University College London | ||
14:00 20mTalk | Model Context Protocol (MCP): Landscape, Security Threats, and Future Research Directions Journal-First Paper Xinyi Hou Huazhong University of Science and Technology, Yanjie Zhao Huazhong University of Science and Technology, Shenao Wang Huazhong University of Science and Technology, Haoyu Wang Huazhong University of Science and Technology | ||
14:20 20mTalk | Human-aligned AI Model Cards with Weighted Hierarchy Architecture Industry Papers Pengyue Yang The University of Sydney, Haolin Jin The University of Sydney, Qingwen Zeng The University of Sydney, Jiawen Wen The University of Sydney, Harry Rao Bytedance, Huaming Chen The University of Sydney | ||
14:40 10mTalk | Machine Learning in the Wild: Early Evidence of Non-Compliant ML-Automation in Open-Source Software Ideas, Visions and Reflections Zohaib Arshid University of Sannio, Italy, Daniele Bifolco University of Sannio, Fiorella Zampetti University of Sannio, Italy, Massimiliano Di Penta University of Sannio, Italy | ||
14:50 20mTalk | SMARLA: A Safety Monitoring Approach for Deep Reinforcement Learning Agents Journal-First Paper Amirhossein Zolfagharian University of Ottawa - School of Electrical Engineering & Computer Science (EECS), Manel Abdellatif École de Technologie Supérieure, Lionel Briand University of Ottawa, Canada; Lero centre, University of Limerick, Ireland, Ramesh S | ||
15:10 10mTalk | DevGen: Automated Generation of Virtual Device Models for Kernel Drivers via Large Language Models Ideas, Visions and Reflections Mingyu Wang Xidian University, Bin Yu Xidian University, Wenjian Lu Xidian University, kefeng gao Xidian University, Zhi Wang Xidian University, Cheng Wen Xidian University, Xu Lu Xidian University, Cong Tian Xidian University | ||
15:20 10mTalk | Panther: Faster and Cheaper Computations with Randomized Numerical Linear Algebra Tool Demonstrations Fahd Seddik University of British Columbia, Abdulrahman Elbedewy University of Texas at Austin, Gaser Elmasry Cairo University, Mohamed Abdelmoniem Noon, Yahia Zakaria Cairo University Pre-print | ||