Human-aligned AI Model Cards with Weighted Hierarchy Architecture
By: Pengyue Yang , Haolin Jin , Qingwen Zeng and more
Potential Business Impact:
Helps pick the best AI for any job.
The proliferation of Large Language Models (LLMs) has led to a burgeoning ecosystem of specialized, domain-specific models. While this rapid growth accelerates innovation, it has simultaneously created significant challenges in model discovery and adoption. Users struggle to navigate this landscape due to inconsistent, incomplete, and imbalanced documentation across platforms. Existing documentation frameworks, such as Model Cards and FactSheets, attempt to standardize reporting but are often static, predominantly qualitative, and lack the quantitative mechanisms needed for rigorous cross-model comparison. This gap exacerbates model underutilization and hinders responsible adoption. To address these shortcomings, we introduce the Comprehensive Responsible AI Model Card Framework (CRAI-MCF), a novel approach that transitions from static disclosures to actionable, human-aligned documentation. Grounded in Value Sensitive Design (VSD), CRAI-MCF is built upon an empirical analysis of 240 open-source projects, distilling 217 parameters into an eight-module, value-aligned architecture. Our framework introduces a quantitative sufficiency criterion to operationalize evaluation and enables rigorous cross-model comparison under a unified scheme. By balancing technical, ethical, and operational dimensions, CRAI-MCF empowers practitioners to efficiently assess, select, and adopt LLMs with greater confidence and operational integrity.
Similar Papers
Human-aligned AI Model Cards with Weighted Hierarchy Architecture
Software Engineering
Helps pick the best AI for your needs.
Cross-cultural value alignment frameworks for responsible AI governance: Evidence from China-West comparative analysis
Computers and Society
Checks if AI understands different cultures fairly.
AI Transparency Atlas: Framework, Scoring, and Real-Time Model Card Evaluation Pipeline
Artificial Intelligence
Checks AI for safety and honesty.