Logging Requirement for Continuous Auditing of Responsible Machine Learning-based Applications
By: Patrick Loic Foalem , Leuson Da Silva , Foutse Khomh and more
Potential Business Impact:
Makes AI systems trustworthy and fair for everyone.
Machine learning (ML) is increasingly applied across industries to automate decision-making, but concerns about ethical and legal compliance remain due to limited transparency, fairness, and accountability. Monitoring through logging a long-standing practice in traditional software offers a potential means for auditing ML applications, as logs provide traceable records of system behavior useful for debugging, performance analysis, and continuous auditing. systematically auditing models for compliance or accountability. The findings underscore the need for enhanced logging practices and tooling that systematically integrate responsible AI metrics. Such practices would support the development of auditable, transparent, and ethically responsible ML systems, aligning with growing regulatory requirements and societal expectations. By highlighting specific deficiencies and opportunities, this work provides actionable guidance for both practitioners and tool developers seeking to strengthen the accountability and trustworthiness of ML applications.
Similar Papers
Monitoring and Observability of Machine Learning Systems: Current Practices and Gaps
Software Engineering
Helps computers make right choices, not wrong ones.
Log Probability Tracking of LLM APIs
Machine Learning (CS)
Checks if AI language models change secretly.
Monitoring Machine Learning Systems: A Multivocal Literature Review
Software Engineering
Keeps computer smarts working right all the time.