yProv4ML: Effortless Provenance Tracking for Machine Learning Systems
By: Gabriele Padovani, Valentine Anantharaj, Sandro Fiore
Potential Business Impact:
Helps track how computer "brains" learn best.
The rapid growth of interest in large language models (LLMs) reflects their potential for flexibility and generalization, and attracted the attention of a diverse range of researchers. However, the advent of these techniques has also brought to light the lack of transparency and rigor with which development is pursued. In particular, the inability to determine the number of epochs and other hyperparameters in advance presents challenges in identifying the best model. To address this challenge, machine learning frameworks such as MLFlow can automate the collection of this type of information. However, these tools capture data using proprietary formats and pose little attention to lineage. This paper proposes yProv4ML, a framework to capture provenance information generated during machine learning processes in PROV-JSON format, with minimal code modifications.
Similar Papers
Provenance Tracking in Large-Scale Machine Learning Systems
Machine Learning (CS)
Tracks AI training to save energy and time.
PROV-AGENT: Unified Provenance for Tracking AI Agent Interactions in Agentic Workflows
Distributed, Parallel, and Cluster Computing
Tracks AI agent mistakes to fix them.
Model Provenance Testing for Large Language Models
Cryptography and Security
Finds if one AI was copied from another.