Automatic Metadata Capture and Processing for High-Performance Workflows
By: Polina Shpilker, Line Pouchard
Potential Business Impact:
Helps scientists track how computer programs run.
Modern workflows run on increasingly heterogeneous computing architectures and with this heterogeneity comes additional complexity. We aim to apply the FAIR principles for research reproducibility by developing software to collect metadata annotations for workflows run on HPC systems. We experiment with two possible formats to uniformly store these metadata, and reorganize the collected metadata to be as easy to use as possible for researchers studying their workflow performance.
Similar Papers
Designing FAIR Workflows at OLCF: Building Scalable and Reusable Ecosystems for HPC Science
Distributed, Parallel, and Cluster Computing
Helps scientists share and reuse computer tools.
FAIR Ecosystems for Science at Scale
Distributed, Parallel, and Cluster Computing
Helps scientists share computer tools to do science faster.
Towards FAIR and federated Data Ecosystems for interdisciplinary Research
Databases
Lets scientists share and reuse each other's data.