-
Provenance feature for Loading and Aggregation modules: By specifying
Provenance: yes
in the Analysis section of the recipe, JSON files will be generated and stored inout_dir/outputs/provenance
during the workflow execution. These files contain a comprehensive description of the transformations applied to the data using the METACLIP ontologies. As a result, the transformations can be interactively visualized with the METACLIP interpreter. -
When running multiple jobs with autosubmit, setting the parameter
auto_conf$provenance
toTrue
triggers the creation of the filerocrate.yml
. This file is later used by autosubmit to create a zip archive withro-crate-metadata.json
at the top level. This JSON file includes all the provenance details related to the autosubmit execution. Additionally, it contains the provenance of each individual job, described with METACLIP, as well as the recipes used. For more information: https://earth.bsc.es/gitlab/es/sunset/-/tree/Dev-Provenance/use_cases/ex1_4_provenance_autosubmit.