Skip to content
GitLab
Projects Groups Topics Snippets
  • /
  • Help
    • Help
    • Support
    • Community forum
    • Submit feedback
  • Sign in
  • SUNSET SUNSET
  • Project information
    • Project information
    • Activity
    • Labels
    • Members
  • Repository
    • Repository
    • Files
    • Commits
    • Branches
    • Tags
    • Contributor statistics
    • Graph
    • Compare revisions
  • Issues 42
    • Issues 42
    • List
    • Boards
    • Service Desk
    • Milestones
  • Merge requests 12
    • Merge requests 12
  • CI/CD
    • CI/CD
    • Pipelines
    • Jobs
    • Schedules
  • Deployments
    • Deployments
    • Environments
    • Releases
  • Packages and registries
    • Packages and registries
    • Package Registry
    • Terraform modules
  • Monitor
    • Monitor
    • Incidents
  • Analytics
    • Analytics
    • Value stream
    • CI/CD
    • Repository
  • Wiki
    • Wiki
  • Snippets
    • Snippets
  • Activity
  • Graph
  • Create a new issue
  • Jobs
  • Commits
  • Issue Boards
Collapse sidebar
  • Earth SciencesEarth Sciences
  • SUNSETSUNSET
  • Merge requests
  • !120

Develop save metrics scorecards

  • Review changes

  • Download
  • Patches
  • Plain diff
Merged Nadia Milders requested to merge develop-save_metrics_scorecards into master Feb 23, 2024
  • Overview 18
  • Commits 47
  • Pipelines 14
  • Changes 32

Hi @vagudets,

This development for including the statistical significance of metrics in the scorecards is now ready to be merged. Here is a list of the changes applied:

  • New skill metrics are calculated: rps_syear, rps_clim_syear, crps_syear, crps_clim_syear. These metrics have an extra dimension:syear, being each year of the requested data, so no temporal aggregation is applied.
  • The s2dv functions RPS.R and CRPS.R are temporally included since they have been altered to allow the dimension syear to be returned, by setting the parameter return_mean = FALSE.
  • Skill metrics are now saved in individual output files rather than all metrics in one file, using the new function: modules/Saving/R/save_metrics_scorecards.R. This function uses the CST_SaveExp function from CSTools.
  • A new module: Statistics has been created, the statistics are also saved in separate output files, in the output folder: outputs/Statistics/, and with the same filename structure as the skill metrics.
  • The statistics are also included in the Visualisation module so that when statistics is requested in recipe$Analysis$Workflow$Visualization$plots, then the statistics are plotted in the same way as the skill metrics.
  • The calculation of the statistical significance of the metrics is carried out in Scorecards.R, using both skill metrics and statistics.
  • The scorecards code has been updated to include the significance of the metrics in the plots, significant values are underlined.
  • The SCPlotScorecard function has been replaced by VizScorecard, the function from the new ESViz package.
  • The scorecard functions .SCTableColors and .SCLegend in modules/Scorecards/R/tmp/Utils.R have been removed since they are now included in VizScorecard.
  • The Scorecard.R function has been updated to include all available parameters of the function VizScorecard, so that they can be adjusted by the user. These parameters are also included in the recipe.

Let me know if anything is unclear.

Thanks,

Nadia

Assignee
Assign to
Reviewers
Request review from
Time tracking
Source branch: develop-save_metrics_scorecards