This is the branch for the GRIB loading module. It works with the whole workflow (Loading -> Calibration -> Skill -> Saving & Plotting.) Except for the loading part, all the other modules are not changed. If you want to try, you can run test_GRIB.R on Nord3v2 (the memory fits in the normal node). If you want to check the outputs directly, the result netCDF files and plotting are under /esarchive/scratch/aho/repos/auto-s2s/out-logs/recipe_GRIB_system5_era5_20230314122734/outputs/ECMWF-SEAS5/mse_min-monthly_mean/tas/20201101.
I put other details in #66 (closed). Let me know if you have questions, thanks!
Cheers,
An-Chi
TODO
-
Checks after loading are not added yet. -
A dictionary for variable name conversion (e.g., "2t" in GRIB attr "shortName" should be "tas") -
Memory consumption checks