Attendants:

NES

• Done:
  • Bugfixing:
    • Correct the dimensions of the resulting points datasets from any interpolation.
    • Amend the interpolation method to account for cases in which the distance among points equals zero.
    • Correct the way we retrieve the level positive value.
    • Correct how to calculate the spatial bounds of LCC and Mercator grids: the dimensions were flipped.
    • Correct how to calculate the spatial bounds for all grids: use read axis limits instead of write axis limits.
    • Calculate centroids from coordinates in the creation of shapefiles, instead of using the geopandas function 'centroid', which raises a warning for possible errors.
    • Enable selection of variables on the creation of shapefiles
  • New Features:
    • Improve Lat-Lon to Cartesian coordinates method (used in Providentia).
    • Function to_shapefile() to create shapefiles from a NES object without losing data from the original grid and being able to select the time and level.
    • Function from_shapefile() to create a new grid with data from a shapefile after doing a spatial join.
    • Function create_shapefile() can now be used in parallel.
    • Function calculate_grid_area() to calculate the area of each cell in a grid.
    • Function calculate_geometry_area() to calculate the area of each cell given a set of geometries.

• Working on:
  • Horizontal Interpolation: Conservative
• Todo:
  • Release v1.1.0:
    • Finish Conservative remapping
    • Add Tests.
  • HERMES's needs:
    • Write by adding timesteps

SNES

• Waiting for NES release.

Auto-SNES

• Waiting for SNES release.

Auto-MONARCH

• HERMES on CIRRUS:
  • geopandas version <0.11

Other stuff

• CALIOPE_CAT:
  • Barnes cross-validation.
    • Code adapted to achieve the cross-validation but with Errors that I've not been able to solve.
      • It cannot run in a loop of stations.
      • Single station works fine. Then concatenate the results.
    • Miriam is testing the one-month execution (I've only tested one day)

Attendants:

NES

• Working on conservative horizontal interpolation
• New: to_shapefile & from_fhapefile
• TODO:
  • Tests for merging

SNES

• Vertical direction set
• Only interpolation

Auto-Monarch

Auto-SNES

• Waiting for SNES release

Other stuff

Attendants:

NES

• Solved some bugs but this does not affect any operational operation.
• Vertical direction hardcoded in NES

SNES

• How do we threat the vertical dimension?

Auto-Monarch

• CAMS RA workflow?

Auto-SNES

• Working on documentation and test cases

BDRC

• It should be working before February 2023
• New needs. 12h more.
  • SNES in serial.
  • To speedup an intermediate parallelization strategy has to be applied. This is the SNES issue to follow up on this improvement.
• CIRRUS installation.
  • This week

Other stuff

• Providentia interpolation:
  • Bug solved.
  • Release 1.0.0
  • Roadmap of auto-SNES transition done.

Attendants: Francesca, Francesco, Carles, Alba, Alejandro, Gilbert, Miriam

NES

• CAMS RA format has been validated by INERIS.
• v1.0.0 version has been released.
• NESv1.0.0 is installed as a nord3v2 module

SNES

• production branch updated with CAMS_RA format
• Created v1.0.0 version release.

Auto-Monarch

• Alejandro will start the CAMS RA workflow
  • SNES branch should be updated to tag v.1.0.0
  • SNES modules should be updated in order to use the installed module

Auto-SNES

• Working on documentation and test cases

Other stuff

• Providentia interpolation:
  • Alba is going to start the climatology on Providentia Interpolation project.
  • In parallel she will analyze the functionalities in order to get all the Providentia Interpolation current features
  • That current features will be used as a requirement for SNES future release.
  • Miriam will help to get the requirements list with their experiences using it.
  • She will also add suggestions for improvements.
  • If the priority list does not change, SNES with Providentia Interpolation features will be postponed till MN5 arrive.

Attendants: Francesca, Francesco, Carles, Alba, Alejandro, Gilbert, Miriam

NES

• Horizontal interpolation differences comes from normalization of weights.
• Tests on coordinates bounds in parallel.

Auto-Monarch

• implemented in the workflow
• TODO: remove split_method from the template

Attendants: Francesca, Francesco, Carles, Alba, Alejandro, Gilbert, Miriam

NES

• Changing labels related to AC-CES to CES to avoid discussion on AC-CES group (Alba)

SNES

• BDRC #18
  • Grib2 does not accept NaN. If FillFirstHour fails I'm substituting NaN by zero
  • Current Grib2 contains negative values

grib_dump /esarchive/scratch/fbeninca/SNES/2022091212_3H_SDSWAS_NMMB-BSC-v2_OPER.grb2 >> /gpfs/scratch/bsc32/bsc32538/SNES_tests/OUT/monarch/BDRC_AEMET/grib2/orig_dump.txt

cat /gpfs/scratch/bsc32/bsc32538/SNES_tests/OUT/monarch/BDRC_AEMET/grib2/orig_dump.txt | grep minimum
[bsc32538@login4 grib2]$ cat orig_dump.txt | grep minimum
  #-READ ONLY- minimum = -3.87477e-33;
  #-READ ONLY- minimum = -6.30957e-19;
  #-READ ONLY- minimum = -1.63499e-30;
  #-READ ONLY- minimum = -3.06059e-29;
  ...

• SNES implementation done. Pending tasks:
  • Testing
  • Auto-MONARCH:
    • File gathering
      • NetCDF
      • Grib2
    • md5sum

• Move project from ES group to AC group in Gitlab (Alba)

Auto-Monarch

• Memory issue running SNES in a real case of CAMS2_40 forecast. Split in 2 jobs?

Auto-SNES

Other stuff

Attendants: Francesca, Francesco, Carles, Alba, Alejandro, Gilbert, Miriam

NES

• Installation MN4
• Selection function (FillFirstHour & GFAS-Hourly)

SNES

• fill_first_hour_from #20
• Select write by variable #21
• BDRC #18
  • YES: File per variable (netcdf & grib2) → template gather them ?
  • NO: Or… Grib2 - One file with all variables #19

Auto-Monarch * DUST OK * WIP CAMS2_40

Auto-SNES

Other stuff

• CES meeting presentation

Attendants: Francesca, Francesco, Carles, Alba, Alejandro, Gilbert

NES

• Providentia experiment format (Alba)
• Create shapefile (Alba)
• Adding shapefile info to NetCDF (Alba)
• Selecting function WIP (GFAS-Hourly Carles)

SNES

• Enza ask for member implementation.

Auto-Monarch

• How it is going on?

Auto-SNES

• WIP: Pending issue to be resolved autosubmit #861

Other stuff

• BDRC: Outside BSC post-process
• fill_first_hour