AC Post-Process Working Group Meetings
20230502
Attendants:
NES:
SNES:
auto-SNES:
Other stuff
20230404
Attendants:
NES
SNES
auto-SNES
Other stuff
20230321
Attendants:
NES
DONE:
Bugfix on cell_methods serial write
Write 2D string data (timezones)
Sum Nes objects (sum variables)
Write by time step
Concatenation improved times
Working on:
TODO:
Training requested.
SNES
Auto-SNES
Auto-MONARCH
Other stuff
20230307
Attendants:
NES
v1.1.0 release done:
Improve Lat-Lon to Cartesian coordinates method (used in Providentia).
Horizontal Interpolation: Conservative
Shapefile:
Function to_shapefile() to create shapefiles from a NES object without losing data from the original grid and being able to select the time and level.
Function from_shapefile() to create a new grid with data from a shapefile after doing a spatial join.
Function create_shapefile() can now be used in parallel.
Function calculate_grid_area() to calculate the area of each cell in a grid.
Function calculate_geometry_area() to calculate the area of each cell given a set of geometries.
Function get_spatial_bounds_mesh_format() to get the lon-lat boundaries in a mesh format (used in pcolormesh).
Bugs fixing:
Correct the dimensions of the resulting points datasets from any interpolation.
Amend the interpolation method to take into account the cases in which the distance among points equals zero.
Correct the way we retrieve the level positive value.
Correct how to calculate the spatial bounds of LCC and Mercator grids: the dimensions were flipped.
Correct how to calculate the spatial bounds for all grids: use read axis limits instead of write axis limits.
Calculate centroids from coordinates in creating shapefiles, instead of using the geopandas function 'centroid', which raises a warning for possible errors.
Enable selection of variables on the creation of shapefiles.
Correct read and write parallel limits.
Correct data type in the parallelization of points datasets.
Correct errors that appear when trying to select coordinates and write the file.
Working on:
Next steps:
Training requested.
SNES
v1.1.0 release done:
Correct way to use level.positive NetCDF metadata.
Added sum_levels new options in the CSV.
Added the option to choose if you want to enable (or not) the sum_levels option by variable with the 'sum_levels' column.
Added the option to choose if you want to write (or not) the sum_levels option by variable with the 'sum_levels_path' column
Added NES conservative horizontal interpolation.
NES update to v1.1.0 (see NESv1.1.0 release notes)
Next steps:
Auto-SNES
Auto-MONARCH
Other stuff
20230207
Attendants:
NES
Done:
Bugfixing:
Correct the dimensions of the resulting points datasets from any interpolation.
Amend the interpolation method to account for cases in which the distance among points equals zero.
Correct the way we retrieve the level positive value.
Correct how to calculate the spatial bounds of LCC and Mercator grids: the dimensions were flipped.
Pending to merge-request:
Correct how to calculate the spatial bounds for all grids: use read axis limits instead of write axis limits.
Calculate centroids from coordinates in the creation of shapefiles, instead of using the geopandas function 'centroid', which raises a warning for possible errors.
Enable selection of variables on the creation of shapefiles
New Features:
Improve Lat-Lon to Cartesian coordinates method (used in Providentia).
Function to_shapefile() to create shapefiles from a NES object without losing data from the original grid and being able to select the time and level.
Function from_shapefile() to create a new grid with data from a shapefile after doing a spatial join.
Function create_shapefile() can now be used in parallel.
Pending to merge:
Working on:
Todo:
Release v1.1.0:
HERMES's needs:
SNES
Auto-SNES
Auto-MONARCH
Other stuff
20230124
Attendants:
NES
SNES
Vertical direction set
Only interpolation
Auto-Monarch
Auto-SNES
Other stuff
20221213
Attendants:
NES
SNES
Auto-Monarch
Auto-SNES
BDRC
Other stuff
20221129
Attendants: Francesca, Francesco, Carles, Alba, Alejandro, Gilbert, Miriam
NES
CAMS RA format has been validated by INERIS.
v1.0.0 version has been released.
NESv1.0.0 is installed as a nord3v2 module
SNES
Auto-Monarch
Auto-SNES
Other stuff
20221018
Attendants: Francesca, Francesco, Carles, Alba, Alejandro, Gilbert, Miriam
NES
Auto-Monarch
20221004
Attendants: Francesca, Francesco, Carles, Alba, Alejandro, Gilbert, Miriam
NES
SNES
grib_dump /esarchive/scratch/fbeninca/SNES/2022091212_3H_SDSWAS_NMMB-BSC-v2_OPER.grb2 >> /gpfs/scratch/bsc32/bsc32538/SNES_tests/OUT/monarch/BDRC_AEMET/grib2/orig_dump.txt
cat /gpfs/scratch/bsc32/bsc32538/SNES_tests/OUT/monarch/BDRC_AEMET/grib2/orig_dump.txt | grep minimum
[bsc32538@login4 grib2]$ cat orig_dump.txt | grep minimum
#-READ ONLY- minimum = -3.87477e-33;
#-READ ONLY- minimum = -6.30957e-19;
#-READ ONLY- minimum = -1.63499e-30;
#-READ ONLY- minimum = -3.06059e-29;
...
Auto-Monarch
Auto-SNES
Other stuff
20220920
Attendants: Francesca, Francesco, Carles, Alba, Alejandro, Gilbert, Miriam
NES
SNES
-
Select write by variable
#21-
Auto-Monarch
* DUST OK
* WIP CAMS2_40
Auto-SNES
Other stuff
20220906
Attendants: Francesca, Francesco, Carles, Alba, Alejandro, Gilbert
NES
Providentia experiment format (Alba)
Create shapefile (Alba)
Adding shapefile info to NetCDF (Alba)
Selecting function WIP (GFAS-Hourly Carles)
SNES
Auto-Monarch
Auto-SNES
Other stuff