Differences

This shows you the differences between two versions of the page.

--- working_groups:ces:postprocess [2023/02/07 10:17]
ctena [20230207]
+++ working_groups:ces:postprocess [2023/05/02 08:09] (current)
ctena
@@ Line 1: / Line 1: @@
 ====== AC Post-Process Working Group Meetings ======
+===== 20230502 =====
+Attendants:
+**NES**:
+  * Alba requested **Pypi** to remove the current NES package. Stattus?
+  * **Unit changing** (Dene's package)
+    * Pending to provide examples to Dene. [[https://earth.bsc.es/gitlab/ac/unit-converter/-/issues/1|unit-converter #1]]
+  * **Rotated-Nested** create. Pending to merge [[https://earth.bsc.es/gitlab/es/NES/-/issues/46|#46]]
+  * **MONARCH** output type
+    * Pending: **CMAQ** and **WRF-Chem** [[https://earth.bsc.es/gitlab/es/NES/-/issues/63|#63]]
+  * **Tutorial** date selected: [[https://doodle.com/meeting/participate/id/bmY89D3b|Tuesday 2023/05/16 from 15:00 to 17:00]]
+    * 23/28 people
+    * **TODO**: Check & refactor Jupyther Notebooks [[https://earth.bsc.es/gitlab/es/NES/-/issues/65|#65]]
+  * **Pending**:
+    * **Unmapped** horizontal interpolation regions [[https://earth.bsc.es/gitlab/es/NES/-/issues/64|#64]]
+**SNES**:
+  * Added **daily** input type form ESARCHIVE
+  * Added **conservative** horizontal interpolation
+    * TODO: agree and implement flux to mass (and mass to flux) for conservative remapping.
+      * We have suggested some options and the chosen one from Oriol is to add a new column in the CSV indicating if you want to apply that transformation. [[https://earth.bsc.es/gitlab/es/SNES/-/issues/38|#38]]
+**auto-SNES**:
+  * Oriol is **testing the conservative** remapping with auto-SNES & AS/4.
+  * Dani Beltran suggest to remove the current AS/4 to point to the new tag, but I rejected the idea until auto-SNES is adapted to the new tag changes. [[https://earth.bsc.es/gitlab/es/autosubmit/-/issues/1022|Autosubmit #1022]]
+  * **Pending**:
+    * Testing suite [[https://earth.bsc.es/gitlab/es/auto-SNES/-/issues/8|#8]]
+**Other stuff**
+  * **Output-checker**: interpolated data stattus? CAMS2_40 check? [[https://earth.bsc.es/gitlab/es/auto-monarch/-/issues/532|auto-MONARCH #532]]
+  * Slow multi-day statistics (Miriam)
+  * Maria's monthly outputs [[https://earth.bsc.es/gitlab/ac/nmmb-monarch/-/issues/224|MONARCH #224]]
+  * Providentia Interpolation [[https://earth.bsc.es/gitlab/es/SNES/-/issues/17|SNES #17]]
+===== 20230404 =====
+Attendants:
+**NES**
+  * Alba suggests opening the NES library with PyPi:
+    * Readthedocs documentation
+    * Change the name to one not picked in the PyPi repository
+      * **PIOLES**: **P**arallel **I**nput **O**utput **L**ibrary for **E**arth **S**cience
+      * PIOLib
+      * PIOLIbES
+      * **APIO**: **A**utomatic **P**arallel **I**nput **O**utput
+      * **PIOESlib**: **P**arallel **IO** for **E**arth **S**cience **Lib**rary
+      * **MIOPES**: **M**ulti **IO** **P**arallel for **E**arth **S**cience
+  * Unit changing (Dene's package)
+    * Alba is going to lead that task.
+  *
+**SNES**
+  * No news
+**auto-SNES**
+  * No news
+**Other stuff**
+  * Slow multi-day statistics (Miriam)
+    * Maria's monthly outputs
+    * Providentia Interpolation
+===== 20230321 =====
+Attendants:
+**NES**
+  * DONE:
+    * Bugfix on cell_methods serial write
+    * Write 2D string data (timezones)
+    * Sum Nes objects (sum variables)
+    * Write by time step
+    * Concatenation improved times
+  * Working on:
+    * Spin-up bug
+  * TODO:
+    * Nested-Rotated domain (needed for HERMES)
+    * Spatial Join: Improve time & memory for large datasets (needed for HERMES)
+  * Training requested.
+**SNES**
+  * No news
+**Auto-SNES**
+  * Testing suite experiments created.
+  * Next steps:
+    * Fix the benchmark experiments (waiting for auto-MONARCH validation)
+**Auto-MONARCH**
+  * Testing Suite. Output checker fails for NES_master
+**Other stuff**
+  *
+===== 20230307 =====
+Attendants:
+**NES**
+  * v1.1.0 release done:
+    * Improve Lat-Lon to Cartesian coordinates method (used in Providentia).
+    * Horizontal Interpolation: Conservative
+    * Shapefile:
+      * Function **to_shapefile()** to create shapefiles from a NES object without losing data from the original grid and being able to select the time and level.
+      * Function **from_shapefile()** to create a new grid with data from a shapefile after doing a spatial join.
+      * Function **create_shapefile()** can now be used in parallel.
+    * Function **calculate_grid_area()** to calculate the area of each cell in a grid.
+    * Function **calculate_geometry_area()** to calculate the area of each cell given a set of geometries.
+    * Function **get_spatial_bounds_mesh_format()** to get the lon-lat boundaries in a mesh format (used in pcolormesh).
+    * Bugs fixing:
+      * Correct the dimensions of the resulting points datasets from any interpolation.
+      * Amend the interpolation method to take into account the cases in which the distance among points equals zero.
+      * Correct the way we retrieve the level positive value.
+      * Correct how to calculate the spatial bounds of LCC and Mercator grids: the dimensions were flipped.
+      * Correct how to calculate the spatial bounds for all grids: use read axis limits instead of write axis limits.
+      * Calculate centroids from coordinates in creating shapefiles, instead of using the geopandas function 'centroid', which raises a warning for possible errors.
+      * Enable selection of variables on the creation of shapefiles.
+      * Correct read and write parallel limits.
+      * Correct data type in the parallelization of points datasets.
+      * Correct errors that appear when trying to select coordinates and write the file.
+  * Working on:
+    * Pending to merge:
+      * Bug on cell_methods serial write
+  * Next steps:
+    * Sum Nes objects (sum variables)
+    * Write 2D string data (timezones)
+    * Nested-Rotated domain
+  * Training requested.
+**SNES**
+  * v1.1.0 release done:
+    * Correct way to use level.positive NetCDF metadata.
+    * Added sum_levels new options in the CSV.
+      * Added the option to choose if you want to enable (or not) the sum_levels option by variable with the 'sum_levels' column.
+      * Added the option to choose if you want to write (or not) the sum_levels option by variable with the 'sum_levels_path' column
+    * Added NES conservative horizontal interpolation.
+    * NES update to v1.1.0 (see NESv1.1.0 release notes)
+  * Next steps:
+    * run an auto-MONARCH testing suite
+**Auto-SNES**
+  * Next steps:
+    * Testing suite:
+      * Create a testing suite with operational runs (at least)
+**Auto-MONARCH**
+  * Everything OK?
+**Other stuff**
+  *
 ===== 20230207 =====
@@ Line 11: / Line 164: @@
       * Correct the way we retrieve the level positive value.
       * Correct how to calculate the spatial bounds of LCC and Mercator grids: the dimensions were flipped.
-      * **Pending to merge**:
+      * **Pending to merge-request**:
         * Correct how to calculate the spatial bounds for all grids: use read axis limits instead of write axis limits.
         * Calculate centroids from coordinates in the creation of shapefiles, instead of using the geopandas function 'centroid', which raises a warning for possible errors.

User Tools

Site Tools

Differences

Page Tools