Commits · e41c2a22756944afc53cdf3539956aeb1a168929 · Marvin Axness / Post Processing Netcdf Files · GitLab

18 Mar, 2025 4 commits
- Parallelizing reordering of dimensions · e41c2a22
  Marvin Axness authored Mar 18, 2025
  
  e41c2a22
- Order_time_dimension changes · dbda3911
  Marvin Axness authored Mar 18, 2025
  
  dbda3911
- Order time dimension · e133113e
  Marvin Axness authored Mar 18, 2025
  
  e133113e
- New code to reorder time chronologically · abc5e711
  Marvin Axness authored Mar 18, 2025
  
  abc5e711
17 Mar, 2025 9 commits
- Fix timestamp for valid_date regardless of frequency · 8c30f440
  Marvin Axness authored Mar 17, 2025
  
  8c30f440
- Small local changes · 529c4c40
  Marvin Axness authored Mar 17, 2025
  
  529c4c40
- Doesn't stop execution when NODE file gives error, it could not be created so return false · 5873c1e2
  Marvin Axness authored Mar 17, 2025
  
  5873c1e2
- Postprocessing hourly and monthly for control a28a · 08331eed
  Marvin Axness authored Mar 17, 2025
  
  08331eed
- Script to fix filenames · 0e000d90
  Marvin Axness authored Mar 17, 2025
  
  0e000d90
- Hourly case · 3400ee1b
  Marvin Axness authored Mar 17, 2025
  
  3400ee1b
- Fixing filename for more genneral case · 283d4f5b
  Marvin Axness authored Mar 17, 2025
  
  283d4f5b
- Added code to simply fix first timestamp of date · e1a2947f
  Marvin Axness authored Mar 17, 2025
  
  e1a2947f
- Counting files for postproc of hourly and monthly of 18 chunks · ecdfa945
  Marvin Axness authored Mar 17, 2025
  
  ecdfa945
14 Mar, 2025 15 commits
- Force flush of print · eceacc8c
  Marvin Axness authored Mar 14, 2025
  
  eceacc8c
- Added touching of file to allow for simultanous executions of script · ba6df9c6
  Marvin Axness authored Mar 14, 2025
  
  ba6df9c6
- Adding flush to print · 0fa8b38b
  Marvin Axness authored Mar 14, 2025
  
  0fa8b38b
- Parameter number data_chcker combine netcdf · 1647dd0c
  Marvin Axness authored Mar 14, 2025
  
  1647dd0c
- Adding debug print · e97a9578
  Marvin Axness authored Mar 14, 2025
  
  e97a9578
- Added code to reproduce bottleneck · 293df36b
  Marvin Axness authored Mar 14, 2025
  
  293df36b
- Adding touch to create empty file right before writing, which allows for multiple job executions · 97e26152
  Marvin Axness authored Mar 14, 2025
  
  97e26152
- Created full exp analysis slurm + took out chunking · 1adec689
  Marvin Axness authored Mar 14, 2025
  
  1adec689
- Bug for chunk_start_date value reading from Daily fieds · 1b382d19
  Marvin Axness authored Mar 14, 2025
  
  1b382d19
- PostProcess only hourly and monthly data · 69ac8f64
  Marvin Axness authored Mar 14, 2025
  
  69ac8f64
- Chunking for writing file · f2d7f0a4
  Marvin Axness authored Mar 14, 2025
  
  f2d7f0a4
- working on MN5, little parallelization · 6a591563
  Marvin Axness authored Mar 14, 2025
  
  6a591563
- Adding code to loop through all successful rundirs · 313925a7
  Marvin Axness authored Mar 14, 2025
  
  313925a7
- Eliminating level parallelization for now · b9880157
  Marvin Axness authored Mar 14, 2025
  
  b9880157
- Dask parallelization during writing · 442c5004
  Marvin Axness authored Mar 14, 2025
  
  442c5004
13 Mar, 2025 12 commits
- Looking into chunking when writing nc file · 38ad8264
  Marvin Axness authored Mar 13, 2025
  
  38ad8264
- Added parallelization to dates and levels with n_proc var · d77d4c3d
  Marvin Axness authored Mar 13, 2025
  
  d77d4c3d
- Added level parallelization · af0961c3
  Marvin Axness authored Mar 13, 2025
  
  af0961c3
- Force dask to use single-threaded execution ( we loose parallelization) · f11ca070
  Marvin Axness authored Mar 13, 2025
  
  f11ca070
- Adding chunking · b328fa14
  Marvin Axness authored Mar 13, 2025
  
  b328fa14
- Reverting engine used from h5netcdf to netcdf4 · 7136476e
  Marvin Axness authored Mar 13, 2025
  
  7136476e
- Error handling in processing level fields · 2f658340
  Marvin Axness authored Mar 13, 2025
  
  2f658340
- Small argument fixes and new submission script slurm · d499197d
  Marvin Axness authored Mar 13, 2025
  
  d499197d
- Add path to cmor table · 4e70687b
  Marvin Axness authored Mar 13, 2025
  
  4e70687b
- Adding print debug line · 7478fe76
  Marvin Axness authored Mar 13, 2025
  
  7478fe76
- Apply dask delayed for all calls in combine_netcdf · 27719b9f
  Marvin Axness authored Mar 13, 2025
  
  27719b9f
- Parallelizing inner level loop with dask · d3f321fa
  Marvin Axness authored Mar 13, 2025
  
  d3f321fa