Commits · 177b6256bd9aa0da9110f52dfaa63ac1bfcce44a · Marvin Axness / Post Processing Netcdf Files · GitLab

28 Feb, 2025 2 commits
- Script to fix combined filenames · 177b6256
  Marvin Axness authored Feb 28, 2025
  
  177b6256
- Added script to correct short_name · 5127d375
  Marvin Axness authored Feb 28, 2025
  
  5127d375
26 Feb, 2025 3 commits
- Changing opening permissions for safety · 4925049c
  Marvin Axness authored Feb 26, 2025
  
  4925049c
- Add default cmor tables path for MN5 · 653dbf28
  Marvin Axness authored Feb 26, 2025
  
  653dbf28
- Script to fix data short_name · 6944b6f5
  Marvin Axness authored Feb 26, 2025
  
  6944b6f5
25 Feb, 2025 5 commits
- Change to avoid including end month in monthly combination of files · 129fbb1a
  Marvin Axness authored Feb 25, 2025
  
  129fbb1a
- Include dynamic load balancing and parallelization for PL loops · c632513f
  Marvin Axness authored Feb 25, 2025
  
  c632513f
- Adding dynamic load balancing with ProcessPoolExecutor submit · c029a4ad
  Marvin Axness authored Feb 25, 2025
  
  c029a4ad
- Testing with Monthly combination · a92bd361
  Marvin Axness authored Feb 25, 2025
  
  a92bd361
- Bug due to confusion between chunk and enddate in construct_dates · d239a2f5
  Marvin Axness authored Feb 25, 2025
  
  d239a2f5
24 Feb, 2025 4 commits
- Removing trailing zeros · 57d38980
  Marvin Axness authored Feb 24, 2025
  
  57d38980
- adding module purge · bde4a644
  Marvin Axness authored Feb 24, 2025
  
  bde4a644
- Feature for flexibility with chunk simulations start date issue · bd6c5d03
  Marvin Axness authored Feb 24, 2025
  
  bd6c5d03
- Arguments missing for output_folder · 3a304188
  Marvin Axness authored Feb 24, 2025
  
  3a304188
21 Feb, 2025 2 commits
- Hardcoding some things like start date and fclen · 4506c655
  Marvin Axness authored Feb 21, 2025
  
  4506c655
- Adapting to new runs, moving output to specific output folder · 06d7cce8
  Marvin Axness authored Feb 21, 2025
  
  06d7cce8
12 Feb, 2025 4 commits
- Support for personalized cloned repo · 6e320825
  Marvin Axness authored Feb 12, 2025
  
  6e320825
- Cleanup manual postprocessing slurm script · 2b7e1c75
  Marvin Axness authored Feb 12, 2025
  
  2b7e1c75
- Adding manual post-processing · f69d0e90
  Marvin Axness authored Feb 12, 2025
  
  f69d0e90
- Adding script to remove redundant netcdf · 693edd9b
  Marvin Axness authored Feb 12, 2025
  
  693edd9b
23 Jan, 2025 2 commits
- Making NEMO levels path as optional flag · f6ce5205
  Marvin Axness authored Jan 23, 2025
  
  f6ce5205
- add condition to not processed files that have already been combined · f03ba082
  Marvin Axness authored Jan 23, 2025
  
  f03ba082
22 Jan, 2025 2 commits
- Adding keyword to print statement flush=True to output log, instead of keeping in buffer · 0c103ec8
  Marvin Axness authored Jan 22, 2025
  
  0c103ec8
- Rename entry in yaml for more clarity · 1e263bea
  Marvin Axness authored Jan 22, 2025
  
  1e263bea
21 Jan, 2025 9 commits
- Deleting unnecessary flag from manual postprocessing · ba35fa46
  Marvin Axness authored Jan 21, 2025
  
  ba35fa46
- Fix of datetime end_date calculation · 44ca1620
  Marvin Axness authored Jan 21, 2025
  
  44ca1620
- Missing arg · 079b47dc
  Marvin Axness authored Jan 21, 2025
  
  079b47dc
- Change format of dates · 29c02b65
  Marvin Axness authored Jan 21, 2025
  
  29c02b65
- Merge branch 'main' of https://earth.bsc.es/gitlab/maxness/post-processing-netcdf-files · 13dfd203
  Marvin Axness authored Jan 21, 2025
  
  13dfd203
- Refactoring code to allow for manual postprocessing of multiple rundirectories · f60462af
  Marvin Axness authored Jan 21, 2025
  
  f60462af
- Adding thread-safety · 293c9ac0
  Marvin Axness authored Jan 21, 2025
  
  293c9ac0
- Working on manual postprocessing for all rundirs · 18a2f352
  Marvin Axness authored Jan 21, 2025
  
  18a2f352
- Testing on conda environment, using concurrent.features python · 462bcd63
  Marvin Axness authored Jan 21, 2025
  
  462bcd63
20 Jan, 2025 3 commits
- Parallelization causes segfault, so setting workers to 1. Fixed flags in manual submit job · f68acaa5
  Marvin Axness authored Jan 20, 2025
  
  f68acaa5
- Add flags for manual post processing job · f2b1b467
  Marvin Axness authored Jan 20, 2025
  
  f2b1b467
- Small parallelization with ThreadPoolExecutor · 11cbbe15
  Marvin Axness authored Jan 20, 2025
  
  11cbbe15
17 Jan, 2025 3 commits
- Merge branch 'feature/Performance_Optimizations' · 894ff0dd
  Marvin Axness authored Jan 17, 2025
  
  894ff0dd
- Modify manual submit script · 6ab6ac55
  Marvin Axness authored Jan 17, 2025
  
  6ab6ac55
- Parallelize main loop with ThreadPoolExecutor · 39152ab7
  Marvin Axness authored Jan 17, 2025
  
  39152ab7
14 Jan, 2025 1 commit
- Temporal fix for Monthly fields postprocessing · 138c85ea
  Marvin Axness authored Jan 14, 2025
  
  138c85ea