CMORization of newly arrived chunks without redoing everything
Hello!
I think I had mentioned this problem orally to @jvegas but I thought it would be better to report it here too.
I'm running the EarthDiagnostics on an experiment (a0dc
, config. file /home/Earth/fmassonn/EARTHDIAGS/diags_a0dc
). I did not activate the online CMORization for this experiment, so I have to do it offline using EarthDiagnostics (FORCE = True
in the [CMOR]
block). My experiment is ongoing, meaning that new data arrives each day, and hence has to be CMORized before diagnostics can be run.
I'm able to CMORIze the data in general (so, that's good), but if I want to CMORize new data that has been transferred say today, I will have to re-CMORize all the chunks from the beginning. In other words, it's impossible now to CMORize only one specific chunk, or a set of chunks, or a given range of chunks. For now, the only possibility is to CMORize chunk 1 to X, where X can change.
Fixing this would be very helpful, because it takes a lot of time to CMORize a chunk...
Thanks in advance,
François