startR merge requestshttps://earth.bsc.es/gitlab/es/startR/-/merge_requests2020-10-29T16:23:54+01:00https://earth.bsc.es/gitlab/es/startR/-/merge_requests/108Stop the execution after removing the bigmemory object in Compute2020-10-29T16:23:54+01:00Nuria Pérez-ZanónStop the execution after removing the bigmemory object in ComputeHi @cdelgado,
This merge request fixes the problem you detected.
The last version I did to clean /dev/shm folder, correctly removed the bigmemory files if the code fails in the retrieving data step. However, the code doesn't fail so ec...Hi @cdelgado,
This merge request fixes the problem you detected.
The last version I did to clean /dev/shm folder, correctly removed the bigmemory files if the code fails in the retrieving data step. However, the code doesn't fail so ecFlow detects the job as finished and the user gets a result (filled with zeros as @cdelgado reported).
This new version should stop the process just after cleaning the memory, so, ecFlow will show that the job has failed.
@aho, please, let me know if you have any inconveniences in installing this version in WS (R 3.6.1) and Nord3. Given that it is a problem with Compute when submitting to a cluster, this is the only way I know to test it.
Cheers,
Núriahttps://earth.bsc.es/gitlab/es/startR/-/merge_requests/28Apply input data needs names to work with use_attributes2019-11-18T15:43:58+01:00Nuria Pérez-ZanónApply input data needs names to work with use_attributesHi @aho!
I want to check how well ClimProjDiags fits with Compute, as ClimProjDiags is following the approach of working in arrays of any number of dimensions with named dimensions.
To do it, I would develop examples for each of them....Hi @aho!
I want to check how well ClimProjDiags fits with Compute, as ClimProjDiags is following the approach of working in arrays of any number of dimensions with named dimensions.
To do it, I would develop examples for each of them. The first one has been DTRRef, which inputs are two variables maximum and minimum temperature, and it also require the dates to do the calculation. So, the example will require two calls for Start() and the parameter use_attributes.
When running Compute, a warning appears indicating that the names of the use of attributes didn't match with the names of the input data:
```
5: In multiApply::Apply(data, target_dims = attr(step_fun, "TargetDims"), :
Parameter 'use_attributes' provided with names, but no names provided for 'data'. All names will be disregarded.
```
However, I was providing the same names. I think that the parameter 'cube_headers' had the names when function ByChunks() starts running, but later they aren't passed to 'data' in the call of Apply.
The solution I propose in this branch solve the problem in the example I did.
See the exemple in the file /esarchive/scratch/nperez/git/Flor/ClimProjDiags_Tests/DTRRef_Ex_Start.R
Could you consider this fix or improving it?
Thanks!
Núriaahoaho