Issue with a mask?
Hi @sloosvel ,@pabretonniere ,
@pabretonniere, I finally successfully launched the earthdiagnostics jobs with auto-ecearth (reducing a lot the number of diagnostics).
The first two jobs, (for the first two chunks) succeeded but for the third one, I have this error in the .out file (/esarchive/autosubmit/a4a0/tmp/LOG_a4a0/a4a0_19800101_fc00_3_EARTHDIAGS.20220215152227.out
):
^[[31m[ERROR] Interpolate with CDO Startdate: 19800101 Member: 0 Chunk: 3 Variable: ocean:tos Frequency: mon Target grid: r360x180 Original grid: Mask ocean: True Model: Ec3.2_O25L75: [Errno -101] NetCDF: HDF error: b'mask.nc'
File "/opt/conda/lib/python3.8/site-packages/earthdiagnostics/work_manager.py", line 313, in _run_job
job.compute()
File "/opt/conda/lib/python3.8/site-packages/earthdiagnostics/ocean/interpolatecdo.py", line 318, in compute
mask = Utils.get_mask(Basins().Global).astype(float)
File "/opt/conda/lib/python3.8/site-packages/earthdiagnostics/utils.py", line 92, in get_mask
mask_handler = Utils.open_cdf("mask.nc")
File "/opt/conda/lib/python3.8/site-packages/earthdiagnostics/utils.py", line 630, in open_cdf
return netCDF4.Dataset(filepath, mode)
File "src/netCDF4/_netCDF4.pyx", line 2330, in netCDF4._netCDF4.Dataset.__init__
File "src/netCDF4/_netCDF4.pyx", line 1948, in netCDF4._netCDF4._ensure_nc_success
and in the .err file (/esarchive/autosubmit/a4a0/tmp/LOG_a4a0/a4a0_19800101_fc00_3_EARTHDIAGS.20220215152227.err
):
+ singularity exec /esarchive/software/containers/earthdiagnostics/earthdiagnostics-latest.sif earthdiags -f /gpfs/scratch/bsc32/bsc32283/a4a0/diags_a4a0_19800101_fc00_3.conf -lc DEBUG
^[[33mWARNING:^[[0m seccomp requested but not enabled, seccomp library is missing or too old
HDF5-DIAG: Error detected in HDF5 (1.10.6) thread 47495698716416:
#000: H5F.c line 509 in H5Fopen(): unable to open file
major: File accessibilty
minor: Unable to open file
#001: H5Fint.c line 1535 in H5F_open(): file is already open for read-only
major: File accessibilty
minor: Unable to open file
I'm not sure what is this mask.nc
and I don't understand why it's failing for this chunk.
Could you help me here?
Thanks