cmorization of atmos variables does not work on Power9 (bot works fine on fat nodes)
hi @jvegas
on power9 I get the following error when I try to cmorize atmospheric variables
[ERROR] Could not cmorize atmospheric file 1: cannot reshape array of size 1 into shape (7,2)
Traceback (most recent call last):
File "/gpfs/projects/bsc32/software/rhel/7.5/ppc64le/POWER9/software/earthdiagnostics/3.0.1-foss-2018b-Python-2.7.1
5/lib/python2.7/site-packages/earthdiagnostics-3.0.1-py2.7.egg/earthdiagnostics/cmorizer.py", line 233, in _cmorize_m
ma_files
self._cmorize_nc_files()
File "/gpfs/projects/bsc32/software/rhel/7.5/ppc64le/POWER9/software/earthdiagnostics/3.0.1-foss-2018b-Python-2.7.1
5/lib/python2.7/site-packages/earthdiagnostics-3.0.1-py2.7.egg/earthdiagnostics/cmorizer.py", line 139, in _cmorize_n
c_files
self._cmorize_nc_file(filename)
File "/gpfs/projects/bsc32/software/rhel/7.5/ppc64le/POWER9/software/earthdiagnostics/3.0.1-foss-2018b-Python-2.7.1
5/lib/python2.7/site-packages/earthdiagnostics-3.0.1-py2.7.egg/earthdiagnostics/cmorizer.py", line 388, in _cmorize_n
c_file
self._update_time_variables(handler)
File "/gpfs/projects/bsc32/software/rhel/7.5/ppc64le/POWER9/software/earthdiagnostics/3.0.1-foss-2018b-Python-2.7.1
5/lib/python2.7/site-packages/earthdiagnostics-3.0.1-py2.7.egg/earthdiagnostics/cmorizer.py", line 682, in _update_ti
me_variables
Utils.convert_units(handler.variables['time_bnds'], 'days since 1850-01-01 00:00:00', calendar, calendar)
File "/gpfs/projects/bsc32/software/rhel/7.5/ppc64le/POWER9/software/earthdiagnostics/3.0.1-foss-2018b-Python-2.7.1
5/lib/python2.7/site-packages/earthdiagnostics-3.0.1-py2.7.egg/earthdiagnostics/utils.py", line 794, in convert_units
var_handler[:] = old_unit.convert(var_handler[:], new_unit, inplace=True)
File "/gpfs/projects/bsc32/software/rhel/7.4/ppc64le/POWER9/software/Python/2.7.15-foss-2018b/lib/python2.7/site-pa
ckages/cf_units-2.0.2-py2.7-linux-ppc64le.egg/cf_units/__init__.py", line 1808, in convert
result = ut2.date2num(ut1.num2date(result))
File "cftime/_cftime.pyx", line 1210, in cftime._cftime.utime.num2date
File "/gpfs/projects/bsc32/software/rhel/7.4/ppc64le/POWER9/software/Python/2.7.15-foss-2018b/lib/python2.7/site-pa
ckages/numpy-1.14.3-py2.7-linux-ppc64le.egg/numpy/core/fromnumeric.py", line 257, in reshape
return _wrapfunc(a, 'reshape', newshape, order=order)
File "/gpfs/projects/bsc32/software/rhel/7.4/ppc64le/POWER9/software/Python/2.7.15-foss-2018b/lib/python2.7/site-pa
ckages/numpy-1.14.3-py2.7-linux-ppc64le.egg/numpy/core/fromnumeric.py", line 52, in _wrapfunc
return getattr(obj, method)(*args, **kwds)
ValueError: cannot reshape array of size 1 into shape (7,2)
On the fat nodes it works fine. It's only for atmospheric variables. Ocean variables seem to be ok and can be cmorized on power9.
I load earthdiagnostics/3.0.1-foss-2018b-Python-2.7.15
on power9 and earthdiagnostics/3.0.0rc4-foss-2015a-Python-2.7.9
on the fat nodes.
If you want to have a look at my settings: /esarchive/scratch/swild/earthdiagnostics/a1q0_atmos
Thanks!