SLURM variables not passed to the Wrappers (Nodes, Tasks)
Hello @dbeltran and @bdepaula,
Autosubmit Version
4.0.0b0 ( autosubmit/4.0.0b18 (L,D))
Expid affected(If applicable)
a03i (in the Autosubmit VM)
Which task has issues? Where is the log(If applicable)
The wrapper scripts.
- Full_name: a03i_ASThread_1685087477111_32_2.cmd a03i_ASThread_16850874779610_32_3.cmd
Summary
I was setting vertical wrappers in the SIM step. I'm using this configuration for the PLATFORM (/appl/AS/AUTOSUBMIT_DATA/a03i/proj/workflow/conf/model/ifs-nemo /tco79l137
):
LUMI:
NODES: 2
TASKS: 16
THREADS: 8
PROCESSORS: 32
And this information is correctly passed to the SIM.cmd
scripts. You can check a03i_20200120_fc0_1_SIM.cmd
. The problem is that once the wrappers are enabled, some of this SLURM variables are no longer in the header (a03i_ASThread_1685087477111_32_2.cmd
), and once the SIM job is running, we got that SLURM_NTASKS_PER_NODE
was an unbound variable.
Steps to reproduce
Set up a platform with NODES, TASKS, THREADS and PROCESSORS, and a wrapper (mine is this one):
WRAPPERS:
WRAPPER_0:
TYPE: "vertical"
JOBS_IN_WRAPPER: "SIM"
What is the current bug behavior?
AS skips some of the SLURM variables.
What is the expected correct behavior?
Pass all the SLURM variables to the Wrapper script (I think).
Any other relevant information(if applicable)
This is for Climate DT. Right now we are running the spinups without wrappers because we got a reservation, but the historical and control runs must be done by the end of June and they would need to be launched in 1-2 weeks. And it would be great to be able to sort this out by then!
Thanks!