When Platform is in main, Queue type not specified on platform LUMI Error
Hello @dbeltran and @bdepaula,
Autosubmit Version
Autosubmit is running with 4.0.89
Expid affected(If applicable)
I recycled a06l to show you the issue.
Which task has issues? Where is the log(If applicable)
The issue appears in the autosubmit create.
Summary
We have a platforms.yml
with:
Platforms:
lumi:
TYPE: slurm
HOST: lumi-cluster
And then some users want to customize things in main.yml
:
PLATFORMS:
LUMI:
NODES: 112
TASKS: 16
THREADS: 8
PROCESSORS: 1792
PARTITION: "standard"
MAX_WALLCLOCK: "02:00"
When they to this, they get:
[ERROR] Trace: Queue type not specified on platform LUMI
[CRITICAL] Error obtaining the project data, check the parameters related to PROJECT and GIT/SVN or LOCAL sections [eCode=7014]
This is solved when adding the type of platform in the main.yml
. But it is a little bit confusing. I was just thinking that maybe is because of the lowercase-uppercase mismatch (but it shouldn't, right?).
Steps to reproduce
We are using --minimal, and a bootstrap with this include.yml
:
DEFAULT:
CUSTOM_CONFIG:
PRE:
- "%PROJDIR%/conf"
- "%PROJDIR%/conf/simulation/%RUN.SIMULATION%.yml"
- "%PROJDIR%/conf/parameter/%RUN.PARAMETER%.yml"
- "%PROJDIR%/conf/model/%RUN.MODEL%/%RUN.MODEL%.yml"
- "%PROJDIR%/conf/model/%RUN.MODEL%/%RUN.GRID_ATM%.yml"
- "%PROJDIR%/conf/application/%RUN.APPLICATION%.yml"
POST:
- "~/platforms.yml"
~
The platforms.yml file is loaded in the first bullet point (- "%PROJDIR%/conf"
). And then in the main.yml (that is in the middle of pre and post) it is overwritten. So to reproduce the error you should have a platform in pre, and try to override some values in another file that comes after it.
Relevant logs and/or screenshots(if applicable)
The a06l experiment 4.0.0b0 version is being updated to 4.0.89 for match autosubmit version
Autosubmit is running with 4.0.89
Preparing .lock file to avoid multiple instances with same expid.
Traceback (most recent call last):
File "/appl/AS/4.0.89/lib/python3.9/site-packages/autosubmit-4.0.89-py3.9.egg/autosubmit/autosubmit.py", line 4539, in create
if not Autosubmit._copy_code(as_conf, expid, as_conf.experiment_data.get("PROJECT",{}).get("PROJECT_TYPE","none"), False):
File "/appl/AS/4.0.89/lib/python3.9/site-packages/autosubmit-4.0.89-py3.9.egg/autosubmit/autosubmit.py", line 4765, in _copy_code
submitter.load_platforms(as_conf)
File "/appl/AS/4.0.89/lib/python3.9/site-packages/autosubmit-4.0.89-py3.9.egg/autosubmit/platforms/paramiko_submitter.py", line 156, in load_platforms
raise Exception(
Exception: Queue type not specified on platform LUMI
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/appl/AS/4.0.89/lib/python3.9/site-packages/autosubmit-4.0.89-py3.9.egg/autosubmit/autosubmit.py", line 4544, in create
raise AutosubmitCritical("Error obtaining the project data, check the parameters related to PROJECT and GIT/SVN or LOCAL sections", code=7014,trace=str(e))
log.log.AutosubmitCritical:
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/appl/AS/4.0.89/lib/python3.9/site-packages/autosubmit-4.0.89-py3.9.egg/EGG-INFO/scripts/autosubmit", line 37, in main
Autosubmit.parse_args()
File "/appl/AS/4.0.89/lib/python3.9/site-packages/autosubmit-4.0.89-py3.9.egg/autosubmit/autosubmit.py", line 690, in parse_args
return Autosubmit.create(args.expid, args.noplot, args.hide, args.output, args.group_by, args.expand,
File "/appl/AS/4.0.89/lib/python3.9/site-packages/autosubmit-4.0.89-py3.9.egg/autosubmit/autosubmit.py", line 4735, in create
raise AutosubmitCritical(e.message, e.code, e.trace)
log.log.AutosubmitCritical:
[ERROR] Trace: Queue type not specified on platform LUMI
[CRITICAL] Error obtaining the project data, check the parameters related to PROJECT and GIT/SVN or LOCAL sections [eCode=7014]
Any other relevant information(if applicable)
It is sorted out when adding TYPE: slurm
under the platform in main, but is a little misleading for the users.
Thanks!!!