Skip to content
GitLab
Projects Groups Topics Snippets
  • /
  • Help
    • Help
    • Support
    • Community forum
    • Submit feedback
  • Sign in
  • autosubmit autosubmit
  • Project information
    • Project information
    • Activity
    • Labels
    • Members
  • Repository
    • Repository
    • Files
    • Commits
    • Branches
    • Tags
    • Contributor statistics
    • Graph
    • Compare revisions
  • Issues 338
    • Issues 338
    • List
    • Boards
    • Service Desk
    • Milestones
  • Merge requests 21
    • Merge requests 21
  • Deployments
    • Deployments
    • Releases
  • Monitor
    • Monitor
    • Incidents
  • Analytics
    • Analytics
    • Value stream
    • Repository
  • Wiki
    • Wiki
  • Snippets
    • Snippets
  • Activity
  • Graph
  • Create a new issue
  • Commits
  • Issue Boards
Collapse sidebar
  • Earth SciencesEarth Sciences
  • autosubmitautosubmit
  • Issues
  • #1458
Closed
Open
Issue created Nov 19, 2024 by Francesc Roura Adserias@froura🌍Developer

Problems with custom_directives

( This is a template for bug reports. Please fill in the relevant information and delete the rest. )

Hello @dbeltran and @bdepaula,

Autosubmit Version

4.1.10

Expid affected(If applicable)

OPA_ENERGY_ONSHORE_1

Which task has issues? Where is the log(If applicable)

  • Full_name: a1tz_20240101_fc0_1_1_OPA_ENERGY_ONSHORE_6

  • Log_Path: /gpfs/scratch/ehpc01/bsc032056/a1tz/LOG_a1tz

Summary

apparently not parsed correctly from opa.yml configuration file:

# Options for different HPCs here
PLATFORMS:
  LUMI:
    OPA_CUSTOM_DIRECTIVES: '#SBATCH --mem=100G'
    OPA_EXCLUSIVE: False
  MARENOSTRUM5:
    OPA_CUSTOM_DIRECTIVES: "['#SBATCH -t 00:29:00','#SBATCH --exclusive']"
    OPA_EXCLUSIVE: 'True'

This is parsed in the jobs_apps.yml as

(...)
  OPA:
    CHECK: on_submission
    CUSTOM_DIRECTIVES: '%CURRENT_OPA_CUSTOM_DIRECTIVES%'

(...)

and in the .cmd appears as:

#SBATCH -t 48:00:00
#SBATCH -J a1tz_20240101_fc0_1_1_OPA_ENERGY_ONSHORE_6
#SBATCH --output=/gpfs/scratch/ehpc01/bsc032056/a1tz/LOG_a1tz/a1tz_20240101_fc0_1_1_OPA_ENERGY_ONSHORE_6.cmd.out.0
#SBATCH --error=/gpfs/scratch/ehpc01/bsc032056/a1tz/LOG_a1tz/a1tz_20240101_fc0_1_1_OPA_ENERGY_ONSHORE_6.cmd.err.0
['#SBATCH -t 00:29:00','#SBATCH --exclusive']

I tried as well setting

OPA:
  MARENOSTRUM5:
    OPA_CUSTOM_DIRECTIVES: ['#SBATCH -t 00:29:00','#SBATCH --exclusive']

Unsuccessfully

Steps to reproduce

Create the template using the keys provided above.

What is the current bug behavior?

I'm getting this ['#SBATCH -t 00:29:00','#SBATCH --exclusive'] in the .cmd instead of an expanded list

What is the expected correct behavior?

#SBATCH -t 00:29:00
#SBATCH --exclusive

Relevant logs and/or screenshots(if applicable)

Any other relevant information(if applicable)

Maybe it is just some dumb quote thing, but as the inspect command is very slow, it is hard to try the different combinations.

I tried as well to use the EXCLUSIVE: 'True' flag but I was getting an error

Calculating possible ready jobs for MARENOSTRUM5
^[[1m ^[[31m[CRITICAL] A not admitted configuration or error in the code has happened: object of type 'bool' has no len().

Funfact: with EXCLUSIVE: False I was not getting any error

IDK if I should add a separate issue for that. You tell me ;)

Thanks!

()

Edited Nov 19, 2024 by Francesc Roura Adserias
Assignee
Assign to
Time tracking