Skip to content
GitLab
Projects Groups Topics Snippets
  • /
  • Help
    • Help
    • Support
    • Community forum
    • Submit feedback
  • Sign in
  • autosubmit autosubmit
  • Project information
    • Project information
    • Activity
    • Labels
    • Members
  • Repository
    • Repository
    • Files
    • Commits
    • Branches
    • Tags
    • Contributor statistics
    • Graph
    • Compare revisions
  • Issues 338
    • Issues 338
    • List
    • Boards
    • Service Desk
    • Milestones
  • Merge requests 21
    • Merge requests 21
  • Deployments
    • Deployments
    • Releases
  • Monitor
    • Monitor
    • Incidents
  • Analytics
    • Analytics
    • Value stream
    • Repository
  • Wiki
    • Wiki
  • Snippets
    • Snippets
  • Activity
  • Graph
  • Create a new issue
  • Commits
  • Issue Boards
Collapse sidebar
  • Earth SciencesEarth Sciences
  • autosubmitautosubmit
  • Issues
  • #1226
Closed
Open
Issue created Feb 09, 2024 by dbeltran@dbeltranMaintainer

Wrapper deadlock detection and splits

Hello @bdepaula ,

I found an issue with infinite deadlock detection ( the normal deadlock works fine ) when the jobs wrapped have the split value set.

It is a design issue more than a bug

To know if a job could be wrapped or not in the future, AS fills a list of "next_wrappeable_jobs" and checks if the child is a direct one or not ( for vertical and 2-D wrappers, for horizontal ones is not necessary but it also does it ) to know which jobs need to be in READY status to add more jobs in the wrapper.

The problem is that the calculation only takes into account the chunks. So, for splits, this list could or could not be wrong. (For example, with the filter "previous" , this is not enough )

The idea is to change the algorithm to take into account other factors.

I think that max_jobs_to_submit, total_jobs, max_jobs, checking if other jobs can be submitted, and checking the list of active jobs could be enough to calculate the infinite deadlock without relying upon dependencies that, with the special filters, can be not so straightforward as in the past.

Edited Feb 09, 2024 by dbeltran
Assignee
Assign to
Time tracking