Skip to content
GitLab
Projects Groups Topics Snippets
  • /
  • Help
    • Help
    • Support
    • Community forum
    • Submit feedback
  • Sign in
  • startR startR
  • Project information
    • Project information
    • Activity
    • Labels
    • Members
  • Repository
    • Repository
    • Files
    • Commits
    • Branches
    • Tags
    • Contributor statistics
    • Graph
    • Compare revisions
  • Issues 29
    • Issues 29
    • List
    • Boards
    • Service Desk
    • Milestones
  • Merge requests 7
    • Merge requests 7
  • CI/CD
    • CI/CD
    • Pipelines
    • Jobs
    • Schedules
  • Deployments
    • Deployments
    • Environments
    • Releases
  • Monitor
    • Monitor
    • Incidents
  • Analytics
    • Analytics
    • Value stream
    • CI/CD
    • Repository
  • Wiki
    • Wiki
  • Snippets
    • Snippets
  • Activity
  • Graph
  • Create a new issue
  • Jobs
  • Commits
  • Issue Boards
Collapse sidebar
  • Earth SciencesEarth Sciences
  • startRstartR
  • Merge requests
  • !215

Autosubmit as workflow manager

  • Review changes

  • Download
  • Patches
  • Plain diff
Merged aho requested to merge develop-autosubmit into master Jul 27, 2023
  • Overview 4
  • Commits 33
  • Pipelines 28
  • Changes 81

#177 (closed)

This development changes several parts in Compute() and Collect(), including:

  • ByChunks() to be renamed to ByChunks_ecflow(), and ByChunks_autosubmit() is created
  • Compute() consider two cases: autosubmit or ecflow
  • Collect() becomes a wrapper of Collect_ecflow() and Collect_autosubmit()
  • inst/chunking/ to have subfolders Autosubmit and ecFlow
  • new Compute() cluster components for Autosubmit

The tested cases: https://earth.bsc.es/gitlab/aho/aho-testtest/-/blob/master/startR/autosubmit/test_autosubmit.R

  • Basic Start() call, function returns data without processing
  • Basic Start() call, function calculating WeightedMean, attributes used
  • Start() call with 2 dats, function calculating WeightedMean, attributes used
  • Start() call with transform, function calculating WeightedMean, attributes used
  • Basic Start() call, return 2 outputs with names (mean and min)

TODO:

  • Change TODO parts
  • Check resource usage (core/processor/threads)
  • Documentation
Edited Aug 31, 2023 by aho
Assignee
Assign to
Reviewers
Request review from
Time tracking
Source branch: develop-autosubmit