|
|
|
## Description
|
|
|
|
## Short Description
|
|
|
|
|
|
|
|
Autosubmit is a Python-based workflow manager to create, manage and monitor complex tasks involving different substeps, such as scientific computational experiments. These workflows may involve multiple computing systems for their completion, from HPCs to post-processing clusters or workstations. Autosubmit can orchestrate all the tasks integrating the workflow by managing their dependencies, interfacing with all the platforms involved, and handling eventual errors.
|
|
|
|
|
|
|
|
-----------------------------
|
|
|
|
## Description
|
|
|
|
|
|
|
|
Autosubmit is a lightweight workflow manager designed to meet climate research necessities. Unlike other workflow solutions in the domain, it integrates the capabilities of an experiment manager, workflow orchestrator and monitor in a self-contained application. The experiment manager allows for defining and configuring experiments, supported by a hierarchical database that ensures reproducibility and traceability. The orchestrator is designed to run complex workflows in research and operational mode by managing their dependencies and interfacing with local and remote hosts. These multi-scale workflows can involve from a few to thousands of steps and from one to multiple platforms.
|
|
|
|
|
| ... | ... | @@ -16,7 +16,7 @@ It has contributed to various European research projects and runs different oper |
|
|
|
|
|
|
|
Concretely, it is currently used at Barcelona Supercomputing Centre (BSC) to run models (EC-Earth, MONARCH, NEMO, CALIOPE, HERMES...), operational toolchains (S2S4E), data-download workflows (ECMWF MARS), and many other. Autosubmit has run these workflows in different supercomputers in BSC, ECMWF, IC3, CESGA, EPCC, PDC, and OLCF.
|
|
|
|
|
|
|
|
-----------------------------
|
|
|
|
## Features
|
|
|
|
|
|
|
|
Autosubmit is the only existing tool that satisfies the following requirements from the weather and climate community:
|
|
|
|
|
| ... | ... | |
