Skip to content
GitLab

Home · Changes

Page history
Update home authored by Miguel Castrillo's avatar Miguel Castrillo
Hide whitespace changes
Inline Side-by-side
home.md
View page @ 891aaff7
......@@ -12,17 +12,15 @@ It is a Python package available at PyPI. The source code in Git contains a Dock
## Description
Autosubmit is a lightweight workflow manager designed to meet climate research necessities. Unlike other workflow solutions in the domain, it integrates the capabilities of an experiment manager, workflow orchestrator and monitor in a self-contained application. The experiment manager allows for defining and configuring experiments, supported by a hierarchical database that ensures reproducibility and traceability. The orchestrator is designed to run complex workflows in research and operational mode by managing their dependencies and interfacing with local and remote hosts. These multi-scale workflows can involve from a few to thousands of steps and from one to multiple platforms.
Autosubmit is a lightweight workflow manager designed to meet the specific needs of climate research. Unlike other workflow solutions in the domain, it integrates the capabilities of an experiment manager, workflow orchestrator and monitor in a self-contained application. The experiment manager allows for the definition and configuration of experiments, supported by a hierarchical database that ensures reproducibility and traceability. The orchestrator is designed to run complex workflows in research and operational mode by managing their dependencies and interfacing with local and remote hosts. These multi-scale workflows can involve from a few to thousands of steps and from one to multiple platforms.
Autosubmit facilitates easy and fast integration and relocation on new platforms. On the one hand, users can rapidly execute general scripts and progressively parametrize them by reading Autosubmit variables. On the other hand, it is a self-contained desktop application capable of submitting jobs to remote platforms without any external deployment.
Autosubmit facilitates easy and fast integration and relocation on new platforms. On the one hand, users can rapidly execute general scripts and progressively parametrize them by reading Autosubmit variables. Conversely, it is a self-contained desktop application capable of submitting jobs to remote platforms without external deployment.
Due to its robustness, it can handle different eventualities, such as networking or I/O errors. Finally, the monitoring capabilities extend beyond the desktop application through a REST API that allows communication with workflow monitoring tools such as the Autosubmit web GUI.
Its robustness is demonstrated by its ability to handle different eventualities, such as networking or I/O errors. Finally, the monitoring capabilities extend beyond the desktop application through a REST API that allows communication with workflow monitoring tools such as the Autosubmit web GUI.
It is a Python package available at PyPI. The source code in Git contains a Dockerfile used in cloud environments with Kubernetes, and there are examples of how to install Autosubmit with Conda.
It has contributed to various European research projects and runs different operational systems. During the following years, it will support some of the Earth Digital Twins as the Digital Twin Ocean.
Autosubmit is a Python package available at PyPI. The source code in Git contains a Dockerfile suitable for use in cloud environments with Kubernetes. Additionally, there are examples of how to install Autosubmit with Conda. It has contributed to various European research projects and runs different operational systems. Currently, it supports the Climate Adaptation Digital Twin (Climate DT) in the Destination Earth flagship initiative and the EDITO-Model Lab implementing the European Digital Twin Ocean, funded by the European Commission.
Concretely, it is currently used at Barcelona Supercomputing Centre (BSC) to run models (EC-Earth, MONARCH, NEMO, CALIOPE, HERMES...), operational toolchains (S2S4E), data-download workflows (ECMWF MARS), and many other. Autosubmit has run these workflows in different supercomputers in BSC, ECMWF, IC3, CESGA, EPCC, PDC, and OLCF.
At the Barcelona Supercomputing Centre (BSC), Autosubmit runs a variety of models (EC-Earth, MONARCH, NEMO, CALIOPE, HERMES, etc.), operational toolchains (S2S4E), data-download workflows (ECMWF MARS), and numerous other workflows on different supercomputers at BSC, ECMWF, EPCC, PDC, OLCF, CSC, Riken, DKRZ, and CESGA.
## Features
......