... | @@ -8,15 +8,11 @@ Autosubmit is currently used at Barcelona Supercomputing Centre (BSC) to run mod |
... | @@ -8,15 +8,11 @@ Autosubmit is currently used at Barcelona Supercomputing Centre (BSC) to run mod |
|
|
|
|
|
Autosubmit has been used to manage models running at supercomputers in BSC, ECMWF, IC3, CESGA, EPCC, PDC and OLCF.
|
|
Autosubmit has been used to manage models running at supercomputers in BSC, ECMWF, IC3, CESGA, EPCC, PDC and OLCF.
|
|
|
|
|
|
|
|
|
|
Autosubmit is the only existing tool that satisfies the following requirements from the weather and climate community:
|
|
Autosubmit is the only existing tool that satisfies the following requirements from the weather and climate community:
|
|
|
|
|
|
* **Automatisation**: Job submission to machines and dependencies between jobs are managed by Autosubmit. No user intervention is needed.
|
|
* **Automatisation**: Job submission to machines and dependencies between jobs are managed by Autosubmit. No user intervention is needed.
|
|
|
|
|
|
* **Data provenance**: Assigns unique identifiers for each experiment and stores information about model version, experiment configuration and computing facilities used in the whole process.
|
|
* **Data provenance**: Assigns unique identifiers for each experiment and stores information about model version, experiment configuration and computing facilities used in the whole process.
|
|
|
|
|
|
* **Failure tolerance**: Automatic retrials and ability to rerun chunks in case of corrupted or missing data.
|
|
* **Failure tolerance**: Automatic retrials and ability to rerun chunks in case of corrupted or missing data.
|
|
|
|
|
|
* **Resource management**: Autosubmit manages supercomputer particularities, allowing users to run their experiments without having to adapt their codes for that purpose. Autosubmit also allows to submit tasks from the same experiment to different platforms.
|
|
* **Resource management**: Autosubmit manages supercomputer particularities, allowing users to run their experiments without having to adapt their codes for that purpose. Autosubmit also allows to submit tasks from the same experiment to different platforms.
|
|
|
|
|
|
And some of its highlights are:
|
|
And some of its highlights are:
|
... | @@ -33,20 +29,25 @@ And some of its highlights are: |
... | @@ -33,20 +29,25 @@ And some of its highlights are: |
|
|
|
|
|
* D. Manubens-Gil, J. Vegas-Regidor, C. Prodhomme, O. Mula-Valls and F. J. Doblas-Reyes, “Seamless management of ensemble climate prediction experiments on HPC platforms,” 2016 International Conference on High Performance Computing & Simulation (HPCS), Innsbruck, 2016, pp. 895-900. doi: 10.1109/HPCSim.2016.7568429 ([PDF](https://earth.bsc.es/wiki/lib/exe/fetch.php?media=publications:dmanubens_hpcs_2016.pdf))
|
|
* D. Manubens-Gil, J. Vegas-Regidor, C. Prodhomme, O. Mula-Valls and F. J. Doblas-Reyes, “Seamless management of ensemble climate prediction experiments on HPC platforms,” 2016 International Conference on High Performance Computing & Simulation (HPCS), Innsbruck, 2016, pp. 895-900. doi: 10.1109/HPCSim.2016.7568429 ([PDF](https://earth.bsc.es/wiki/lib/exe/fetch.php?media=publications:dmanubens_hpcs_2016.pdf))
|
|
|
|
|
|
## Contact persons
|
|
## Contact
|
|
|
|
|
|
Code developed at [Barcelona Supercomputing Center](https://www.bsc.es) (BSC-CNS).
|
|
Code developed at [Barcelona Supercomputing Center](https://www.bsc.es) (BSC-CNS).
|
|
|
|
|
|
|
|
External support mail: [support-autosubmit@bsc.es](mailto:support-autosubmit@bsc.es)
|
|
|
|
|
|
Developers:
|
|
Developers:
|
|
* Daniel Beltrán Mora - daniel.beltran@bsc.es
|
|
|
|
* Wilmer Uruchi Ticona - wilmer.uruchi@bsc.es
|
|
* Daniel Beltrán Mora - [daniel.beltran@bsc.es](mailto:daniel.beltran@bsc.es)
|
|
|
|
* Wilmer Uruchi Ticona - [wilmer.uruchi@bsc.es](mailto:wilmer.uruchi@bsc.es)
|
|
|
|
|
|
Maintainer:
|
|
Maintainer:
|
|
* Daniel Beltrán Mora - daniel.beltran@bsc.es
|
|
|
|
|
|
* Daniel Beltrán Mora - [daniel.beltran@bsc.es](mailto:daniel.beltran@bsc.es)
|
|
|
|
|
|
Former Developers:
|
|
Former Developers:
|
|
|
|
|
|
* Domingo Manubens Gil
|
|
* Domingo Manubens Gil
|
|
* Javier Vegas-Regidor - javier.vegas@bsc.es
|
|
* Javier Vegas-Regidor - [javier.vegas@bsc.es](mailto:javier.vegas@bsc.es)
|
|
* Larissa Batista Leite
|
|
* Larissa Batista Leite
|
|
* Joan López
|
|
* Joan López
|
|
* Oriol Mula-Mula Valls
|
|
* Oriol Mula-Mula Valls
|
... | @@ -54,13 +55,14 @@ Former Developers: |
... | @@ -54,13 +55,14 @@ Former Developers: |
|
### Requirements
|
|
### Requirements
|
|
|
|
|
|
Autosubmit has been tested with the following Operating Systems:
|
|
Autosubmit has been tested with the following Operating Systems:
|
|
* Linux Debian
|
|
|
|
* Linux OpenSUSE
|
|
* Linux Debian
|
|
|
|
* Linux OpenSUSE
|
|
|
|
|
|
**Pre-requisites**:
|
|
**Pre-requisites**:
|
|
|
|
|
|
- These packages (bash, python2, sqlite3, git-scm > 1.8.2, subversion, dialog*) must be available at local machine.
|
|
- These packages (bash, python2, sqlite3, git-scm > 1.8.2, subversion, dialog\*) must be available at local machine.
|
|
- These packages (argparse, dateutil, pyparsing, numpy, pydotplus, matplotlib, paramiko, python2-pythondialog*, mock, portalocker) must be available for python runtime. The machine needs to be able to access HPC platforms via password-less ssh.
|
|
- These packages (argparse, dateutil, pyparsing, numpy, pydotplus, matplotlib, paramiko, python2-pythondialog\*, mock, portalocker) must be available for python runtime. The machine needs to be able to access HPC platforms via password-less ssh.
|
|
|
|
|
|
## Usage
|
|
## Usage
|
|
|
|
|
... | | ... | |