This is an old revision of the document!
This wiki is being updated (June 2020). Most of their content will be moved to GitLab wiki. You can check the Useful links section below.
Autosubmit launches and monitors experiments on any platform used at Earth Sciences Department. A general description of the goal of Autosubmit, how it works, how to install on your computer, user's manual and documentation is available here.
The repository and issue tracker of Autosubmit is here
IEEE pdf D. Manubens-Gil, J. Vegas-Regidor, C. Prodhomme, O. Mula-Valls and F. J. Doblas-Reyes, “Seamless management of ensemble climate prediction experiments on HPC platforms,” 2016 International Conference on High Performance Computing & Simulation (HPCS), Innsbruck, 2016, pp. 895-900. doi: 10.1109/HPCSim.2016.7568429
A CNRM-CM6 monitoring using Autosubmit
A few members of seasonal forecast experiment using CNRM-CM6 on ECMWF IBM Power 7 has been performed using Autosubmit monitoring. A few day long collaboration at IC3 has been sufficient to adapt the existing CNRM workflow script to Autosubmit non-intrusive requirements. Nevertheless, a more comprehensive work would be necessary to fully exploit Autosubmit capabilities to monitor and control the full workflow (from compiling) on any kind of supercomputer platform.
The technical report descirbing the work is available here: http://www.cerfacs.fr/globc/publication/technicalreport/2014/autosubmit_cnrm-cm.pdf
If you need Autosubmit 3.x on a non ES machine, you can download and install it by typing
pip install autosubmit
And follow installation documentation here:
http://www.bsc.es/projects/earthscience/autosubmit/installation.html
If you need an older version (2.x) you must download it by typing:
git clone https://earth.bsc.es/gitlab/es/autosubmit.git
and then you can switch to the required tag with
git checkout tags/<tag_name>
Pre-requisties: These packages (python2, python-argparse, python-dateutil, python-pydot, python-matplotlib, sqlite3) must be available at local machine. And the machine is also able to access HPC's/Clusters via password-less ssh.
Create a repository for experiments: Say for example “/cfu/autosubmit” then edit the repository path into src/dir_config.py, src/expid.py, conf/autosubmit.conf Create a blank database: Say for example “autosubmit.db” at above created repository and thereafter:
> cd /cfu/autosubmit > sqlite3 autosubmit.db sqlite3>.read ../../src/autosubmit.sql > chmod 777 autosubmit.db
User guide: http://www.bsc.es/projects/earthscience/autosubmit/
Run Autosubmit in BSC-ES: Here
The coordinator of this project is Miguel Castrillo miguel.castrillo@bsc.es
Miguel Castrillo miguel.castrillo@bsc.es, Daniel Beltrán daniel.beltran@bsc.es, Wilmer Uruchi wilmer.uruchi@bsc.es
See the following page to check the current branching scheme used within the GIT project 'autosubmit': Git branching scheme
You can check the style guide for Autosubmit here