User Tools

Site Tools

Trace:
tools:autosubmit

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision 		Previous revision
tools:autosubmit [2020/08/18 16:05]
mcastril 		tools:autosubmit [2023/08/24 16:25] (current)
pgoitia
Line 1: Line 1:
- 
- 
- 
-__This wiki is being updated (June 2020). Most of their content will be moved to GitLab wiki. You can check the Useful links section below.  
-__ 
- 
 ==== Objective ==== ==== Objective ====
  
Line 12: Line 6:
 ==== Repository ==== ==== Repository ====
  
-The repository and issue tracker of Autosubmit is here+The repository and issue tracker of Autosubmit (and the API and the GUI) is here
  
-  * [[https://earth.bsc.es/gitlab/es/autosubmit.git]]+  * [[https://earth.bsc.es/gitlab/es/autosubmit.git|Autosubmit GitLab]] 
 +  * [[https://earth.bsc.es/gitlab/es/autosubmit_api|Autosubmit API GitLab]] 
 +  * [[https://earth.bsc.es/gitlab/es/autosubmitreact|Autosubmit GUI GitLab]] 
 + 
 +=== Using Autosubmit at the Earth Sciences department === 
 + 
 +  * [[https://earth.bsc.es/gitlab/es/autosubmit/-/wikis/Running-Autosubmit-in-Earth-Sciences|Instructions in Autosubmit wiki]]
  
 === Useful links === === Useful links ===
 +  * [[https://earth.bsc.es/gitlab/es/autosubmit/-/wikis/home|Autosubmit GitLab wiki]]
 +  * [[https://autosubmit.readthedocs.io/en/master/introduction/index.html|Autosubmit Documentation]] 
 +  * [[https://earth.bsc.es/wiki/doku.php?id=tools:autosubmit:tutorials|Autosubmit Tutorials]]
 +  * [[https://autosubmitgui.bsc.es/presentation|Autosubmit App (GUI)]] (public demo)
 +  * [[http://bscesweb04.bsc.es/autosubmitapp/|Autosubmit App (GUI)]] (only accessible from inside BSC network)
 +  * [[http://bscesautosubmit01.bsc.es:8000/autosubmit_v3|List of experiments v3]] (LEGACY, only accessible from inside BSC network)
  
-  * [[https://autosubmit.readthedocs.io/en/latest/introduction.html|Autosubmit Documentation]]  
-  * [[http://bscesweb04.bsc.es/autosubmitapp/|Autosubmit App (GUI)]] (only accessible form inside BSC network) 
-  * [[http://bscesautosubmit01.bsc.es:8000/autosubmit_v3|List of experiments v3]] (only accessible form inside BSC network) 
  
  
Line 26: Line 29:
  
 [[http://ieeexplore.ieee.org/document/7568429/|IEEE]] {{:publications:dmanubens_hpcs_2016.pdf|pdf}} D. Manubens-Gil, J. Vegas-Regidor, C. Prodhomme, O. Mula-Valls and F. J.  Doblas-Reyes, "Seamless management of ensemble climate prediction  experiments on HPC platforms," 2016 International Conference on High Performance Computing & Simulation (HPCS), Innsbruck, 2016, pp. 895-900. [[http://ieeexplore.ieee.org/document/7568429/|IEEE]] {{:publications:dmanubens_hpcs_2016.pdf|pdf}} D. Manubens-Gil, J. Vegas-Regidor, C. Prodhomme, O. Mula-Valls and F. J.  Doblas-Reyes, "Seamless management of ensemble climate prediction  experiments on HPC platforms," 2016 International Conference on High Performance Computing & Simulation (HPCS), Innsbruck, 2016, pp. 895-900.
-doi: 10.1109/HPCSim.2016.7568429 +https://doi.org/10.1109/HPCSim.2016.7568429
- +
-=== Technical Description === +
- +
- +
-== IS-ENES 2 == +
- +
- +
-**A CNRM-CM6 monitoring using Autosubmit** +
- +
- +
-A few members of seasonal forecast experiment using CNRM-CM6 on ECMWF IBM Power 7 has been performed using Autosubmit monitoring. A few day long collaboration at IC3 has been sufficient to adapt the existing CNRM workflow script to Autosubmit non-intrusive requirements. Nevertheless, a more comprehensive work would be necessary to fully exploit Autosubmit capabilities to monitor and control the full workflow (from compiling) on any kind of supercomputer platform. +
- +
-The technical report descirbing the work is available here: http://www.cerfacs.fr/globc/publication/technicalreport/2014/autosubmit_cnrm-cm.pdf +
- +
- +
-==== Requirements ==== +
- +
-=== How to deploy/setup Autosubmit (v3) === +
- +
-If you need Autosubmit 3.x on a non ES machine, you can download and install it by typing +
- +
-<code>pip install autosubmit</code> +
- +
-And follow installation documentation here: +
- +
-[[http://www.bsc.es/projects/earthscience/autosubmit/installation.html]] +
- +
-=== How to deploy/setup Autosubmit (v2) === +
- +
-If you need an older version (2.x) you must download it by typing: +
- +
-<code>git clone https://earth.bsc.es/gitlab/es/autosubmit.git</code> +
- +
-and then you can switch to the required tag with +
- +
-<code>git checkout tags/<tag_name></code> +
- +
-Pre-requisties: These packages (python2, python-argparse, python-dateutil, python-pydot, python-matplotlib, sqlite3) must be available at local machine. And the machine is also able to access HPC's/Clusters via password-less ssh. +
- +
-Create a repository for experiments: Say for example "/cfu/autosubmit" then edit the repository path into src/dir_config.py, src/expid.py, conf/autosubmit.conf +
-Create a blank database: Say for example "autosubmit.db" at above created repository and thereafter: +
-  > cd /cfu/autosubmit +
-  > sqlite3 autosubmit.db +
-  sqlite3>.read ../../src/autosubmit.sql +
-  > chmod 777 autosubmit.db +
- +
- +
-==== Use ==== +
- +
-User guide: [[http://www.bsc.es/projects/earthscience/autosubmit/]] +
- +
-  *  Autosubmit 3.0+ [[https://readthedocs.org/projects/autosubmit|documentation]] +
- +
-Run Autosubmit in BSC-ES: [[tools:autosubmit:bsces|Here]] +
-  +
- +
-==== Tutorials ==== +
- +
-[[tools:autosubmit:tutorials|Tutorials]]  +
- +
-[[tools:autosubmit:past_tutorials|Past Tutorials]]  +
- +
- +
-==== Presentations ==== +
-  *  Call for Autosubmit users - May 2016 {{:tools:call_for_autosubmit_users_26_05_.pdf|}} --- //[[domingo.manubens@bsc.es|DOMINGO MANUBENS]] 2016/05/26 12:27// +
-  * Autosubmit 3.0.0 CFU presentation {{file:as300.pdf}} --Dmanubens (talk) 18:28, 3 December 2014 (CET) +
-  * Autosubmit 3.0.0 training {{file:as3_training.pdf}} --Dmanubens (talk) 18:32, 3 December 2014 (CET) +
-  * Autosubmit 2.4.1 CFU presentation {{file:as241.pdf}} --Dmanubens (talk) 17:27, 4 July 2014 (CEST) +
-  * Autosubmit and GIT: new projects {{file:asand_git.pdf}} +
-  * Autosubmit 2.3 and GIT {{file:as23and_git.pdf}}  +
-  * Assesment report on Autosubmit, Cylc and ecFlow - {{:tools:is-enes2_d93_v1.0_mp.pdf|}} +
  
 +==== How to cite the Autosubmit Graphical Interface ====
  
 +[[https://joss.theoj.org/papers/10.21105/joss.03049#|JOSS]] Uruchi et al., (2021). Autosubmit GUI: A Javascript-based Graphical User Interface to Monitor Experiments Workflow Execution. Journal of Open Source Software, 6(59), 3049, https://doi.org/10.21105/joss.03049
 ==== Contact ==== ==== Contact ====
  
Line 106: Line 39:
 The coordinator of this project is Miguel Castrillo <miguel.castrillo@bsc.es> The coordinator of this project is Miguel Castrillo <miguel.castrillo@bsc.es>
  
-Miguel Castrillo <miguel.castrillo@bsc.es>, Daniel Beltrán <daniel.beltran@bsc.es>, Wilmer Uruchi <wilmer.uruchi@bsc.es> +Daniel Beltrán <daniel.beltran@bsc.es>, Miguel Castrillo <miguel.castrillo@bsc.es> 
- +
- +
- +
-==== Development ==== +
- +
- +
- +
-=== SCRUM Framework === +
- +
-  * [[https://trello.com/b/0la8i6Fg/autosubmit]] +
- +
-Old version +
- +
-  *  [[tools:scrum|SCRUM Framework]] +
- +
- +
-=== GIT branching scheme ===+
  
-See the following page to check the current branching scheme used within the GIT project 'autosubmit': [[library:git#git_branching_scheme|Git branching scheme]] 
  
  
-==== Style Guide ==== 
  
-You can check the style guide for Autosubmit [[tools:style_guides:python|here]] 
  
tools/autosubmit.1597766715.txt.gz · Last modified: 2020/08/18 16:05 by mcastril

Page Tools

Donate Powered by PHP Valid HTML5 Valid CSS Driven by DokuWiki