User Tools

Site Tools


tools:tools

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision
Previous revision
Last revision Both sides next revision
tools:tools [2017/02/24 11:48]
jvegas
tools:tools [2021/10/20 07:16]
pbretonn
Line 3: Line 3:
 The tools shared within ES can be downloaded from different GIT repositories, although some of them are installed on ES machines by default. When a tool is deployed on the machine, it is preferred to use the installed version because it will be always the last available stable version. The tools shared within ES can be downloaded from different GIT repositories, although some of them are installed on ES machines by default. When a tool is deployed on the machine, it is preferred to use the installed version because it will be always the last available stable version.
  
-To run experiments you can use [[tools:Autosubmit]] in combination with the [[https://earth.bsc.es/gitlab/es|auto-models repositories]].+To run experiments you can use [[tools:Autosubmit]] in combination with the [[https://earth.bsc.es/gitlab/es|auto-models repositories]]. For instance, [[https://earth.bsc.es/wiki/doku.php?id=models:ec-earth:ec-earth:auto-ec-earth|Auto-EC-Earth]] is used to launch EC-Earth experiments with Autosubmit.
  
 The climate experiments can be postprocessed by using: The climate experiments can be postprocessed by using:
 +  * [[https://esmvaltool.readthedocs.io/en/latest/|ESMValTool]]
 +  * [[https://earthdiagnostics.readthedocs.io/en/latest/index.html|Earth Diagnostics]]
 +  
  
-  * [[tools:ocean_postprocessing|Ocean postprocessing]] +The links above are pointing to both tool's general documentation. To learn more about how to run them in BSC please refer to these GitLab projects:
-  * [[tools:atmosphere_diagnostics|Atmosphere diagnostics]]  +
-  * [[tools:daystat|daystat]] +
  
-Prediction scores can be computed by using:+  * [[https://earth.bsc.es/gitlab/es/earthdiags_suite/wikis/home|EarthDiagnostics' ecFlow suite]] 
 +  * [[https://earth.bsc.es/gitlab/es/es-esmvaltool/tree/master|ES-ESMValTool]]
  
-  * [[:tools:s2dverification|s2dverification]]+The R tools can be used for postprocessing experiments: loading data, computing prediction scores, indices or calibrate experiments as well as plotting, formating data and saving data. Furthermore, by dividing the data in chunks, you can speed your execution by using startR. You can join the [[https://gateway.bsc.es/mailman/listinfo/,DanaInfo=mailman.bsc.es,SSL+earth-rtools&s[]list|Earth RTools mailing list]] to receive the latest updates about news. Please, follow the links to learn more about:
  
-And many other tools can be found under:+  * [[https://earth.bsc.es/wiki/doku.php?id=tools:Rtools&s[]=Rtools|Department R tools]] 
 +  * [[https://earth.bsc.es/wiki/doku.php?id=tools:startR&s[]=startR|startR]] 
 +  * [[https://earth.bsc.es/wiki/doku.php?id=tools:CSTools&s[]=CSTools|CSTools]] 
 +  * [[https://earth.bsc.es/wiki/doku.php?id=tools:ClimProjDiags&s[]=ClimProjDiags|ClimProjDiags]] 
 +  * [[https://earth.bsc.es/wiki/doku.php?id=tools:s2dv&s[]=s2dv|s2dv]] 
 +  * [[https://earth.bsc.es/wiki/doku.php?id=tools:multiApply&s[]=multiApply|multiApply]] 
 +  * [[https://earth.bsc.es/wiki/doku.php?id=tools:easyNCDF&s[]=easyNCDF|easyNCDF]] 
 +  * [[https://earth.bsc.es/wiki/doku.php?id=tools:s2dverification&s[]=s2dverification|s2dverification]] //[deprecated 04/09/2020]//
  
-  * [[https://earth.bsc.es/gitlab/es/cpg_tools.git|CPG tools]] 
  
-More details can be found in the wikis for each project 
  
-[[:tools:autosubmit|Autosubmit]] +And many other tools can be found under:
  
-Autosubmit launches and monitors experiments on any [[https://earth.bsc.es/wiki/doku.php?id=models:ec-earth:ec-earth#platforms|Platforms]] used at Earth Sciences Department. +  * [[https://earth.bsc.es/gitlab/es/cpg_tools.git|CPG tools]]
-A general description, what is the goal of Autosubmit, how it works, user's manual and documentation is available here.+
  
  
-[[:tools:ocean_postprocessing|Ocean postprocessing]]+Older experiments have been postprocessed using the following now deprecated tools:
  
 +  * [[https://earth.bsc.es/gitlab/es/ocean_diagnostics/wikis/home|Ocean postprocessing]]
 +  * [[https://earth.bsc.es/gitlab/es/atmosphere_diagnostics/wikis/home|Atmosphere diagnostics]] 
  
-Set of bash functions called through the ocean_pp.bash script allowing the user to perform a series of diagnostics.+A quick presentation about how to use these old oceanic and atmospheric post processing tools can also be found here: {{file:tools_meeting_presentation.pdf}}. More details can be found in the wikis for each project
  
-A quick presentation about how to use ocean and atmospheric post processing tools has been given, the slides are available here {{file:tools_meeting_presentation.pdf}}+[[:tools:autosubmit|Autosubmit]] 
  
-[[tools:atmosphere_diagnostics|Atmosphere diagnostics]]  +Autosubmit launches and monitors experiments on any [[https://earth.bsc.es/wiki/doku.php?id=models:ec-earth:ec-earth#platforms|Platforms]] used at Earth Sciences Department. 
- +A general description, what is the goal of Autosubmit, how it works, user's manual and documentation is available here.
- +
-Set of bash and nco functions called used to format atmospheric monthly and daily means into standards from ENSEMBLE project.  +
- +
-A quick presentation about how to use ocean and atmospheric post processing tools can also be fin here: {{file:tools_meeting_presentation.pdf}} +
- +
- +
-[[tools:s2dverification|s2dverification]]  +
- +
- +
-Seasonal To Decadal (Climate) Verification. Set of tools to assess the performance of a model through the computation of typical prediction scores against one or more observational datasets or reanalyses (a reanalysis being a physical extrapolation of observations that relies on the equations from a model, not a pure observational dataset).  +
- +
-[[tools:daystat|daystat]] +
- +
-This set of tools has been developped in python using a object oriented framework in order to post-process and calculate statistics on daily data (ERAint daily reanalysis, raw outpust from EC-Earth experiments, ECMWF S4)These tools allows to calculate monthly extremes and means, daily climatologies, daily anomalies, precipitation based monsoon onset date, averaged or select data over a regionThe function are done to save easily the output with the proper format on the /esnasSome functions are also available for plotting. Most of the statistics are based on cdo. +
-  +
-[[tools:eigentechniques|Eigentechniques]]  +
- +
-NB: the git branch "NAO_example" of cfutools includes a script example_NAO.R that computes and plot the NAO index with different methods: Surface Pressure Level difference between two regions and EOF projections. +
- +
-[[tools:smoothing|Smoothing]]  +
- +
-This is a package containing bash and R code that produces smoother fields from original ones. This has been needed in the past to produce smoother restart fields when the ocean model couldn't cope with too strong gradients+
  
  
Line 69: Line 55:
  
 [[tools:miscellaneous|Miscellaneous]]  [[tools:miscellaneous|Miscellaneous]] 
- 
-[[tools:regression|Regression]] 
- 
-[[tools:interpolation|Interpolation]]  
- 
- 
-[[tools:tutorials|Tutorials]]  
- 
-[[tools:past_tutorials|Past Tutorials]]  
- 
  
 ====Repository coordinators==== ====Repository coordinators====
 Every tool has it's source code in a git repository in the ES [[:library:git_lab|GitLab]]. Here you can find the [[:library:git|list of coordinators]] for every project. Every tool has it's source code in a git repository in the ES [[:library:git_lab|GitLab]]. Here you can find the [[:library:git|list of coordinators]] for every project.
tools/tools.txt · Last modified: 2023/07/12 06:28 by nperez