tools

tools:atmosphere_diagnostics

Anonymous (anonymous@undisclosed.example.com) — 2015-10-19T15:08:06+00:00

Objective Set of bash and nco functions called used to format atmospheric monhtly and daily means into standards from the department (usable by s2dverfication). Description The purpose is to standardize EC-Earth atmospheric outputs to make them follow the common netcdf file conventions of the ENSEMBLE project (all members of one variable of one starting date in one file).

tools:automonarch

Anonymous (anonymous@undisclosed.example.com) — 2025-02-06T10:35:26+00:00

Training sessions This section contains details on the trainings sesions by the Auto-MONARCH team. Training sessions Title Slides Video Date Basic concepts [ Auto-MONARCH: Basic concepts slides] Auto-MONARCH: Basic concepts video January 23th 2025

tools:autosubmit

Anonymous (anonymous@undisclosed.example.com) — 2026-01-14T10:54:52+00:00

Objective Autosubmit launches and monitors experiments on any platform used at Earth Sciences Department. A general description of the goal of Autosubmit, how it works, how to install on your computer, user's manual and documentation is available here.

tools:autosubmit_extrae

Anonymous (anonymous@undisclosed.example.com) — 2018-08-31T14:55:46+00:00

How to trace using Extrae experiments on Autosubmit 1. Once you have created (or cloned) your project, go to: cd experiment_root_path/proj/auto-ecearth3/sources/runtime/autosubmit Modify ece-ifs+nemo.sh ( or ece-nemo.sh for Nemo standalone ) script to add the Extrae trace.sh call before executing the models

tools:climprojdiags

Anonymous (anonymous@undisclosed.example.com) — 2020-11-25T12:57:17+00:00

ClimProjDiags This R package was initially developed under MAGIC project. ClimProjDiags stands for Climate Projections Diagnostics, however, given the flexibility of the framework under which it was developed, the functions integrated could also be used for other forecast horizons.

tools:cstools

Anonymous (anonymous@undisclosed.example.com) — 2020-09-04T16:00:18+00:00

CSTool MEDSCOPE is developing and distributing a toolbox, CSTools, designed and built to improve the quality of climate forecasts in the Mediterranean region on seasonal to multi-annual scales, along with a number of examples of sectoral applications of relevance for the region. The improved climate prediction information will be achieved both via a better understanding of the Mediterranean climate variability and predictability and on the development of innovative methodologies to extract the …

tools:cylc

Anonymous (anonymous@undisclosed.example.com) — 2018-11-26T12:15:39+00:00

Cylc (& Rose) Cylc () is a workflow management system developed at NIWA and the UK MetOffice. It has good cycling capabilities and it provides a friendly graphical user interface client that needs to be installed in the 'suite host'. It can be configured to submit jobs to

tools:daystat

Anonymous (anonymous@undisclosed.example.com) — 2016-04-25T15:41:26+00:00

Objective This set of tools has been developped in python using a object oriented framework in order to post-process and calculate statistics on daily data (ERAint daily reanalysis, raw outpust from EC-Earth experiments, ECMWF S4). These tools allows to calculate monthly extremes and means, daily climatologies, daily anomalies, precipitation based monsoon onset date, averaged or select data over a region. The function are done to save easily the output with the proper format on the /esnas. Some…

tools:deploy

Anonymous (anonymous@undisclosed.example.com) — 2013-04-09T13:05:43+00:00

Objective The objective is to deploy automatically different versions of EC-Earth on MareNostrum using the directory structure agreed by the CFU members (instead of the one provided by default in the EC-Earth releases). To accomplish this task, a suite of scripts has been prepared and kept at the common place

tools:diagnostics

Anonymous (anonymous@undisclosed.example.com) — 2015-05-26T11:25:15+00:00

The information on this page is badly out-of-date. It describes a system that is no longer in production or has drastically changed, Please see s2dverification Description of the set of R functions As a new user, please register to this mailing list: You'll then have access to the history of all the emails sent to the users and presenting the functions and their available options.

tools:diags

Anonymous (anonymous@undisclosed.example.com) — 2015-05-26T11:33:52+00:00

Requirements This set of outputs relies on online post processing through the common_ocean_post.txt functions from the ocean_diagnostics repository. CDFTOOLS2.1 needs therefore to be called in your archdef.conf file instead of CDFTOOLS3.0. Furthermore, a replicate of /cfu/autosubmit/conf_files needs to be done in your $SCRATCH_DIR/con_files on the platform, at least for the configuration files that correspond to the configuration used in your experiment.

tools:easyncdf

Anonymous (anonymous@undisclosed.example.com) — 2020-11-26T12:04:21+00:00

easyNCDF easyNCDF is an R package containing a set of wrappers for the ncdf4 R package to simplify and extend its reading/writing capabilities into/from multi-dimensional R arrays. This package is published on CRAN since April 2017: https://CRAN.R-project.org/package=easyNCDF For more information, visit its GitLab project

tools:eigentechniques

Anonymous (anonymous@undisclosed.example.com) — 2013-04-09T13:12:18+00:00

Objective Contact javier.garcia-serrano@ic3.cat fabian.lienert@ic3.cat

tools:eionet-utdretriever

Anonymous (anonymous@undisclosed.example.com) — 2016-12-29T09:09:20+00:00

EIONET UTD (up-to-date) Air Quality data retrieval Goal This tool provides automated data collection from the EEA's Air Quality Portal. The aim is to further improve the gathering of air quality observations across Europe by using the LIVE Air Quality Data service. The purpose of this tool is also to provide a single, common tool to gather air quality observations from stations, thus phasing out the several scripts used to date -as of December 2015- (one for each Comunidad Autónoma (regional …

tools:interpolation

Anonymous (anonymous@undisclosed.example.com) — 2015-05-26T11:27:11+00:00

Objective Description interp.bash is a script encapsulating the interpolator and the preparation of its namelist. It is able to interpolate from and to 11 different horizontal grids (ORCA1t_v2.2/ORCA1t_v3.2/ORCA025t_v3.2/ERA40/ERAint/EcEarth2/EcEarth3/HadISST/NCEP/NOAAv3b/NSIDC) and with 4 different interpolation (conservative, bilinear, bicubic, distance-weighted) methods. Usually, the conservative method is used for surface fluxes or tas/tos which ensures that their global mean is conserved…

tools:lucia

Anonymous (anonymous@undisclosed.example.com) — 2017-01-16T09:09:04+00:00

LUCIA tool can be used to evaluate the load balance among components of Earth System Models which are coupled using OASIS. This tool can obtain the interpolation and communication/waiting time of each component separately. Compilation In $(OASIS_DIR)/oasis3-mct/util/lucia, compile main-lucia.F90 :

tools:miscellaneous

Anonymous (anonymous@undisclosed.example.com) — 2020-11-29T13:48:12+00:00

This page describes additional useful information for the development of the department tools. Matplotlib configuration For who uses the python matplotlib library. As the Tk library (the default backend) is not installed (and must be installed compiling again python itself), to avoid the error

tools:multiapply

Anonymous (anonymous@undisclosed.example.com) — 2020-11-26T11:59:42+00:00

multiApply This package includes the function Apply as its only function. It extends the apply function to applications in which a function needs to be applied simultaneously over multiple input arrays. Although this can be done manually with for loops and calls to the base apply function, it can often be a challenging task which can easily result in error-prone or memory-inefficient code.

tools:ocean_diagnostics_developments

Anonymous (anonymous@undisclosed.example.com) — 2015-03-26T14:38:00+00:00

This is the ocean_diagnostics developers page. Here, developers can consult and update information related to the maintenance and upgrade of the ocean_diagnostics tools, keep track and notify of errors or any ocean-diagnostics related issues. * List of

tools:ocean_diagnostics_error_archive

Anonymous (anonymous@undisclosed.example.com) — 2015-03-26T10:31:36+00:00

You can find on this page a archive of the errors and bugs found and corrected in the ocean diagnostic codes: Error details -- Correction date * ...--...

tools:ocean_diagnostics_error_log

Anonymous (anonymous@undisclosed.example.com) — 2015-03-26T10:32:03+00:00

This page contains the archive of corrected bugs and errors in the ocean diagnostics codes: Reported bug -- correction date * ... -- ...

tools:ocean_diagnostics_survey

Anonymous (anonymous@undisclosed.example.com) — 2015-03-26T10:32:18+00:00

This page is dedicated to collect the needs for new ocean diagnostics from the users. You can add any request you need. This is a open page that is meant to evolve and to gather as many comments, discussions, feedback as possible. This is also the place to share your experience about ocean_pp.bash/common_ocean_post.txt.

tools:ocean_nudging

Anonymous (anonymous@undisclosed.example.com) — 2018-04-24T11:55:01+00:00

ATTENTION OBSOLETE PAGE Preliminary step First of all, please check that the reference files for your nudged experiments are available on the platform you would like to run at the location : HSM_DIR/nudging/REFERENCE/CONFIG/fcMEMB/ where REFERENCE is the name of the ocean reanalysis you would like to nudge to (fa9p / s4 / glorys2v1 = 3 options available currently ), CONFIG is the ocean model resolution (ORCA1L42 / ORCA1L46 / ORCA025L46 / ORCA025L75) and MEMB is the member.

tools:ocean_nudging2

Anonymous (anonymous@undisclosed.example.com) — 2019-08-12T12:53:48+00:00

PAGE UNDER CONSTRUCTION. PLEASE BE PATIENT How to run a nudging experiment with EC-Earth 3.2.3 You can run experiments activating surface restoring or Newtonian Damping (3D nudging). Both features are already part of NEMO code, nevertheless with auto-ecearth there are some parameters to activate in the configuration files and some variables to take care of in the namelist. This guide is mostly thought for AUTO-ECEARTH users.

tools:ocean_postprocessing

Anonymous (anonymous@undisclosed.example.com) — 2017-02-24T09:17:06+00:00

Objective Set of bash functions called through the ocean_pp.bash script allowing the user to perform a series of diagnostics. Description The bash script ocean_pp.bash performs diagnostics on monthly or daily ocean model outputs. It relies on a set of functions included in common_ocean_post.txt that can also be used within the Ec-Earth and NEMO post templates when using autosubmit. Many of the functions included in common_ocean_post.txt have been built based on Hui Du's post-processing scrip…

tools:past_tutorials

Anonymous (anonymous@undisclosed.example.com) — 2016-09-21T09:35:45+00:00

Tutorials repository This section contains details on the past tutorials by the BSC Computational Earth Sciences group. Past sessions Title Description Type Associated files Date Autosubmit Tutorial: Getting started with Autosubmit and EC-Earth 3.2 beta

tools:perturbation_of_atmospheric_forcing

Anonymous (anonymous@undisclosed.example.com) — 2016-06-02T11:17:32+00:00

See this [PDF] file.

tools:postprocessing

Anonymous (anonymous@undisclosed.example.com) — 2015-05-26T11:18:53+00:00

Oce monthly and daily Objective The bash script ocean_pp.bash performs diagnostics on monthly or daily ocean model outputs. It relies on a set of functions included in common_ocean_post.bash that can also be used within the Ec-Earth and NEMO post templates when using autosubmit. Many of the functions included in common_ocean_post.bash have been built based on Hui Du's post-processing scripts.

tools:regression

Anonymous (anonymous@undisclosed.example.com) — 2015-05-26T11:29:45+00:00

Objective Description List of functions * regressedts.R * multipleregress.R * filteroutreg.R * PoissonReg.R * PoissonRegwTrend.R Extract a signal by linear regression over a range of lags The script named regressedts.R and stored at

tools:rtools

Anonymous (anonymous@undisclosed.example.com) — 2026-04-20T13:56:31+00:00

At BSC-ES there is a collaborative effort to share resources for data analysis in R and develop some in-houseR tools that are maintained by the R developer team. The R tools can be used for postprocessing experiments: loading data, computing prediction scores, indices or calibrate experiments as well as plotting, formating data and saving data. Furthermore, by dividing the data in chunks, you can speed your execution by using startR. You will find more information about our in-house packages fur…

tools:run_1st_exp

Anonymous (anonymous@undisclosed.example.com) — 2021-10-15T09:41:42+00:00

Running an EC-Earth experiment at BSC The idea of this documentation is to provide information for people running climate models at BSC. The goal is not to replace the autosubmit documentation, it is to provide a more local information, in particular to help new people in the climate prediction group to run EC-Earth simulations.

tools:s2dv

Anonymous (anonymous@undisclosed.example.com) — 2020-11-26T09:06:25+00:00

s2dv s2dv is the advanced version of package 's2dverification'. It is intended for 'seasonal to decadal' (s2d) climate forecast verification, but it can also be used in other kinds of forecasts or general climate analysis. This package is specially designed for the comparison between the experimental and observational datasets. The functionality of the included functions covers from data retrieval, data post-processing, skill scores against observation, to visualization. Compared to 's2dverifi…

tools:s2dverification

Anonymous (anonymous@undisclosed.example.com) — 2017-09-15T13:02:10+00:00

Objective Set of tools to assess the performance of a model through the computation of typical prediction scores against one or more observational datasets or reanalyses (a reanalysis being a physical extrapolation of observations that relies on the equations from a model, not a pure observational dataset).

tools:scrum

Anonymous (anonymous@undisclosed.example.com) — 2014-12-17T10:04:02+00:00

SCRUM Framework Artifacts Product backlog Sprint backlog list * 2012-05-14 : “EC-Earth meeting, Python wrapper, Model setup&mods” * 2012-06-21 : “Python wrapper, rerun/recover chunks, v3 starting” * 2012-08-29 : “Technical paper, v3 stories” * 2012-09-17 : “Ecaccess client, rerun improvement, technical paper

tools:smoothing

Anonymous (anonymous@undisclosed.example.com) — 2015-05-26T10:07:08+00:00

Objective This is a package containing bash and R code that produces smoother fields from original ones. This has been needed in the past to produce smoother restart fields when the ocean model couldn't cope with too strong gradients. * Applying smoothing to GLORYS ocean restart files Description

tools:startr

Anonymous (anonymous@undisclosed.example.com) — 2023-10-19T13:46:17+00:00

startR startR is an R package developed by BSC-ES to automatically fetch, transform and arrange subsets of multi-dimensional data sets (collections of files) stored in local and/or remote file systems or servers, using multicore capabilities where possible. The tool provides an interface to perceive a collection of data sets as a single large multidimensional data array, and enables the user to request for automatic retrieval, processing and arrangement of subsets of the large array. Wrapper fu…

tools:style_guides

Anonymous (anonymous@undisclosed.example.com) — 2015-05-26T11:24:02+00:00

For practices that ensure a long-term sustainable development look at this presentation: Languages * BASH * Python * R

tools:sunset_sunset

Anonymous (anonymous@undisclosed.example.com) — 2025-05-12T07:59:06+00:00

SUNSET SUbseasoNal to decadal climate forecast post-processing and asSEsmenT suite SUNSET is an R-based tool that provides climate services for sub-seasonal, seasonal and decadal climate forecast horizons. The tool post-processes climate forecast outputs by applying state-of-the-art methodologies to tailor climate products for each application and sector (e.g.: agriculture, energy, water management, or health). Its modular design allows the technicians and researchers to decide on the post-pro…

tools:tools

Anonymous (anonymous@undisclosed.example.com) — 2023-07-12T06:28:08+00:00

Tools The tools shared within ES can be downloaded from different GIT repositories, although some of them are installed on ES machines by default. When a tool is deployed on the machine, it is preferred to use the installed version because it will be always the last available stable version.

tools:transfer

Anonymous (anonymous@undisclosed.example.com) — 2013-04-09T13:08:13+00:00

Objective A script has been written by Jordi Peralta for downloading data from MareNostrum to the CFU storage. This script is located at “/cfu/pub/scripts/transfer/do_transfer.1.sh” and has the necessary steps to make sure data can be properly downloaded (identical to the original ones).

tools:tutorials

Anonymous (anonymous@undisclosed.example.com) — 2016-09-21T09:38:28+00:00

Tutorials This section contains details on the tutorials by the BSC Computational Earth Sciences group. Upcoming sessions Title Description Type Associated files Date Tutorial on Autosubmit Joint IS-ENES Workshop on Workflows and Metadata Generation