User Tools

Site Tools


tools:transfer

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

tools:transfer [2013/04/09 13:08] (current)
Line 1: Line 1:
 +
 +=== Objective ===
 +
 +
 +A script has been written by Jordi Peralta for downloading data from MareNostrum to the CFU storage. 
 +This script is located at "/cfu/pub/scripts/transfer/do_transfer.1.sh" and has the necessary steps 
 +to make sure data can be properly downloaded (identical to the original ones).
 +
 +
 +=== Use ===
 +
 +
 +Users are advised to follow these recommendations:
 +  *  It is recommended to use this script on one of "thor" and vili
 +  * You have to make sure you can use the command "ssh mn" to login to MareNostrum without password (check this with Jordi, if you can not).
 +  *  Run this script by typing the following:
 +
 +./do_transfer.1.sh <exp_id> <startdate> <data_type>
 +
 +Where data_type can be mmo (for ocean output), mma (for atmospheric output), rest (for restart files) log (for log files)
 +
 +For example: ./do_transfer.1.sh b015 1960* mma
 +
 +This will download all the atmosphere data for the starting dates 1960* of "b015"
 +
 +
 +=== Tips ===
 +
 +
 +  * Do not run this script in background mode, It might NOT work well or even does not work at all.
 +  * To copy a whole experiment, you can use a loop like the following, this will copy all the data from one experiment.
 +
 +EXPID=b014
 +
 +YEAR_LST="19601101 19651101 19701101"
 +
 +SCRIPT_DIR=/home/huidu/scripts
 +
 +for year in $YEAR_LST; do
 +
 +<code> for type in mma mmo rest log; do
 +</code>
 +<code>   ${SCRIPT_DIR}/do_transfer.sh ${EXPID} ${year} ${type}
 +</code>
 +<code> done
 +</code>
 +done #loop for starting dates
 +
 +
 +=== Contact ===
 +
 +
 +muhammad.asif@ic3.cat
  
tools/transfer.txt ยท Last modified: 2013/04/09 13:08 (external edit)