Earth Sciences

Earth Sciences Wiki

User Tools

Site Tools


tools:transfer

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

tools:transfer [2013/04/09 15:08] (current)
Line 1: Line 1:
 +
 +=== Objective ===
 +
 +
 +A script has been written by Jordi Peralta for downloading data from MareNostrum to the CFU storage. ​
 +This script is located at "/​cfu/​pub/​scripts/​transfer/​do_transfer.1.sh"​ and has the necessary steps 
 +to make sure data can be properly downloaded (identical to the original ones).
 +
 +
 +=== Use ===
 +
 +
 +Users are advised to follow these recommendations:​
 +  *  It is recommended to use this script on one of "​thor"​ and vili
 +  * You have to make sure you can use the command "ssh mn" to login to MareNostrum without password (check this with Jordi, if you can not).
 +  *  Run this script by typing the following:
 +
 +./​do_transfer.1.sh <​exp_id>​ <​startdate>​ <​data_type>​
 +
 +Where data_type can be mmo (for ocean output), mma (for atmospheric output), rest (for restart files) log (for log files)
 +
 +For example: ./​do_transfer.1.sh b015 1960* mma
 +
 +This will download all the atmosphere data for the starting dates 1960* of "​b015"​
 +
 +
 +=== Tips ===
 +
 +
 +  * Do not run this script in background mode, It might NOT work well or even does not work at all.
 +  * To copy a whole experiment, you can use a loop like the following, this will copy all the data from one experiment.
 +
 +EXPID=b014
 +
 +YEAR_LST="​19601101 19651101 19701101"​
 +
 +SCRIPT_DIR=/​home/​huidu/​scripts
 +
 +for year in $YEAR_LST; do
 +
 +<​code>​ for type in mma mmo rest log; do
 +</​code>​
 +<​code> ​  ​${SCRIPT_DIR}/​do_transfer.sh ${EXPID} ${year} ${type}
 +</​code>​
 +<​code>​ done
 +</​code>​
 +done #loop for starting dates
 +
 +
 +=== Contact ===
 +
 +
 +muhammad.asif@ic3.cat
  
tools/transfer.txt ยท Last modified: 2013/04/09 15:08 (external edit)