User Tools

Site Tools


scalability_with_autosubmit

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision
Previous revision
scalability_with_autosubmit [2016/12/15 08:15]
xyepes
scalability_with_autosubmit [2017/07/03 09:41] (current)
adegimel [Autosubmit database setup and install]
Line 9: Line 9:
 Note that all the scripts are coded to perform the average of 3 executions for each combination of MPI tasks. Note that all the scripts are coded to perform the average of 3 executions for each combination of MPI tasks.
  
-It was tested with version 3.2.0 of Autosubmit. With newer versions it could not work. For any problem or question, please contact me: xavier.yepes@bsc.es+All this was tested with version 3.2.0 of Autosubmit. With newer versions it could not work. For any problem or question, please contact me: xavier.yepes@bsc.es 
 + 
 +=====Autosubmit database setup and install===== 
 + 
 +It is recommended to perform this kind of scalability analysis using a separate database different than the one from production experiments, in an isolated environment. The script creates a vast number of experiments in an automated way, so having them in the same database would be confusing for production users. 
 + 
 +To create an isolated environment and different database you have to follow next steps: 
 + 
 +1- Create a new directory in any place you like (e.g. your $HOME dir): 
 + 
 +  mkdir ~/performance_autosubmit 
 + 
 +2- Edit .autosubmitrc file (located by default in your $HOME dir), and change DATABASE, LOCAL and CONF paths to make them point to the directory created above. You need to replace any path pointing to /esnas/autosubmit by the path to the newly created directory. 
 + 
 +If the file is not present, you can create it and fill in with the contents below, but changing the user name with yours: 
 + 
 +  vi ~/.autosubmitrc 
 + 
 +  [database] 
 +  path = /home/Earth/xyepes/performance_autosubmit 
 +  filename = performance_autosubmit.db 
 +    
 +  [local] 
 +  path = /home/Earth/xyepes/performance_autosubmit 
 +    
 +  [conf] 
 +  jobs = /home/Earth/xyepes/performance_autosubmit/default 
 +  platforms = /home/Earth/xyepes/performance_autosubmit/default 
 +   
 +3- Create default directory for the default configuration files that wiil be used for any new experiment of the scalability analysis: 
 + 
 +  mkdir ~/performance_autosubmit/default 
 + 
 +4- Copy default jobs.conf and platforms.conf files from /esnas/autosubmit/default, or any other experiment you'd like, to the newly created directory: 
 + 
 +  cp /esnas/autosubmit/a0mo/conf/platforms_a0mo.conf ~/performance_autosubmit/default/platforms.conf 
 +  cp /esnas/autosubmit/a0mo/conf/jobs_a0mo.conf ~/performance_autosubmit/default/jobs.conf   
 + 
 +5- Execute autosubmit install command 
 + 
 +  autosubmit install 
 + 
 +Then it is ready to be used. 
 + 
scalability_with_autosubmit.1481789715.txt.gz · Last modified: 2016/12/15 08:15 by xyepes