This shows you the differences between two versions of the page.
Next revision | Previous revision | ||
scalability_with_autosubmit [2016/12/12 08:15] xyepes created |
scalability_with_autosubmit [2017/07/03 09:41] (current) adegimel [Autosubmit database setup and install] |
||
---|---|---|---|
Line 1: | Line 1: | ||
=====Automate a scalability analysis with Autosubmit===== | =====Automate a scalability analysis with Autosubmit===== | ||
- | In case of having to perform a bi-dimensional scalability analysis, a lot of simulations are needed. In order to deal with this, it is possible to automate the whole analysis with the [[/ | + | In case of having to perform a bi-dimensional scalability analysis, a lot of simulations are needed. In order to deal with this, it is possible to automate the whole analysis with the [[/ |
+ | |||
+ | On the other hand, once experiments have finsihed, it is possible to gather the execution times using [[/ | ||
+ | |||
+ | Finally, since we are only interested in execution times, it is possible to remove outputs to save disk space. The [[/ | ||
+ | |||
+ | Note that all the scripts are coded to perform the average of 3 executions for each combination of MPI tasks. | ||
+ | |||
+ | All this was tested with version 3.2.0 of Autosubmit. With newer versions it could not work. For any problem or question, please contact me: xavier.yepes@bsc.es | ||
+ | |||
+ | =====Autosubmit database setup and install===== | ||
+ | |||
+ | It is recommended to perform this kind of scalability analysis using a separate database different than the one from production experiments, | ||
+ | |||
+ | To create an isolated environment and different database you have to follow next steps: | ||
+ | |||
+ | 1- Create a new directory in any place you like (e.g. your $HOME dir): | ||
+ | |||
+ | mkdir ~/ | ||
+ | |||
+ | 2- Edit .autosubmitrc file (located by default in your $HOME dir), and change DATABASE, LOCAL and CONF paths to make them point to the directory created above. You need to replace any path pointing to / | ||
+ | |||
+ | If the file is not present, you can create it and fill in with the contents below, but changing the user name with yours: | ||
+ | |||
+ | vi ~/ | ||
+ | |||
+ | [database] | ||
+ | path = / | ||
+ | filename = performance_autosubmit.db | ||
+ | |||
+ | [local] | ||
+ | path = / | ||
+ | |||
+ | [conf] | ||
+ | jobs = / | ||
+ | platforms = / | ||
+ | |||
+ | 3- Create default directory for the default configuration files that wiil be used for any new experiment of the scalability analysis: | ||
+ | |||
+ | mkdir ~/ | ||
+ | |||
+ | 4- Copy default jobs.conf and platforms.conf files from / | ||
+ | |||
+ | cp / | ||
+ | cp / | ||
+ | |||
+ | 5- Execute autosubmit install command | ||
+ | |||
+ | autosubmit install | ||
+ | |||
+ | Then it is ready to be used. | ||
+ |