... | @@ -41,38 +41,52 @@ The aim of this section is to provide useful **guidelines** about the features t |
... | @@ -41,38 +41,52 @@ The aim of this section is to provide useful **guidelines** about the features t |
|
* New `updatedescrip` command to modify the experiment's description.
|
|
* New `updatedescrip` command to modify the experiment's description.
|
|
* Added Nord3 support.
|
|
* Added Nord3 support.
|
|
|
|
|
|
|
|
* **3.14.0** - This latest development version for autosubmit 3 provides new functionalities, especially regarding workflow flexibility.
|
|
|
|
|
|
* **3.14.0b** - This is the latest development version and provides new functionalities especially in terms of workflow flexibility.
|
|
* Workflows have now increased flexibility which includes:
|
|
* Workflows have now increased **flexibility**:
|
|
* There were improvements in select_chunks and added select_members.
|
|
* Improved **select_chunks** to be less restrictive and can be used in conjunction with other parameters.
|
|
* A new way of setting up the dependencies in the form of weak dependencies when specified in a job allows some dependencies to fail (dependencies marked with the '?' char).
|
|
* Added **select_members**, which adds select_chunk functionality to members.
|
|
* Added an Exclusion parameter that allows disabling the creation of a job for a given member/chunk.
|
|
* Added **conditional** dependencies: allowing some of the dependencies to fail (dependencies marked with the '?' char).
|
|
* Reintroduced the re-run mechanism with improvements to the job selection and now it allows re-running any job.
|
|
* Added **Exclusion**, which allows to disable the creation of a job for a given member/chunk.
|
|
* Workflow behaviour configuration:
|
|
* **Re-run** has been reintroduced with improvements to the job selection. Now it allows rerunning any kind of job.
|
|
* Added an extensible wall clock in cases where the internal retrial mechanism is triggered.
|
|
* Improvements to **wrappers**:
|
|
* Added the possibility of delaying job retrials.
|
|
* Added the possibility of running **different types of wrappers** under the same experiment.
|
|
* Now Proj.conf supports dynamic variables (%_%).
|
|
* Added an **internal retrial** mechanism for vertical wrappers, bypassing the resubmission of the wrapper.
|
|
* We Added a chunk-dependant wallclock time.
|
|
* Added an **extensible wallclock** in cases where the internal retrial mechanism is triggered.
|
|
* We standardized the meaning of task, total_jobs, and threads across all platforms and added parameter tasks to the slurm scheduler and hyperthreading for cca.
|
|
* Added the possibility to **delay** job retrials.
|
|
* Improvements to wrappers:
|
|
* Added **X11** support.
|
|
* Added the possibility of running different types of wrappers under the same experiment.
|
|
* Homogeneous **locale (LANG)** enforced across all autosubmit iterations (wrapper, code, runtime and experiments).
|
|
* Added an internal retrial mechanism for vertical wrappers, bypassing the resubmission of the wrapper.
|
|
* Now **proj.conf** supports dynamic variables (%_%).
|
|
* Experiment stats improvements:
|
|
* Added **security** to Autosubmit folders, having only tmp accessible for other users.
|
|
* Job historical database is improved.
|
|
* Improved job_status **log** and new log file for failed steps.
|
|
* Redesigned dbfix command to restore the historical job database in case of corruption.
|
|
* Autosubmit **stats** have been reworked and improved.
|
|
* Now, AS can detect and recover the corruption of the historical job database in real time.
|
|
* Users who do not own a given experiment can now **monitor** others' experiments without making any changes to the experiment tree (except the tmp folder).
|
|
* The autosubmit stats command is more detailed.
|
|
* Redesigned **Allowed/Denied** hosts: whitelist/blacklist mechanism for specific hosts and commands.
|
|
* Homogeneous locale (LANG) enforced across all autosubmit iterations (wrapper, code, runtime and experiments).
|
|
* Now Autosubmit users will receive an **e-mail notification** if there are issues with any remote platform.
|
|
* Project data/code management
|
|
* Added security and a cancel mechanism into Autosubmit **recovery** (it will detect existing active jobs).
|
|
* Depth and githooks are now supported.
|
|
* Added a chunk-dependant **wallclock** time.
|
|
* Submodules of submodules are now supported.
|
|
* Added an **IO exception** recovery.
|
|
* Better project transfer when used in local mode.
|
|
|
|
* Security changes
|
|
|
|
* Security increased based on owner-only writing permissions for Autosubmit folders, having * only tmp accessible for other users.
|
|
|
|
* Redesigned Allowed/Denied hosts: authorized/forbidden mechanism for specific hosts and commands.
|
|
|
|
* Users who do not own a given experiment can monitor others' experiments without changing the experiment tree (except the temp folder).
|
|
|
|
* We Added security and a cancel mechanism into Autosubmit recovery (it will detect existing active jobs).
|
|
|
|
* Notifications changes:
|
|
|
|
* Now Autosubmit users will receive an e-mail notification if there are issues with any remote platform.
|
|
|
|
* Now Autosubmit users will always receive their e-mails with the proper timestamp.
|
|
|
|
* Improvements across all recovery procedures.
|
|
|
|
* New I/O recovery.
|
|
|
|
* New scheduler errors recovery.
|
|
|
|
* Log retrieval features a better recovery mechanism.
|
|
|
|
* Improved expid commands regarding the expid deletion, database storage and messages provided.
|
|
|
|
* The improved migrate command now supports bigger file sizes and an increment in the transfer speed.
|
|
|
|
* New installation methods are supported ( pip, conda )
|
|
|
|
* Docs structure and content are improved.
|
|
|
|
* Implements a set of new optimizations that address some issues regarding memory and performance.
|
|
|
|
|
|
|
|
* **4.0.0b** - This latest beta version features a complete overhaul of the configuration management alongside the porting to python 3.7 and 3.9.
|
|
|
|
* Written in Python 3.
|
|
|
|
* TODO
|
|
|
|
|
|
Further information about all these functionalities and commands can be found at the [Autosubmit documentation](https://autosubmit.readthedocs.io/en/latest/introduction.html). |
|
Further information about all these functionalities and commands can be found at the [Autosubmit documentation](https://autosubmit.readthedocs.io/en/latest/introduction.html). |
|
|
|
\ No newline at end of file |