Skip to content
GitLab

versions · Changes

Page history
Update versions authored by dbeltran's avatar dbeltran
Hide whitespace changes
Inline Side-by-side
versions.md
View page @ d32e1ff8
......@@ -41,38 +41,52 @@ The aim of this section is to provide useful **guidelines** about the features t
* New `updatedescrip` command to modify the experiment's description.
* Added Nord3 support.
* **3.14.0** - This latest development version for autosubmit 3 provides new functionalities, especially regarding workflow flexibility.
* **3.14.0b** - This is the latest development version and provides new functionalities especially in terms of workflow flexibility.
* Workflows have now increased **flexibility**:
* Improved **select_chunks** to be less restrictive and can be used in conjunction with other parameters.
* Added **select_members**, which adds select_chunk functionality to members.
* Added **conditional** dependencies: allowing some of the dependencies to fail (dependencies marked with the '?' char).
* Added **Exclusion**, which allows to disable the creation of a job for a given member/chunk.
* **Re-run** has been reintroduced with improvements to the job selection. Now it allows rerunning any kind of job.
* Improvements to **wrappers**:
* Added the possibility of running **different types of wrappers** under the same experiment.
* Added an **internal retrial** mechanism for vertical wrappers, bypassing the resubmission of the wrapper.
* Added an **extensible wallclock** in cases where the internal retrial mechanism is triggered.
* Added the possibility to **delay** job retrials.
* Added **X11** support.
* Homogeneous **locale (LANG)** enforced across all autosubmit iterations (wrapper, code, runtime and experiments).
* Now **proj.conf** supports dynamic variables (%_%).
* Added **security** to Autosubmit folders, having only tmp accessible for other users.
* Improved job_status **log** and new log file for failed steps.
* Autosubmit **stats** have been reworked and improved.
* Users who do not own a given experiment can now **monitor** others' experiments without making any changes to the experiment tree (except the tmp folder).
* Redesigned **Allowed/Denied** hosts: whitelist/blacklist mechanism for specific hosts and commands.
* Now Autosubmit users will receive an **e-mail notification** if there are issues with any remote platform.
* Added security and a cancel mechanism into Autosubmit **recovery** (it will detect existing active jobs).
* Added a chunk-dependant **wallclock** time.
* Added an **IO exception** recovery.
* Workflows have now increased flexibility which includes:
* There were improvements in select_chunks and added select_members.
* A new way of setting up the dependencies in the form of weak dependencies when specified in a job allows some dependencies to fail (dependencies marked with the '?' char).
* Added an Exclusion parameter that allows disabling the creation of a job for a given member/chunk.
* Reintroduced the re-run mechanism with improvements to the job selection and now it allows re-running any job.
* Workflow behaviour configuration:
* Added an extensible wall clock in cases where the internal retrial mechanism is triggered.
* Added the possibility of delaying job retrials.
* Now Proj.conf supports dynamic variables (%_%).
* We Added a chunk-dependant wallclock time.
* We standardized the meaning of task, total_jobs, and threads across all platforms and added parameter tasks to the slurm scheduler and hyperthreading for cca.
* Improvements to wrappers:
* Added the possibility of running different types of wrappers under the same experiment.
* Added an internal retrial mechanism for vertical wrappers, bypassing the resubmission of the wrapper.
* Experiment stats improvements:
* Job historical database is improved.
* Redesigned dbfix command to restore the historical job database in case of corruption.
* Now, AS can detect and recover the corruption of the historical job database in real time.
* The autosubmit stats command is more detailed.
* Homogeneous locale (LANG) enforced across all autosubmit iterations (wrapper, code, runtime and experiments).
* Project data/code management
* Depth and githooks are now supported.
* Submodules of submodules are now supported.
* Better project transfer when used in local mode.
* Security changes
* Security increased based on owner-only writing permissions for Autosubmit folders, having * only tmp accessible for other users.
* Redesigned Allowed/Denied hosts: authorized/forbidden mechanism for specific hosts and commands.
* Users who do not own a given experiment can monitor others' experiments without changing the experiment tree (except the temp folder).
* We Added security and a cancel mechanism into Autosubmit recovery (it will detect existing active jobs).
* Notifications changes:
* Now Autosubmit users will receive an e-mail notification if there are issues with any remote platform.
* Now Autosubmit users will always receive their e-mails with the proper timestamp.
* Improvements across all recovery procedures.
* New I/O recovery.
* New scheduler errors recovery.
* Log retrieval features a better recovery mechanism.
* Improved expid commands regarding the expid deletion, database storage and messages provided.
* The improved migrate command now supports bigger file sizes and an increment in the transfer speed.
* New installation methods are supported ( pip, conda )
* Docs structure and content are improved.
* Implements a set of new optimizations that address some issues regarding memory and performance.
* **4.0.0b** - This latest beta version features a complete overhaul of the configuration management alongside the porting to python 3.7 and 3.9.
* Written in Python 3.
* TODO
Further information about all these functionalities and commands can be found at the [Autosubmit documentation](https://autosubmit.readthedocs.io/en/latest/introduction.html).
\ No newline at end of file