Add Families?
At the moment we have hierarchy in Autosubmit. Users can control hierarchy at pre-defined levels, like chunks, start dates, members, splits.
Within each level, you can not have different levels. This feature would be useful, for instance, when you have a lot of splits or if you have multiple tasks that have a certain hierarchy. One possible solution for this issue would be to allow users to create Families in Autosubmit workflows. This is available in ecFlow and Cylc.
For example, you could have a Split job (e.g. COMPUTE_STATISTICS) that depends on other Split job (e.g. GET_DATA). If you add more dimensions, like climate variables, grid, resolutions, you may prefer to organize these dimensions within Splits with some logical abstraction, like a Family.
If we allow dependencies between families, that would probably require further planning (e.g. a Split Family is like a Split? Does it support SPLITS_TO/SPLITS_FROM?). And I would feel more confident if we worked on improving our testing coverage and the quality of our tests first. For the workflow optimizations work we spent several days testing things manually, found several bugs (some would be blockers for BSC users -- could be more complicated for external users with less visibility of what's happening), and even after doing our best, it looks like workflow devs have found issues after testing the ClimateDT workflow with this alpha/beta version.