Autosubmit generating workflow configurations for different backends
This is a follow-up to yesterday's conversation with ECMWF.
The idea is to be able to export and Autosubmit experiment configurations to other workflow systems, including higher-level representations such as PyFlow.
I have been thinking about this, and two options come to my mind:
- Direct "source to source" (or config to config) translation
- Pros: We do not risk losing information by passing through an intermediate representation
- Cons: Probably less re-usable
- Two-step conversion, passing through an intermediate representation such as CWL ?
- Pros: More modular. Both steps can be developed in parallel. We could also ask for support from the target workflow experts for the second part of the conversion.
- Cons: Complexity, may lose information if not all features are represented in the intermediate language