[EDITO] Serialization of the Pickle in DDBB
Following the pending tasks discussed on autosubmit-api#52 and #1285, we need to make it possible to have the pickle file data available in a distributed environment.
For that, we can use our current work on Postgres to save this data in a new table. This could be easy in previous versions of Autosubmit where the pickle content consisted of a List of Lists that stored the jobs data in primitive data types. Still, since newer versions of Autosubmit this was changed to a networkx.DiGraph making it more difficult to make a correct serialization/deserialization without losing any piece of data.
Anyway, this could be done quickly and effectively with a not-so-elegant solution that is storing the pickle as a BLOB in the database. This seems to be a valid option since, in the current state of Autosubmit, we don't query directly the content of the pickle file and load it as a whole (which will be nice to change in the longer run).