Skip to content
GitLab
Projects Groups Topics Snippets
  • /
  • Help
    • Help
    • Support
    • Community forum
    • Submit feedback
  • Sign in
  • autosubmit autosubmit
  • Project information
    • Project information
    • Activity
    • Labels
    • Members
  • Repository
    • Repository
    • Files
    • Commits
    • Branches
    • Tags
    • Contributor statistics
    • Graph
    • Compare revisions
  • Issues 338
    • Issues 338
    • List
    • Boards
    • Service Desk
    • Milestones
  • Merge requests 21
    • Merge requests 21
  • Deployments
    • Deployments
    • Releases
  • Monitor
    • Monitor
    • Incidents
  • Analytics
    • Analytics
    • Value stream
    • Repository
  • Wiki
    • Wiki
  • Snippets
    • Snippets
  • Activity
  • Graph
  • Create a new issue
  • Commits
  • Issue Boards
Collapse sidebar
  • Earth SciencesEarth Sciences
  • autosubmitautosubmit
  • Issues
  • #1285
Closed
Open
Issue created Apr 30, 2024 by Luiggi Tenorio Ku@ltenorioMaintainer

Postgres layer option

To deploy Autosubmit in EDITO, we will need to have the option to save to a different DBMS like Postgres.

  • This option could be available inside the .autosubmitrc file and it will persist the DDBB data inside the Postgres instance we will have in EDITO.
  • As a scope, we aim to implement a middle layer to decide which engine to use (SQLite/Postgres) keeping the same table schemas for now.
  • Update the AS code
    • autosubmit.database package, already done by @ltenorio !)
    • autosubmit.history 😱, @bdepaula will take a look if we can remove things first
    • Tests!
      • @ltenorio will check out pytest + unittest (use pytest to run existing tests) and add a conftest.py
      • Create a fixtures to overwrite the BasicConfig and prepare the DDBB for testing
      • Create temporary sqlite for each tests as needed
      • Create a Docker postgres DB for each tests as needed
      • Run sqlite tests on GitLab worker, Docker+pg locally

Tests that need to be performed (@ltenorio feel free to add more to this list):

  • Install AS from scratch
  • Create a workflow
  • Run a dummy experiment
  • Set status
  • Use wrappers
  • Archive a workflow (what's going to happen here?
  • Delete experiments #1317 (comment 284520)

@mcastril @bdepaula @dbeltran

Edited Aug 27, 2024 by Luiggi Tenorio Ku
Assignee
Assign to
Time tracking