Skip to content
GitLab
Projects Groups Topics Snippets
  • /
  • Help
    • Help
    • Support
    • Community forum
    • Submit feedback
  • Sign in
  • P Python Amip Reader
  • Project information
    • Project information
    • Activity
    • Labels
    • Members
  • Repository
    • Repository
    • Files
    • Commits
    • Branches
    • Tags
    • Contributor statistics
    • Graph
    • Compare revisions
  • Issues 9
    • Issues 9
    • List
    • Boards
    • Service Desk
    • Milestones
  • Merge requests 1
    • Merge requests 1
  • CI/CD
    • CI/CD
    • Pipelines
    • Jobs
    • Schedules
  • Deployments
    • Deployments
    • Environments
    • Releases
  • Packages and registries
    • Packages and registries
    • Package Registry
    • Terraform modules
  • Monitor
    • Monitor
    • Metrics
    • Incidents
  • Analytics
    • Analytics
    • Value stream
    • CI/CD
    • Repository
  • Wiki
    • Wiki
  • Snippets
    • Snippets
  • Activity
  • Graph
  • Create a new issue
  • Jobs
  • Commits
  • Issue Boards
Collapse sidebar
  • Earth SciencesEarth Sciences
  • Python Amip Reader
  • Issues
  • #8
Closed
Open
Issue created Sep 28, 2023 by Etienne Tourigny@etourignMaintainer

integrate and test carbon-tracker into the data-coupler branch

the following commits from the carbon-tracker branch should be integrated/adapted to the data-coupler branch (in this order)

  • bdf0a91c add grid descriptions
  • 5b3ade71 add scripts to fix and merge GFAS and SiB4v2 input files
  • bb44e0dd add support for GFAS fire flux and proper management of grids
  • 7208161d add scale factors for reading Carbon Tracker files

for bb44e0dd some adaptation is required. one part (CARBON_TRACKER with REG_1X1 grid) is to add a new yaml file for the carbon-tracker, the other (CEDS) is to rename the grid as well as the filename of the existing co2flux yaml file. Both configs also have a new fire flux, and the names of the CEDS variables also change.

The files (raw and formatted) are present in hpc2020, please copy the raw files and make sure you are able to generate similar formatted files.

/hpcperm/c3et/work/python-amip-reader/tests/data/co2 folders bio fossil fire ocean

@amozaffa I would proceed as such

  • check differences between carbon-tracker and data-coupler-nml e.g. https://earth.bsc.es/gitlab/es/python-amip-reader/-/compare/data-coupler-nml...carbon-tracker?from_project_id=975&straight=false
  • modify the existing flux coupler : rename template_conf_datacoupler_co2flux.yaml to template_conf_datacoupler_co2flux_ceds.yaml, rename CO2_emis to CEDS grid, rename the grid file in the storage, add fire flux, rename land flux (see https://earth.bsc.es/gitlab/es/python-amip-reader/-/compare/data-coupler-nml...carbon-tracker?from_project_id=975&straight=false#b2ac96f7cc4008f0e7edfca1a351f36e655bcec6_177_177)
  • add new template_conf_datacoupler_co2flux_carbon-tracker.yaml with new grid REG_1X1 (and grid file data/grid-REG_1X1.txt) and apply misc changes in data-coupler that are required
  • add file conversion scripts to the repository, copy the raw files to your test data folder and test the generation of the formatted files in your test folder, then copy all files (the raw files and the converted ones) to the common data folder
  • modify/convert-ece4pyreader-grids.sh

Note that original files are in /hpcperm/rujh/data/2014

Edited Oct 04, 2023 by Etienne Tourigny
Assignee
Assign to
Time tracking