integrate and test carbon-tracker into the data-coupler branch
the following commits from the carbon-tracker branch should be integrated/adapted to the data-coupler branch (in this order)
- bdf0a91c add grid descriptions
- 5b3ade71 add scripts to fix and merge GFAS and SiB4v2 input files
- bb44e0dd add support for GFAS fire flux and proper management of grids
- 7208161d add scale factors for reading Carbon Tracker files
for bb44e0dd some adaptation is required. one part (CARBON_TRACKER
with REG_1X1
grid) is to add a new yaml file for the carbon-tracker, the other (CEDS
) is to rename the grid as well as the filename of the existing co2flux yaml file. Both configs also have a new fire flux, and the names of the CEDS variables also change.
The files (raw and formatted) are present in hpc2020, please copy the raw files and make sure you are able to generate similar formatted files.
/hpcperm/c3et/work/python-amip-reader/tests/data/co2 folders bio fossil fire ocean
@amozaffa I would proceed as such
-
check differences between carbon-tracker and data-coupler-nml e.g. https://earth.bsc.es/gitlab/es/python-amip-reader/-/compare/data-coupler-nml...carbon-tracker?from_project_id=975&straight=false -
modify the existing flux coupler : rename template_conf_datacoupler_co2flux.yaml to template_conf_datacoupler_co2flux_ceds.yaml, rename CO2_emis
toCEDS
grid, rename the grid file in the storage, add fire flux, rename land flux (see https://earth.bsc.es/gitlab/es/python-amip-reader/-/compare/data-coupler-nml...carbon-tracker?from_project_id=975&straight=false#b2ac96f7cc4008f0e7edfca1a351f36e655bcec6_177_177) -
add new template_conf_datacoupler_co2flux_carbon-tracker.yaml with new grid REG_1X1 (and grid file data/grid-REG_1X1.txt) and apply misc changes in data-coupler that are required -
add file conversion scripts to the repository, copy the raw files to your test data folder and test the generation of the formatted files in your test folder, then copy all files (the raw files and the converted ones) to the common data folder -
modify/convert-ece4pyreader-grids.sh
Note that original files are in /hpcperm/rujh/data/2014