Earth Sciences

Earth Sciences Wiki

User Tools

Site Tools


data:data_directory_scheme

Data Structure

All directories and files in the repository should follow this scheme:

/esarchive/
 |
 +-> exp/
 |    |
 |    +-> scripts/
 |    |
 |    +-> ${PROJECT}/
 |    |    |
 |    |    +-> scripts/                           
 |    |    |                                      
 |    |    +-> original_files/                    
 |    |    |                                      
 |    |    +-> ensemble_mean/                     
 |    |    |    |                                  
 |    |    |    +-> monthly_mean/                  
 |    |    |    |                                  
 |    |    |    +-> scripts/                       
 |    |    |    |                                  
 |    |    |    +-> original_files/                
 |    |    |                                      
 |    |    +-> ${exp_time_scale}/
 |    |    |    |
 |    |    |    +-> scripts/
 |    |    |    |
 |    |    |    +-> ${frequency}[_mean]/
 |    |    |    |    |
 |    |    |    |    +-> ${var}[-${res}][_(f${freq}h|s0-12h)]/
 |    |    |    |         |
 |    |    |    |         +-> ${var}_${year}${month}${day}.nc
 |    |    |    |
 |    |    |    +-> ${model}[_v${version}]/
 |    |    |         |
 |    |    |         +-> ${expid}[_${extraid}]/ +
 |    |    |                                    |
 |    |    +-> ${model}[_v${version}]/          |
 |    |         |                               |
 |    |         +-> ${expid}[_${extraid}]/------|
 |    |                                         |
 |    +--> ${model}[_v${version}]/   +-----+----+
 |          |                        |
 |          +-> scripts/             |
 |          |                        |
 |          +-> constant/            |
 |          |                        v
 |          +-> ${expid}[_${extraid}]/[${domain}]/
 |               |
 |               +-> scripts/
 |               |
 |               +-> constant/
 |               |
 |               +-> original_files/
 |               |
 |               +-> docs/
 |               |
 |               +-> scripts/
 |               |
 |               +-> ${frequency}_clim/
 |               |    |
 |               |    +-> ${var}
 |               |         |
 |               |         +-> ${var}_${init_leadtime}${last_leadtime}
 |               |
 |               +-> ${frequency}_statistics/
 |               |    |
 |               |    +-> ${var}/
 |               |         |
 |               |         +-> ${var}_${year}${month}${day}.nc
 |               |
 |               +-> ${frequency}_mean/
 |               |    |
 |               |    +-> ${diagnostics}
 |               |    |                              
 |               |    +-> ${var}[-${res}][_(f${freq}h|s0-12h)]/
 |               |         |
 |               |         +-> ${var}_${year}${month}${day}.nc
 |               |         |                        
 |               |         +-> ${cmorfile} +----------------------------+   
 |               |                                                     |   
 |               +-> ${frequency}/                                     |   
 |               |    |                                                |   
 |               |    +-> multivar/                                    |
 |               |    |   +-> $expid[-r$ensmemb]_$inittime.nc          |
 |               |    |   +-> [$expid[-r$ensmemb]_$inittime_an.nc]     |
 |               |    +-> ${var}/                                      |   
 |               |    |    |                                           |   
 |               |    |    +-> ${var}_${year}${month}${day}.nc         |
 |               |    |    |                                           |
 |               |    |    +-> ${cmorfile} +----------------------------|   
 |               |    |                                                |
 |               |    +-> ensemble_mean/                               |
 |               |         +-> multivar/                               |
 |               |              +-> [${expid}_${inittime}.nc]          |
 |               |              +-> [${expid}_${inittime}_${suffix}.nc] |
 |               +-> cmorfiles/                                         |   
 |                    |                                                |   
 |                    +-> ${cmortree}/  +------------------------------+
 |                         |            v
 |                         +-> ${cmorfile}
 |
 +-> obs/
 |    |
 |    +-> scripts/
 |    |
 |    +-> ${institute}/
 |         |
 |         +-> scripts/
 |         |
 |         +-> ${dataset}[_v${version}]/
 |              |
 |              +-> scripts/
 |              |
 |              +-> docs/
 |              |
 |              +-> constant/
 |              |
 |              +-> original_files/
 |              |
 |              +-> ${frequency}[_mean]/
 |                   |
 |                   +-> ${diagnostics}/
 |                   |
 |                   +-> ${var}[-${res}][_(f${freq}h|s0-12h)]/
 |                        |
 |                        +-> ${var}_${year}${month}.nc
 |
 +-> recon/
 |    |
 |    +-> scripts/
 |    |
 |    +-> ${institute}/
 |         |
 |         +-> scripts/
 |         |
 |         +-> ${dataset}[_v${version}]/
 |              |
 |              +-> scripts/
 |              |
 |              +-> docs/
 |              |
 |              +-> constant/
 |              |
 |              +-> original_files/
 |              |
 |              +-> restart_files/
 |              |
 |              +-> ${frequency}_clim/
 |              |    |
 |              |    +-> ${var}
 |              |         |
 |              |         +-> ${var}_${init_leadtime}${last_leadtime}
 |              |
 |              +-> ${frequency}_statistics/
 |              |      |
 |              |      +-> ${var}/
 |              |          |
 |              |          +-> ${var}_${year}${month}.nc
 |              |
 |              +-> ${frequency}[_mean]/
 |                   |
 |                   +-> ${diagnostics}
 |                   |
 |                   +-> ${var}[-${res}][_(f${freq}h|s0-12h)]/
 |                        |
 |                        +-> ${cmorfile}
 |                        |
 |                        +-> ${var}_${year}${month}.nc
 |
 +-> oper/
      |
      +-> scripts/
      |
      +--> ${model}/
            |
            +-> scripts/
            |
            +-> docs/
            |
            +-> ${operid}[_${extraid}]/
                 |
                 +-> original_files/
                 |
                 +-> scripts/

Tags in the scheme

  • ${model} → Model of the experiment
  • ${institute} → Institution from which the dataset comes from
  • ${exp_time_scale} → Experiment time scale: seasonal, decadal, historical…
  • ${expid}, ${operid} → ID of the experiment, or operation
  • ${extraid} → Extra identification of an experiment (optional, in specific cases)
  • ${PROJECT} → Project where the experiment belongs
  • ${frequency} → Frequency of the data inside the file (can be monthly, daily, 6/3/1hourly, etc)
  • ${var} → Variable inside the data file
  • ${freq} → Frequency at which the ${frequency}_mean was calculated
  • ${res} → Resolution of the grid, in case of interpolation of the original file, or name of a specific location (in the case of stations disseminated on non regular grids).
  • ${cmorfile} → Data file in SPECS CMOR format
  • ${cmortree} → Data tree in SPECS CMOR format
  • ${dataset} → Dataset where the data belongs
  • ${version} → Version number of the dataset
  • ${year}, ${month}, ${day} → Year, month of the timesteps in the data file (in observations) or year, month and day of the start date (in experiments)
  • ${init_leadtime}, ${last_leadtime} → Initial and last leadtimes
  • ${diagnostics} → saltc, heatc, sections, psi, and all of the results of the current ocean diagnostics (v2.1.3)
  • ${suffix} → an (ensemble average analysis), cv (normalised ensemble std_dev =ensemble spread), inc (analysis increments = analysis minus background), oma (analysis departures = observations minus analysis), omb (background departures = observations minus background), orej (observations rejected by QC)
  • [ ] → Content between brackets is optional
  • ${domain} → The domain: ip, eu
data/data_directory_scheme.txt · Last modified: 2019/02/07 11:29 by fbeninca