... | @@ -13,3 +13,59 @@ High level description of the architecture of the C3SDatachecker(work in progres |
... | @@ -13,3 +13,59 @@ High level description of the architecture of the C3SDatachecker(work in progres |
|
|
|
|
|
### [user_guide](dqc_user_guide)
|
|
### [user_guide](dqc_user_guide)
|
|
how to run the checker, outputs generated (work in progress)
|
|
how to run the checker, outputs generated (work in progress)
|
|
|
|
|
|
|
|
**Setup development environment**
|
|
|
|
|
|
|
|
Request access the to the VM machines as first step
|
|
|
|
|
|
|
|
.bashrc
|
|
|
|
|
|
|
|
in order to run conda, you should execute the following line
|
|
|
|
|
|
|
|
`export PATH="/data/miniconda3/bin:$PATH"`
|
|
|
|
|
|
|
|
and add to your .bashrc file the following lines:
|
|
|
|
|
|
|
|
```bash
|
|
|
|
# >>> conda initialize >>>
|
|
|
|
# !! Contents within this block are managed by 'conda init' !!
|
|
|
|
__conda_setup="$('/shared/earth/software/Miniconda3/4.7.12-foss-2015a/bin/conda' 'shell.bash' 'hook' 2> /dev/null)"
|
|
|
|
if [ $? -eq 0 ]; then
|
|
|
|
eval "$__conda_setup"
|
|
|
|
else
|
|
|
|
if [ -f "/shared/earth/software/Miniconda3/4.7.12-foss-2015a/etc/profile.d/conda.sh" ]; then
|
|
|
|
. "/shared/earth/software/Miniconda3/4.7.12-foss-2015a/etc/profile.d/conda.sh"
|
|
|
|
else
|
|
|
|
export PATH="/shared/earth/software/Miniconda3/4.7.12-foss-2015a/bin:$PATH"
|
|
|
|
fi
|
|
|
|
fi
|
|
|
|
unset __conda_setup
|
|
|
|
# <<< conda initialize <<<
|
|
|
|
```
|
|
|
|
**Folders in the VM**
|
|
|
|
|
|
|
|
there are two main partitions, `/data` and `/shared` some of the most important directories to know about are the following:
|
|
|
|
|
|
|
|
```
|
|
|
|
- checker running scripts
|
|
|
|
/shared/QAR_dqc/bin
|
|
|
|
|
|
|
|
- location for downloading of data
|
|
|
|
/shared/cds_downloads/
|
|
|
|
|
|
|
|
- Log files of the ongoing downloads
|
|
|
|
/shared/cds_downloads/logs/
|
|
|
|
|
|
|
|
- location for the results of the checks (QARs)
|
|
|
|
/shared/QAR_dqc/results
|
|
|
|
|
|
|
|
- location for results after the process of renaming
|
|
|
|
/shared/QAR_dqc/results_cms
|
|
|
|
|
|
|
|
- current checker installations
|
|
|
|
/data/joan/c3s512-wp1-datachecker
|
|
|
|
/shared/software/c3s512-wp1-datachecker
|
|
|
|
```
|
|
|
|
|
|
|
|
Current checker installations points/use these folders
|
|
|
|
|