Skip to content
GitLab
Projects Groups Topics Snippets
  • /
  • Help
    • Help
    • Support
    • Community forum
    • Submit feedback
  • Sign in
  • SUNSET SUNSET
  • Project information
    • Project information
    • Activity
    • Labels
    • Members
  • Repository
    • Repository
    • Files
    • Commits
    • Branches
    • Tags
    • Contributor statistics
    • Graph
    • Compare revisions
  • Issues 42
    • Issues 42
    • List
    • Boards
    • Service Desk
    • Milestones
  • Merge requests 12
    • Merge requests 12
  • CI/CD
    • CI/CD
    • Pipelines
    • Jobs
    • Schedules
  • Deployments
    • Deployments
    • Environments
    • Releases
  • Packages and registries
    • Packages and registries
    • Package Registry
    • Terraform modules
  • Monitor
    • Monitor
    • Incidents
  • Analytics
    • Analytics
    • Value stream
    • CI/CD
    • Repository
  • Wiki
    • Wiki
  • Snippets
    • Snippets
  • Activity
  • Graph
  • Create a new issue
  • Jobs
  • Commits
  • Issue Boards
Collapse sidebar
  • Earth SciencesEarth Sciences
  • SUNSETSUNSET
  • Issues
  • #55
Closed
Open
Issue created Jan 10, 2023 by Nadia Milders@nmildersDeveloper

Memory issue when loading data

Hi @vagudets and @aho,

I am loading the following hcst and obs data with the verification suite in my Workstation:

*         dat:   1
*         var:   1
*        sday:   1
*       sweek:   1
*       syear:  24
*        time:   6
*    latitude: 180
*   longitude: 360
*    ensemble:  25
* Total size of requested data:
*   1 x 1 x 1 x 1 x 24 x 6 x 180 x 360 x 25 x 8 bytes = 1.7 Gb
*         dat:   1
*         var:   1
*        sday:   1
*       sweek:   1
*       syear:  24
*        time:   6
*    latitude: 180
*   longitude: 360
* Total size of requested data:
*   1 x 1 x 1 x 1 x 24 x 6 x 180 x 360 x 8 bytes = 71.2 Mb

Using the command htop I see that data load takes up 50% of my WS memory, corresponding to 8Gb, four times greater than the data that I am loading.

Could there possibly be some temporal variables being loaded here which are not removed?

This issue is not currently a problem for me, since I can use Nord3 instead, but I just wanted to let you know about it.

Thanks,

Nadia

Assignee
Assign to
Time tracking