1. 19 Oct, 2012 3 commits
  2. 18 Oct, 2012 9 commits
  3. 17 Oct, 2012 1 commit
  4. 16 Oct, 2012 1 commit
  5. 04 Oct, 2012 2 commits
  6. 03 Oct, 2012 2 commits
  7. 02 Oct, 2012 4 commits
    • Morris Jette's avatar
      Correct -mem-per-cpu logic for multiple threads per core · 6a103f2e
      Morris Jette authored
      See bugzilla bug 132
      
      When using select/cons_res and CR_Core_Memory, hyperthreaded nodes may be
      overcommitted on memory when CPU counts are scaled. I've tested 2.4.2 and HEAD
      (2.5.0-pre3).
      
      Conditions:
      -----------
      * SelectType=select/cons_res
      * SelectTypeParameters=CR_Core_Memory
      * Using threads
        - Ex. "NodeName=linux0 Sockets=1 CoresPerSocket=4 ThreadsPerCore=2
      RealMemory=400"
      
      Description:
      ------------
      In the cons_res plugin, _verify_node_state() in job_test.c checks if a node has
      sufficient memory for a job. However, the per-CPU memory limits appear to be
      scaled by the number of threads. This new value may exceed the available memory
      on the node. And, once a node is overcommitted on memory, future memory checks
      in _verify_node_state() will always succeed.
      
      Scenario to reproduce:
      ----------------------
      With the example node linux0, we run a single-core job with 250MB/core
          srun --mem-per-cpu=250 sleep 60
      
      cons_res checks that it will fit: ((real - alloc) >= job mem)
          ((400 - 0) >= 250) and the job starts
      
      Then, the memory requirement is doubled:
          "slurmctld: error: cons_res: node linux0 memory is overallocated (500) for
      job X"
          "slurmd: scaling CPU count by factor of 2"
      
      This job should not have started
      
      While the first job is still running, we submit a second, identical job
          srun --mem-per-cpu=250 sleep 60
      
      cons_res checks that it will fit:
          ((400 - 500) >= 250), the unsigned int wraps, the test passes, and the job
      starts
      
      This second job also should not have started
      6a103f2e
    • Morris Jette's avatar
    • Danny Auble's avatar
      one more fix · fb0269f3
      Danny Auble authored
      fb0269f3
    • Danny Auble's avatar
      4585b4c0
  8. 01 Oct, 2012 1 commit
  9. 28 Sep, 2012 1 commit
  10. 27 Sep, 2012 5 commits
  11. 25 Sep, 2012 1 commit
  12. 24 Sep, 2012 1 commit
  13. 21 Sep, 2012 1 commit
  14. 20 Sep, 2012 1 commit
  15. 19 Sep, 2012 1 commit
  16. 18 Sep, 2012 6 commits