Corect how CUDA_VISIBLE_DEVICE env set set for gres/mps
The variable is relative to which GPUs are managed by MPS. Currently Slurm only allows one GPU to be managed by MPS at a time, so the env var should always be zero.
Please register or sign in to comment