the software, OS, SLURM. etc.. I am trying to
> limit each user to only be able to use 2 out of 40 gpus across the entire
> cluster or partition. A intended bottle neck so no one can saturate the
> cluster..
>
>
>
> I.E. desired outcome would be. Person A submits 100 jobs, 2 would
User Community List
Subject: Re: [slurm-users] [EXT] Re: Limit the number of GPUS per user per
partition
External Email
Hi Thomas.
With that partition configuration, I suspect jobs are going through the
partition without the QoS 'normal' which restricts the number of GPUs per user.
You may find
NE
>
>JobDefaults=(null)
>
>DefMemPerNode=UNLIMITED MaxMemPerNode=UNLIMITED
>
>
>
> *Thomas Theis*
>
>
>
> *From:* slurm-users *On Behalf Of
> *Sean Crosby
> *Sent:* Wednesday, May 6, 2020 6:22 PM
> *To:* Slurm User Community List
> *
JobDefaults=(null)
DefMemPerNode=UNLIMITED MaxMemPerNode=UNLIMITED
Thomas Theis
From: slurm-users On Behalf Of Sean
Crosby
Sent: Wednesday, May 6, 2020 6:22 PM
To: Slurm User Community List
Subject: Re: [slurm-users] [EXT] Re: Limit the number of GPUS per user per
partition
External Email
Do
:* slurm-users *On Behalf Of
> *Sean Crosby
> *Sent:* Tuesday, May 5, 2020 6:48 PM
> *To:* Slurm User Community List
> *Subject:* Re: [slurm-users] [EXT] Re: Limit the number of GPUS per user
> per partition
>
>
>
> External Email
>
> Hi Thomas,
>
>
>
> Tha
: Re: [slurm-users] [EXT] Re: Limit the number of GPUS per user per
partition
External Email
Hi Thomas,
That value should be
sacctmgr modify qos gpujobs set MaxTRESPerUser=gres/gpu=4
Sean
--
Sean Crosby | Senior DevOpsHPC Engineer and HPC Team Lead
Research Computing Services | Business
On Tuesday, 5 May 2020 3:48:22 PM PDT Sean Crosby wrote:
> sacctmgr modify qos gpujobs set MaxTRESPerUser=gres/gpu=4
Also don't forget you need to tell Slurm to enforce QOS limits with:
AccountingStorageEnforce=safe,qos
in your Slurm configuration ("safe" is good to set, and turns on
Hi Thomas,
That value should be
sacctmgr modify qos gpujobs set MaxTRESPerUser=gres/gpu=4
Sean
--
Sean Crosby | Senior DevOpsHPC Engineer and HPC Team Lead
Research Computing Services | Business Services
The University of Melbourne, Victoria 3010 Australia
On Wed, 6 May 2020 at 04:53,
