Igor, to complement Trey's suggestion, short of implementing a job_submit.lua plugin, you can also set up a QoS to function as the default for a particular partition, and specify it in your user/partition associations. Something like:
sacctmgr add qos name=alldev flags=denyonlimit priority=5 grpcpus=4096 maxcpusperuser=2048 sacctmgr add user name=user1 account=science partition=dev qos+=alldev defaultqos=alldev qos-=normal (Order of the qos-related arguments in the second line is important.) All users with this entry will have their jobs submitted to partition dev be automatically assigned to QoS alldev. Regards, Lyn On Wed, Jun 10, 2015 at 6:57 AM, Trey Dockendorf <[email protected]> wrote: > You could set MaxCpusPerUser in a QOS then assign that QOS to an account > or individual users. So if your partition is called "high" you could > create a QOS called "high" and for the partition set AllowQOS=high in > slurm.conf. Your users would either have to specify the appropriate QOS at > submit time or you can automatically set it with a submit plugin. We use > JobSubmitPlugins=lua and job_submit.lua to set a QOS based on the partition > requested. > > - Trey > > ============================= > > Trey Dockendorf > Systems Analyst I > Texas A&M University > Academy for Advanced Telecommunications and Learning Technologies > Phone: (979)458-2396 > Email: [email protected] > Jabber: [email protected] > > On Wed, Jun 10, 2015 at 12:21 AM, Igor Chebotar < > [email protected]> wrote: > >> >> Hi Trey, >> >> Thanks for your replay. >> >> I was wondering if there is a way to force ALL the users with this limits >> on specific partition/s? Do i have now to move every user in cluster to a >> new group with the new association? is there a way to add limits to all the >> users without moving each of them to other groups? >> >> I tought that i could just add the grpcpus=100 in the slurm.conf of >> partition definition(the line with partitionname=...), but as i see there >> is no such option. >> >> Thanks, Igor. >> >> On 09/06/15 20:54, Trey Dockendorf wrote: >> The partition limits specific to a user are done via sacctmgr. One >> example (untested) would be "sacctmgr create user user1 account=account1 >> partition=part1 grpcpus=100". I would test that first as I've only used >> GrpCPUs with a QOS and not with a user association, but the docs make it >> sound like that should still work. >> >> http://slurm.schedmd.com/sacctmgr.html >> >> - Trey >> >> ============================= >> >> Trey Dockendorf >> Systems Analyst I >> Texas A&M University >> Academy for Advanced Telecommunications and Learning Technologies >> Phone: (979)458-2396 >> Email: [email protected]<mailto:[email protected]> >> Jabber: [email protected]<mailto:[email protected]> >> >> On Tue, Jun 9, 2015 at 12:22 AM, Igor Chebotar < >> [email protected]<mailto:[email protected]>> wrote: >> >> Hi, >> >> I saw that, but how do i set the the limit on partition? Do i have to use >> sacctmgr for each user to limit for GrpCPUs? or i can just edit the >> partitioname= in the slurm.conf? is there any example to see how can i >> configure it? >> >> Thanks, igor. >> >> On 08/06/15 17:44, Moe Jette wrote: >> >> >> See: >> http://slurm.schedmd.com/resource_limits.html >> >> >> Quoting Igor Chebotar <[email protected]<mailto: >> [email protected]>><mailto:[email protected]<mailto: >> [email protected]>>: >> >> >> >> Hello, >> >> I was searching for an option to configure in slurm.conf partition >> that will limit each user to use not more than specific number of >> cpu's per on partition. Is it possible? i want to configure it like >> that so there will be no situation that one user is using all >> resources in the partition. >> >> I want that my partition will not allow to user use more than N >> number of cpus per day or per partition. >> >> Thanks, Igor. >> >> >> >> >> >
