Re: [slurm-users] Job limit in slurm.

[Ole Holm Nielsen]

Hi Navin,

Since you are new to Slurm, you may perhaps find my Slurm Wiki pages useful:
https://wiki.fysik.dtu.dk/niflheim/SLURM

These pages assume CentOS 7 Linux, but much of the information should be 
valid for other Linux variants as well.


/Ole

On 2/17/20 1:55 PM, navin srivastava wrote:

Hi ole,

Thanks Ole.
After setting the Enforce it worked.
I am new to slurm to thanks for helping me.


Regards
Navin


On Mon, Feb 17, 2020 at 5:36 PM Ole Holm Nielsen 
mailto:ole.h.niel...@fysik.dtu.dk>> wrote:


Hi Navin,

I wonder if you have configured the Slurm database and the slurmdbd
daemon?  I think the limit enforcement requires the use of the database.

What is the output of:

$ scontrol show config | grep AccountingStorageEnforce

See also https://slurm.schedmd.com/accounting.html#limit-enforcement

Limit Enforcement

Various limits and limit enforcement are described in the Resource Limits
web page.

To enable any limit enforcement you must at least have
AccountingStorageEnforce=limits in your slurm.conf, otherwise, even if
you
have limits set, they will not be enforced. Other options for
AccountingStorageEnforce and the explanation for each are found on the
Resource Limits document.

/Ole

On 2/17/20 12:20 PM, navin srivastava wrote:
 > Hi ole,
 >
 > i am submitting 100 of jobs are i see all jobs starting at the same
time
 > and all job is going into the run state.
 > if Maxjobs limit is set it should allow only 3 jobs at any point of
time.
 >
 > Regards
 > Navin.
 >
 >
 >
 >
 > On Mon, Feb 17, 2020 at 4:48 PM Ole Holm Nielsen
 > mailto:ole.h.niel...@fysik.dtu.dk>
>> wrote:
 >
 >     Hi Navin,
 >
 >     Why do you think the limit is not working?  The MaxJobs limits
the number
 >     of running jobs to 3, but you can still submit as many jobs as
you like!
 >
 >     See "man sacctmgr" for definitions of the limits MaxJobs as well as
 >     MaxSubmitJobs.
 >
 >     /Ole
 >
 >     On 2/17/20 12:04 PM, navin srivastava wrote:
 >      > Hi,
 >      >
 >      > Thanks for your script.
 >      > with this i am able to show the limit what i set. but this
limt is
 >      > not working.
 >      >
 >      > MaxJobs =        3, current value = 0
 >      >
 >      > Regards
 >      > Navin.
 >      >
 >      > On Mon, Feb 17, 2020 at 4:13 PM Ole Holm Nielsen
 >      > mailto:ole.h.niel...@fysik.dtu.dk> >
 >     
 >           >
 >      >     On 2/17/20 11:16 AM, navin srivastava wrote:
 >      >      > i have an issue with the slurm job limit. i applied
the Maxjobs
 >      >     limit on
 >      >      > user using
 >      >      >
 >      >      >   sacctmgr modify user navin1 set maxjobs=3
 >      >      >
 >      >      > but still i see this is not getting applied. i am
still bale
 >     to submit
 >      >      > more jobs.
 >      >      > Slurm version is 17.11.x
 >      >      >
 >      >      > Let me know what setting is required to implement this.
 >      >
 >      >     The tool "showuserlimits" tells you all user limits in
the Slurm
 >      >     database.
 >      >        You can download it from
 >      >
 >
https://github.com/OleHolmNielsen/Slurm_tools/tree/master/showuserlimits
 >      >     and give it a try:
 >      >
 >      >     $ showuserlimits -u navin1
 >

Re: [slurm-users] Job limit in slurm.

[navin srivastava]

Hi ole,

Thanks Ole.
After setting the Enforce it worked.
I am new to slurm to thanks for helping me.


Regards
Navin


On Mon, Feb 17, 2020 at 5:36 PM Ole Holm Nielsen 
wrote:

> Hi Navin,
>
> I wonder if you have configured the Slurm database and the slurmdbd
> daemon?  I think the limit enforcement requires the use of the database.
>
> What is the output of:
>
> $ scontrol show config | grep AccountingStorageEnforce
>
> See also https://slurm.schedmd.com/accounting.html#limit-enforcement
>
> Limit Enforcement
>
> Various limits and limit enforcement are described in the Resource Limits
> web page.
>
> To enable any limit enforcement you must at least have
> AccountingStorageEnforce=limits in your slurm.conf, otherwise, even if you
> have limits set, they will not be enforced. Other options for
> AccountingStorageEnforce and the explanation for each are found on the
> Resource Limits document.
>
> /Ole
>
> On 2/17/20 12:20 PM, navin srivastava wrote:
> > Hi ole,
> >
> > i am submitting 100 of jobs are i see all jobs starting at the same time
> > and all job is going into the run state.
> > if Maxjobs limit is set it should allow only 3 jobs at any point of time.
> >
> > Regards
> > Navin.
> >
> >
> >
> >
> > On Mon, Feb 17, 2020 at 4:48 PM Ole Holm Nielsen
> > mailto:ole.h.niel...@fysik.dtu.dk>> wrote:
> >
> > Hi Navin,
> >
> > Why do you think the limit is not working?  The MaxJobs limits the
> number
> > of running jobs to 3, but you can still submit as many jobs as you
> like!
> >
> > See "man sacctmgr" for definitions of the limits MaxJobs as well as
> > MaxSubmitJobs.
> >
> > /Ole
> >
> > On 2/17/20 12:04 PM, navin srivastava wrote:
> >  > Hi,
> >  >
> >  > Thanks for your script.
> >  > with this i am able to show the limit what i set. but this limt is
> >  > not working.
> >  >
> >  > MaxJobs =3, current value = 0
> >  >
> >  > Regards
> >  > Navin.
> >  >
> >  > On Mon, Feb 17, 2020 at 4:13 PM Ole Holm Nielsen
> >  > mailto:ole.h.niel...@fysik.dtu.dk>
> >  > >> wrote:
> >  >
> >  > On 2/17/20 11:16 AM, navin srivastava wrote:
> >  >  > i have an issue with the slurm job limit. i applied the
> Maxjobs
> >  > limit on
> >  >  > user using
> >  >  >
> >  >  >   sacctmgr modify user navin1 set maxjobs=3
> >  >  >
> >  >  > but still i see this is not getting applied. i am still
> bale
> > to submit
> >  >  > more jobs.
> >  >  > Slurm version is 17.11.x
> >  >  >
> >  >  > Let me know what setting is required to implement this.
> >  >
> >  > The tool "showuserlimits" tells you all user limits in the
> Slurm
> >  > database.
> >  >You can download it from
> >  >
> >
> https://github.com/OleHolmNielsen/Slurm_tools/tree/master/showuserlimits
> >  > and give it a try:
> >  >
> >  > $ showuserlimits -u navin1
> >
>
>
>

Re: [slurm-users] Job limit in slurm.

[Ole Holm Nielsen]

Hi Navin,

I wonder if you have configured the Slurm database and the slurmdbd 
daemon?  I think the limit enforcement requires the use of the database.


What is the output of:

$ scontrol show config | grep AccountingStorageEnforce

See also https://slurm.schedmd.com/accounting.html#limit-enforcement

Limit Enforcement

Various limits and limit enforcement are described in the Resource Limits 
web page.


To enable any limit enforcement you must at least have 
AccountingStorageEnforce=limits in your slurm.conf, otherwise, even if you 
have limits set, they will not be enforced. Other options for 
AccountingStorageEnforce and the explanation for each are found on the 
Resource Limits document.


/Ole

On 2/17/20 12:20 PM, navin srivastava wrote:

Hi ole,

i am submitting 100 of jobs are i see all jobs starting at the same time 
and all job is going into the run state.

if Maxjobs limit is set it should allow only 3 jobs at any point of time.

Regards
Navin.




On Mon, Feb 17, 2020 at 4:48 PM Ole Holm Nielsen 
mailto:ole.h.niel...@fysik.dtu.dk>> wrote:


Hi Navin,

Why do you think the limit is not working?  The MaxJobs limits the number
of running jobs to 3, but you can still submit as many jobs as you like!

See "man sacctmgr" for definitions of the limits MaxJobs as well as
MaxSubmitJobs.

/Ole

On 2/17/20 12:04 PM, navin srivastava wrote:
 > Hi,
 >
 > Thanks for your script.
 > with this i am able to show the limit what i set. but this limt is
 > not working.
 >
 > MaxJobs =        3, current value = 0
 >
 > Regards
 > Navin.
 >
 > On Mon, Feb 17, 2020 at 4:13 PM Ole Holm Nielsen
 > mailto:ole.h.niel...@fysik.dtu.dk>
>> wrote:
 >
 >     On 2/17/20 11:16 AM, navin srivastava wrote:
 >      > i have an issue with the slurm job limit. i applied the Maxjobs
 >     limit on
 >      > user using
 >      >
 >      >   sacctmgr modify user navin1 set maxjobs=3
 >      >
 >      > but still i see this is not getting applied. i am still bale
to submit
 >      > more jobs.
 >      > Slurm version is 17.11.x
 >      >
 >      > Let me know what setting is required to implement this.
 >
 >     The tool "showuserlimits" tells you all user limits in the Slurm
 >     database.
 >        You can download it from
 >
https://github.com/OleHolmNielsen/Slurm_tools/tree/master/showuserlimits
 >     and give it a try:
 >
 >     $ showuserlimits -u navin1

Re: [slurm-users] Job limit in slurm.

[navin srivastava]

Hi ole,

i am submitting 100 of jobs are i see all jobs starting at the same time
and all job is going into the run state.
if Maxjobs limit is set it should allow only 3 jobs at any point of time.

Regards
Navin.




On Mon, Feb 17, 2020 at 4:48 PM Ole Holm Nielsen 
wrote:

> Hi Navin,
>
> Why do you think the limit is not working?  The MaxJobs limits the number
> of running jobs to 3, but you can still submit as many jobs as you like!
>
> See "man sacctmgr" for definitions of the limits MaxJobs as well as
> MaxSubmitJobs.
>
> /Ole
>
> On 2/17/20 12:04 PM, navin srivastava wrote:
> > Hi,
> >
> > Thanks for your script.
> > with this i am able to show the limit what i set. but this limt is
> > not working.
> >
> > MaxJobs =3, current value = 0
> >
> > Regards
> > Navin.
> >
> > On Mon, Feb 17, 2020 at 4:13 PM Ole Holm Nielsen
> > mailto:ole.h.niel...@fysik.dtu.dk>> wrote:
> >
> > On 2/17/20 11:16 AM, navin srivastava wrote:
> >  > i have an issue with the slurm job limit. i applied the Maxjobs
> > limit on
> >  > user using
> >  >
> >  >   sacctmgr modify user navin1 set maxjobs=3
> >  >
> >  > but still i see this is not getting applied. i am still bale to
> submit
> >  > more jobs.
> >  > Slurm version is 17.11.x
> >  >
> >  > Let me know what setting is required to implement this.
> >
> > The tool "showuserlimits" tells you all user limits in the Slurm
> > database.
> >You can download it from
> >
> https://github.com/OleHolmNielsen/Slurm_tools/tree/master/showuserlimits
> > and give it a try:
> >
> > $ showuserlimits -u navin1
>
>

Re: [slurm-users] Job limit in slurm.

[Ole Holm Nielsen]

Hi Navin,

Why do you think the limit is not working?  The MaxJobs limits the number 
of running jobs to 3, but you can still submit as many jobs as you like!


See "man sacctmgr" for definitions of the limits MaxJobs as well as 
MaxSubmitJobs.


/Ole

On 2/17/20 12:04 PM, navin srivastava wrote:

Hi,

Thanks for your script.
with this i am able to show the limit what i set. but this limt is 
not working.


MaxJobs =        3, current value = 0

Regards
Navin.

On Mon, Feb 17, 2020 at 4:13 PM Ole Holm Nielsen 
mailto:ole.h.niel...@fysik.dtu.dk>> wrote:


On 2/17/20 11:16 AM, navin srivastava wrote:
 > i have an issue with the slurm job limit. i applied the Maxjobs
limit on
 > user using
 >
 >   sacctmgr modify user navin1 set maxjobs=3
 >
 > but still i see this is not getting applied. i am still bale to submit
 > more jobs.
 > Slurm version is 17.11.x
 >
 > Let me know what setting is required to implement this.

The tool "showuserlimits" tells you all user limits in the Slurm
database.
   You can download it from
https://github.com/OleHolmNielsen/Slurm_tools/tree/master/showuserlimits
and give it a try:

$ showuserlimits -u navin1

Re: [slurm-users] Job limit in slurm.

[navin srivastava]

Hi,

Thanks for your script.
with this i am able to show the limit what i set. but this limt is
not working.

MaxJobs =3, current value = 0

Regards
Navin.

On Mon, Feb 17, 2020 at 4:13 PM Ole Holm Nielsen 
wrote:

> On 2/17/20 11:16 AM, navin srivastava wrote:
> > i have an issue with the slurm job limit. i applied the Maxjobs limit on
> > user using
> >
> >   sacctmgr modify user navin1 set maxjobs=3
> >
> > but still i see this is not getting applied. i am still bale to submit
> > more jobs.
> > Slurm version is 17.11.x
> >
> > Let me know what setting is required to implement this.
>
> The tool "showuserlimits" tells you all user limits in the Slurm database.
>   You can download it from
> https://github.com/OleHolmNielsen/Slurm_tools/tree/master/showuserlimits
> and give it a try:
>
> $ showuserlimits -u navin1
>
> /Ole
>
>

Re: [slurm-users] Job limit in slurm.

[Ole Holm Nielsen]

On 2/17/20 11:16 AM, navin srivastava wrote:
i have an issue with the slurm job limit. i applied the Maxjobs limit on 
user using


  sacctmgr modify user navin1 set maxjobs=3

but still i see this is not getting applied. i am still bale to submit 
more jobs.

Slurm version is 17.11.x

Let me know what setting is required to implement this.


The tool "showuserlimits" tells you all user limits in the Slurm database. 
 You can download it from 
https://github.com/OleHolmNielsen/Slurm_tools/tree/master/showuserlimits 
and give it a try:


$ showuserlimits -u navin1

/Ole

[slurm-users] Job limit in slurm.

[navin srivastava]

Hi Team,

i have an issue with the slurm job limit. i applied the Maxjobs limit on
user using

 sacctmgr modify user navin1 set maxjobs=3

but still i see this is not getting applied. i am still bale to submit more
jobs.
Slurm version is 17.11.x

Let me know what setting is required to implement this.

Regards
Navin.