Re: [slurm-users] job priority keeping resources from being used?

2019-11-05 Thread c b
On Sun, Nov 3, 2019 at 7:18 AM Juergen Salk wrote: > > Hi, > > maybe I missed it, but what does squeue say in the reason field for > your pending jobs that you expect to slip in? > > the reason on these jobs is just "Priority". > Is your partition maybe configured for exclusive node access,

Re: [slurm-users] job priority keeping resources from being used?

2019-11-03 Thread Juergen Salk
Hi, maybe I missed it, but what does squeue say in the reason field for your pending jobs that you expect to slip in? Is your partition maybe configured for exclusive node access, e.g. by setting `OverSubscribe=EXCLUSIVE´? Best regards Jürgen -- Jürgen Salk Scientific Software & Compute

Re: [slurm-users] job priority keeping resources from being used?

2019-11-01 Thread c b
I see - yes, to clarify, we are specifying memory for each of these jobs, and there is enough memory on the nodes for both types of jobs to be running simultaneously. On Fri, Nov 1, 2019 at 1:59 PM Brian Andrus wrote: > I ask if you are specifying it, because if not, slurm will assume a job >

Re: [slurm-users] job priority keeping resources from being used?

2019-11-01 Thread Burian, John
: Friday, November 1, 2019 at 11:09 AM To: Slurm User Community List Subject: Re: [slurm-users] job priority keeping resources from being used? On my low resource jobs I'm setting the time to 1 hour, and on my large ones I'm setting time=unlimited. Is the unlimited part the problem? I have

Re: [slurm-users] job priority keeping resources from being used?

2019-11-01 Thread Brian Andrus
I ask if you are specifying it, because if not, slurm will assume a job will use all the memory available. So without specifying, your big job gets allocated 100% of the memory so nothing could be sent to the node. Same if you don't specify for the little jobs. It would want 100%, but if

Re: [slurm-users] job priority keeping resources from being used?

2019-11-01 Thread c b
yes, there is enough memory for each of these jobs, and there is enough memory to run the high resource and low resource jobs at the same time. On Fri, Nov 1, 2019 at 1:37 PM Brian Andrus wrote: > Are you specifying memory for each of the jobs? > > Can't run a small job if there isn't enough

Re: [slurm-users] job priority keeping resources from being used?

2019-11-01 Thread Brian Andrus
Are you specifying memory for each of the jobs? Can't run a small job if there isn't enough memory available for it. Brian Andrus On 11/1/2019 7:42 AM, c b wrote: I have: SelectType=select/cons_res SelectTypeParameters=CR_CPU_Memory On Fri, Nov 1, 2019 at 10:39 AM Mark Hahn

Re: [slurm-users] job priority keeping resources from being used?

2019-11-01 Thread c b
;> *From: *slurm-users on behalf of >> c b >> *Reply-To: *Slurm User Community List >> *Date: *Friday, November 1, 2019 at 10:30 AM >> *To: *"slurm-users@lists.schedmd.com" >> *Subject: *[slurm-users] job priority keeping resources from being used? >&g

Re: [slurm-users] job priority keeping resources from being used?

2019-11-01 Thread c b
:30 AM > *To: *"slurm-users@lists.schedmd.com" > *Subject: *[slurm-users] job priority keeping resources from being used? > > > > [WARNING: External Email - Use Caution] > > > > Hi, > > > > Apologies for the weird subject line...I don't know how

Re: [slurm-users] job priority keeping resources from being used?

2019-11-01 Thread Burian, John
Community List Date: Friday, November 1, 2019 at 10:30 AM To: "slurm-users@lists.schedmd.com" Subject: [slurm-users] job priority keeping resources from being used? [WARNING: External Email - Use Caution] Hi, Apologies for the weird subject line...I don't know how else to describe what

Re: [slurm-users] job priority keeping resources from being used?

2019-11-01 Thread c b
I have: SelectType=select/cons_res SelectTypeParameters=CR_CPU_Memory On Fri, Nov 1, 2019 at 10:39 AM Mark Hahn wrote: > > In theory, these small jobs could slip in and run alongside the large > jobs, > > what are your SelectType and SelectTypeParameters settings? > ExclusiveUser=YES on

[slurm-users] job priority keeping resources from being used?

2019-11-01 Thread c b
Hi, Apologies for the weird subject line...I don't know how else to describe what I'm seeing. Suppose my cluster has machines with 8 cores each. I have many large high priority jobs that each require 6 cores, so each machine in my cluster runs one of each of these jobs at a time. However, I