[slurm-dev] Re: Preemption order?

2016-06-10 Thread jette


See scheduling tutorial starting on page 27
http://slurm.schedmd.com/SUG14/sched_tutorial.pdf

Smaller jobs tend to get preempted larger jobs.

On 2016-06-10 07:52, Paul Edmon wrote:

I'm interested in this as well.  It would be good to have a few knobs
to fine tune which jobs preferentially get requeued.  I know it adds
overhead to the scheduling but the benefit to us outweighs that.
Essentially it would be good to both preempt jobs that are small and
short before the big ones or have been running for a long time.

-Paul Edmon-

On 06/10/2016 02:36 AM, Steffen Grunewald wrote:

Good morning everyone,

is there a way to control the order in which jobs get preempted?
That is, for a queue with PreemptMode=REQUEUE, it would make sense to
preempt jobs first that haven't run for long; for CANCEL with some
GraceTime, perhaps addressing the longest-running jobs first would
be better - can Slurm's strategy be hinted twoards the "right" way?

Thanks,

- S



[slurm-dev] Re: Preemption order?

2016-06-10 Thread Paul Edmon


I'm interested in this as well.  It would be good to have a few knobs to 
fine tune which jobs preferentially get requeued.  I know it adds 
overhead to the scheduling but the benefit to us outweighs that.  
Essentially it would be good to both preempt jobs that are small and 
short before the big ones or have been running for a long time.


-Paul Edmon-

On 06/10/2016 02:36 AM, Steffen Grunewald wrote:

Good morning everyone,

is there a way to control the order in which jobs get preempted?
That is, for a queue with PreemptMode=REQUEUE, it would make sense to
preempt jobs first that haven't run for long; for CANCEL with some
GraceTime, perhaps addressing the longest-running jobs first would
be better - can Slurm's strategy be hinted twoards the "right" way?

Thanks,

- S



[slurm-dev] Re: Scripting Account Provisioning

2016-06-10 Thread Schulz, William
Thanks, Rémi. I will have a look!

-Original Message-
From: Rémi Palancher [mailto:r...@rezib.org] 
Sent: Friday, June 10, 2016 4:51 AM
To: slurm-dev
Subject: [slurm-dev] Re: Scripting Account Provisioning


Hi William,

Le 09/06/2016 à 18:19, Schulz, William a écrit :
> We’re interested in scripting/automating some aspects of Slurm user 
> account provisioning and maintenance. Are there any examples or 
> tutorials available on leveraging the API, or using Python for such tasks?

I'm not sure what you're expecting here but FWIW we have this python script to 
sync slurmdbd users/accounts with one POSIX group (typically with LDAP backend 
through NSS):

https://na01.safelinks.protection.outlook.com/?url=https%3a%2f%2fgithub.com%2fedf-hpc%2fslurm-llnl-misc-plugins%2fblob%2fmaster%2fsync-accounts%2fslurm-sync-accounts=01%7c01%7cwschulz%40email.unc.edu%7c401409cdd9da4e25582d08d3910c4bee%7c58b3d54f16c942d3af081fcabd095666%7c1=in2Qj%2fMuyvMG1xniKFGwKdGKVxGuE6NvSCN9ZYG2yIw%3d

It's rather straight so you may tune easily it to fit your needs.

Best,
Rémi


[slurm-dev] Preemption order?

2016-06-10 Thread Steffen Grunewald

Good morning everyone,

is there a way to control the order in which jobs get preempted?
That is, for a queue with PreemptMode=REQUEUE, it would make sense to 
preempt jobs first that haven't run for long; for CANCEL with some
GraceTime, perhaps addressing the longest-running jobs first would
be better - can Slurm's strategy be hinted twoards the "right" way?

Thanks,

- S

-- 
Steffen Grunewald, Cluster Administrator
Max Planck Institute for Gravitational Physics (Albert Einstein Institute)
Am M�hlenberg 1
D-14476 Potsdam-Golm
Germany
~~~
Fon: +49-331-567 7274
Fax: +49-331-567 7298
Mail: steffen.grunewald(at)aei.mpg.de
~~~