[slurm-dev] Re: queue routing

[Steven Lo]

Hi Jeff,

Thanks so much for the plugin script.

Let me see if we can modify it to fit our need.

I'm not familiar with plugin in Slurm.  How does one submit job using 
this plugin?

The reason I ask is that we have home grown script that we use for the 
Torque/Maui
job submission and just want to see how they all work together.


Thanks

Steven.


On 7/19/16 10:32 AM, Sarlo, Jeffrey S wrote:
I changed the job_submit.lua that comes with slurm to have our routing info in 
it

and you have to have this set in your slurm.conf

JobSubmitPlugins=lua

I don't know a lot about lua programming, but got this to work after searching 
the web a lot.  If the user doesn't submit a time, it defaults to short, which 
is 4 hours.  We just have short medium and long.

Hope this helps.
Jeff
UH - HPC

-----Original Message-----
From: Steven Lo [mailto:s...@cacr.caltech.edu]
Sent: Tuesday, July 19, 2016 12:25 PM
To: slurm-dev
Subject: [slurm-dev] Re: queue routing



Hi,

Any kind pointer/hint/suggestion is highly appreciated.

If this feature is not supported with Slurm, it will be nice to know as well so 
that we can plan accordingly.


Thanks

Steven.


On 7/15/16 12:13 PM, Steven Lo wrote:

Hi,

I'm a newbie to the Slurm world.

We are in the process of transition from Torque/Maui to Slurm.

One of the feature that we have implemented is queue routing where all
the jobs
are submitted to productionQ queue and it will route to the
appropriate queue automatically.

The following is part of our Torque configuration:

#
# Create and define queue productionQ
#
create queue productionQ
set queue productionQ queue_type = Route
set queue productionQ resources_default.neednodes = production
set queue productionQ resources_default.nodect = 1
set queue productionQ resources_default.walltime = 01:00:00
set queue productionQ acl_group_enable = True
set queue productionQ acl_groups = support
set queue productionQ acl_groups += sms
set queue productionQ acl_groups += acm
set queue productionQ route_destinations = shortJobsQ
set queue productionQ route_destinations += longJobsQ
set queue productionQ enabled = True
set queue productionQ started = True

#
# Create and define queue longJobsQ
#
create queue longJobsQ
set queue longJobsQ queue_type = Execution
set queue longJobsQ Priority = 1000
set queue longJobsQ resources_max.nodect = 22
set queue longJobsQ resources_max.walltime = 48:00:00
set queue longJobsQ resources_min.nodect = 2
set queue longJobsQ resources_min.walltime = 12:00:01
set queue longJobsQ resources_default.neednodes = production
set queue longJobsQ acl_group_enable = True
set queue longJobsQ acl_groups = support
set queue longJobsQ acl_groups += sms
set queue longJobsQ acl_groups += acm
set queue longJobsQ enabled = True
set queue longJobsQ started = True


How can we implement the same on Slurm?  Can someone share their
example with us?


Thanks all in advance.

Steven.