Syntax question on the limit.
In order to place a limit of say 333 cores per user on queue "free", is the
syntax:
limit users * queues free to slots=333
Correct?
On 10/15/2012 01:32 PM, Joseph Farran wrote:
Hi Harry.
Thanks. I understand the general fair share methods available in GE.
My question is if anyone knows if a functional fair share can be applied to a
queue only (not system wide).
One manual way to accomplish this ( *basic* fair share method on a queue ) is
to setup a resource quota to allow max cores (slots) to be used by any one user
on the given queue.
A cron job then checks the queue every say 10 minutes and counts the number of
users on the queue and then re-sets the max cores per user on the queue.
If my queue has 1,000 cores, and only one user is using the queue, the cron job
then sets the quota limit with:
limit queues free to slots=1000
On next cron cycle, if there are 3 users on the free queue the cron job will
then:
limit queues free to slots=333
and so on.
As you can tell this method has some shortcomings. If user1 wants 900 cores
and user2 only needs 10 cores and user3 only needs 2 cores, the queue will not
be fully optimized ( only 333+10+2 = 345 cores in used instead of 900+10+2=912
cores in use).
I could do some fancy scripting to re-adjust based on number of users *and*
core-count request, but this get's tricky and since GE has a fair share in
place already, I wanted to see if I could use that but on a queue only.
Best,
Joseph
On 10/15/2012 10:53 AM, harry mangalam wrote:
I wrote up a doc a while ago (when trying to come up with a useful way to
organize/admin our condo cluster) that addresses this, I think:
<http://moo.nac.uci.edu/~hjm/BDUC_Pay_For_Priority.html>
If it is inaccurate, please let me know and I'll correct it.
hjm
On Sunday, October 14, 2012 01:42:38 AM Joseph Farran wrote:
Hi All.
I have a queue on our cluster with 1,000 cores that all users can use.
I like to keep the queue as close to 100% utilization as possible so that 1
user can use all 1,000 cores on that queue. However if other users
jump-in to use the queue, then allow the other users to get their fair
share.
The Grid Engine functional fair share sounds like the way to go, but can it
be set for only a queue? I have several queues and only want to set this
up for 1 queue only.
The notes I read says that to setup a simple Functional Fair Share, to do:
qconf -mconf
enforce_user auto
auto_user_fshare 100
qconf -msconf
weight_tickets_functional 10000
But I think this applies to all queues. Can this be set for 1 queue
only?
_______________________________________________
users mailing list
[email protected]
https://gridengine.org/mailman/listinfo/users
_______________________________________________
users mailing list
[email protected]
https://gridengine.org/mailman/listinfo/users
