Am 15.10.2012 um 22:32 schrieb Joseph Farran: > Hi Harry. > > Thanks. I understand the general fair share methods available in GE. > > My question is if anyone knows if a functional fair share can be applied to a > queue only (not system wide).
There is only one policy per installation possible. Although it would be nice to set it up per hosts/queues. a) You could run more than one sgeexecd per node and tell the users to switch between the installations by `sourcing` different setups. b) In your case, maybe: - one project per user - users have to request the project for this fair-share-queue - weight only the project in the scheduler configuration (others set to zero) - normal jobs don't request a project at all, so it's only FIFO -- Reuti > One manual way to accomplish this ( *basic* fair share method on a queue ) is > to setup a resource quota to allow max cores (slots) to be used by any one > user on the given queue. > > A cron job then checks the queue every say 10 minutes and counts the number > of users on the queue and then re-sets the max cores per user on the queue. > > If my queue has 1,000 cores, and only one user is using the queue, the cron > job then sets the quota limit with: > > limit queues free to slots=1000 > > On next cron cycle, if there are 3 users on the free queue the cron job will > then: > > limit queues free to slots=333 > > and so on. > > As you can tell this method has some shortcomings. If user1 wants 900 > cores and user2 only needs 10 cores and user3 only needs 2 cores, the queue > will not be fully optimized ( only 333+10+2 = 345 cores in used instead of > 900+10+2=912 cores in use). > > I could do some fancy scripting to re-adjust based on number of users *and* > core-count request, but this get's tricky and since GE has a fair share in > place already, I wanted to see if I could use that but on a queue only. > > Best, > Joseph > > > On 10/15/2012 10:53 AM, harry mangalam wrote: >> I wrote up a doc a while ago (when trying to come up with a useful way to >> organize/admin our condo cluster) that addresses this, I think: >> >> <http://moo.nac.uci.edu/~hjm/BDUC_Pay_For_Priority.html> >> >> If it is inaccurate, please let me know and I'll correct it. >> >> hjm >> >> On Sunday, October 14, 2012 01:42:38 AM Joseph Farran wrote: >>> Hi All. >>> >>> I have a queue on our cluster with 1,000 cores that all users can use. >>> >>> I like to keep the queue as close to 100% utilization as possible so that 1 >>> user can use all 1,000 cores on that queue. However if other users >>> jump-in to use the queue, then allow the other users to get their fair >>> share. >>> >>> The Grid Engine functional fair share sounds like the way to go, but can it >>> be set for only a queue? I have several queues and only want to set this >>> up for 1 queue only. >>> >>> The notes I read says that to setup a simple Functional Fair Share, to do: >>> >>> qconf -mconf >>> enforce_user auto >>> auto_user_fshare 100 >>> >>> qconf -msconf >>> weight_tickets_functional 10000 >>> >>> >>> But I think this applies to all queues. Can this be set for 1 queue >>> only? > > _______________________________________________ > users mailing list > [email protected] > https://gridengine.org/mailman/listinfo/users _______________________________________________ users mailing list [email protected] https://gridengine.org/mailman/listinfo/users
