On Mon, 31 Oct 2011 at 17:16 -0000, Bill Hoover wrote:
> I've been trying to figure out a way to get the queue sorting to
> work like I'd prefer, but so far haven't come up with any good
> ideas. I'd appreciate any suggestions (GE 6.2u5).
>
> Currently I have:
> queue_sort_method load
> job_load_adjustments NONE
> load_adjustment_decay_time 0:0:00
> load_formula -slots
>
> On a system with uniform nodes this would operate just as I want,
> and with minimal scheduling load (we bang lots of jobs through
> this).
I'm using:
load_formula seq_no*100+m_core-slots
I have identical nodes and 3 hostgroups/queues (tiny, small, green).
I use seq_no to set the priority order of the hostgroups/queues.
I'm not convinced that jobs always get correctly started on nodes with
the fewest available slots (from the '-slots' component), but it seems
close enough. I assumed 'slots' as a consumable would get an
automatic adjustment at job start. It might be that I need to play
with job_load_adjustments and load_adjustment_decay_time.
> An example of the problem is on of my systems. It has 2 sets of
> nodes. set 1 has 14 machines with older Xeon processors, 8 cores per
> node. set 2 has 14 machines with Westmere processors, 12 cores per
> node, but for our application HT gives a 15-20% overall throughput
> boost so they look like 24 cores per node.
>
> Until you get about 12 jobs assigned to one of the Westmere nodes,
> they are faster than the older ones. Above that, they are slower.
>
> So, the ideal way to distribute jobs would be to assign up to 12
> jobs per node on the set 2 machines, then assign up to 8 jobs per
> node to the set 1 ones, then finish filling up the 12 HT slots on
> the set 2 machines.
You might try a non-ht queue with 12 slots per host along with a ht
queue for the remaining 12 slots per host. You could then use seq_no
to use the ht queue last.
I hate the 'queues on individual hosts' concept, but seem to finally
be wrapping my head around it. I'm almost horrified that I'm even
able to suggest the above possibility.
Stuart
--
I've never been lost; I was once bewildered for three days, but never lost!
-- Daniel Boone
_______________________________________________
users mailing list
[email protected]
https://gridengine.org/mailman/listinfo/users
