The arrival rate is always high. -- bc On Wed, Jan 5, 2011 at 12:07 PM, Mark Wheeler <[email protected]>wrote:
> > Date: Tue, 4 Jan 2011 20:33:58 -0500 > > From: [email protected] > > Subject: Re: [CMS-PIPELINES] Pick a record at random? > > To: [email protected] > > > > Uh, because if I choose the same worker every time and it does not > process > > its spool files faster than they're arriving (common), it will quickly > get > > overloaded. I want to spread the load evenly across the "n" workers. > > -- > > bc > > If you have "enough" workers defined, then much of the time there will be > multiple workers with NO spool files. By randomly distributing the load (or > round-robining), you keep all the workers "active" from a VM perspective. If > the arrival rate is high enough, all the workers workingsets would stay in > storage (which could be substantial because you indicated this is a very > large application). If the arrival rate is low, the workers could experience > a lot of thrashing as they continually get paged out and then back in when > new work arrives. Better IMO to use some other algorithm (alphabetical > sort?) to let as many workers as possible stay idle (and eventually paged > out). > > Mark Wheeler > UnitedHealth Group >
