Hi Weide, I haven't found any material on this matter. But as far as I could figure out, the strategy seems to try to evenly divide the total number of executors among the worker processes. If a particular spout/bolt has multiple executors, it tries to span them across all the worker processes.
However, I could not find out if the topology layout or groupings between the components have any role to play in the distribution. Regards, Srinath. On Sun, May 11, 2014 at 10:12 PM, Weide Zhang <[email protected]> wrote: > Hi > > Is there any good documentation how storm does resource allocation and how > does it maps a topology to different work process and how was it decided to > group components in one worker process or across worker process ? > > i'm trying to understand what algorithm it uses to partition the topology > and in the meanwhile considering the resource constraint to achieve best > performance if there is something available here ? > > Thanks, > > Weide >
