What kind of grouping (if any) are you using on the tuples coming out of your spout?
If you want them evenly spread across a number of worker bolts, set that bolt to subscribe to the stream using a shuffle grouping. http://storm.incubator.apache.org/documentation/Concepts.html Search there for "Stream groupings" On Thu, Mar 20, 2014 at 10:11 AM, Srinath C <[email protected]> wrote: > Anyone? > > > On Wed, Mar 19, 2014 at 6:35 AM, Srinath C <[email protected]> wrote: > >> Hi, >> Can anyone point me to some notes on how storm decides to distribute >> the tasks among its workers. The behavior am seeing is that all tasks of a >> particular type are being grouped into one worker process. >> To add more details to my use-case, I have a spout that is sourcing >> tuples from a rabbitmq cluster. I want to distribute the spout tasks across >> different storm workers so that the throughput is higher and the load of >> ingesting the messages is distributed across all the workers in the storm >> cluster. Any suggestions on how to influence the distribution of tasks? >> >> Thanks, >> Srinath. >> >> >
