Look at the supervisors logs. There could be a timeout that make a supervisor to force a worker to shut down, triggering a rebalancing.
2014-09-08 7:17 GMT-04:00 Palak Shah <[email protected]>: > I have a topology that uses a Kafka spout to read values from a Kafka > queue. I used the kafkaSpout that came with storm-0.9.2-incubating. > > I observed that the nimbus rebalances the topology very often. The > topology suddenly shuts down and starts again with the tasks running on > different machines. I wanted to know why storm nimbus is rebalancing my > topology, so I observed the storm throughput, latency, load on bolts and > even system metrics like cpu and memory utilization, but I could not see a > pattern. > > Can someone explain what are the factors that lead to rebalancing of > topology in storm? > > Thanks, > Palak Shah > -- Cyrille Karmann +1-514-659-1209 [email protected]
