Patrick, Thank you for replying. I did try but load isn't distributed. Both clusters are processing all the events individually on the topic.
Darsh On Thu, Apr 28, 2016 at 2:56 PM, Patrick.Brinton <[email protected] > wrote: > Darsh, > I have never tried but I have a setup where I could try. As long as you > point to the same zooKeeper I think it would work. Give it a try and let > me know if you hit issues. If you do I will mimic your setup and we should > be able to figure it out. > > Patrick > > Patrick Brinton Sr. Engineer SWLM | ¤Target | 7000 Target Parkway North > | Brooklyn Park, MN 55445 | 612.599.6523* (ph) *| > [email protected] <[email protected]> > > From: Darsh <[email protected]> > Reply-To: "[email protected]" <[email protected]> > Date: Thursday, April 28, 2016 at 12:39 PM > To: "[email protected]" <[email protected]> > Subject: Distribute load across multiple storm clusters. > > Hi, > > > Is it possible to to distribute load across 2 clusters if I deploy same > topology to 2 storm clusters with same spout id? > > > We have 2 separate storm clusters with 0.10.0 version of storm running in > 2 different availability zones. We are using storm-kafka spout (with simple > consumer) to process data from kafka and external common zookeeper to store > the kafka offsets.Kafka Topic has 32 partitions. 8 executors( > *parallelism_hint*) for spout in each cluster. > > > > > > > Thanks > > Darsh > -- Thanks Darsh
