We have 4 kafka brokers, each topic is replication factor 3. For a heavy loaded topic we have 40 partitions. I wrote Kafka Spout which uses Kafka group reader API to emit tuples. Running 40 spout instances each is connected to a single partition for reading on 40 partition topic.
On Thu, Jul 3, 2014 at 5:19 AM, Josh J <[email protected]> wrote: > Hi, > > I was wondering if anyone has been able to setup a kafka cluster and > replication using multiple brokers and integrated this with storm using the > KafkaSpout? I'm curious as what the topology would end up looking look and > how to configure the KafkaSpout to talk to zookeeper ? > > Thanks, > Josh > -- Tomas Mazukna 678-557-3834
