Re: Storm kafka integration
Hi, You can use storm-kafka-client, which support storing consumer offsets in kafka cluster. Yuanjia Li From: pradeep s Date: 2017-02-20 03:49 To: users Subject: Storm kafka integration Hi, I am using Storm 1.0.2 and Kafka 0.10.1.1 and have query on Spout code to integrate with Kafka. As per storm docs , its mentioned to use Broker Hosts to register the Kafka Spout. http://storm.apache.org/releases/1.0.2/storm-kafka.html In this case will the consumer offsets be stored in zookeeper. Is this the preferred approach . I have read that in latest Kafka version , consumer offsets can be maintained in Kafka cluster itslef. Is there any storm spout example for this . Regards Pradeep S
Re: Storm kafka integration
You should ask Storm people. Kafka Spout is not provided by Kafka community. Or maybe try out Kafka's Streams API (couldn't resist... ;) ) -Matthias On 2/19/17 11:49 AM, pradeep s wrote: > Hi, > I am using Storm 1.0.2 and Kafka 0.10.1.1 and have query on Spout code to > integrate with Kafka. As per storm docs , its mentioned to use Broker Hosts > to register the Kafka Spout. > http://storm.apache.org/releases/1.0.2/storm-kafka.html > > In this case will the consumer offsets be stored in zookeeper. Is this the > preferred approach . > I have read that in latest Kafka version , consumer offsets can be > maintained in Kafka cluster itslef. Is there any storm spout example for > this . > Regards > Pradeep S > signature.asc Description: OpenPGP digital signature
Storm kafka integration
Hi, I am using Storm 1.0.2 and Kafka 0.10.1.1 and have query on Spout code to integrate with Kafka. As per storm docs , its mentioned to use Broker Hosts to register the Kafka Spout. http://storm.apache.org/releases/1.0.2/storm-kafka.html In this case will the consumer offsets be stored in zookeeper. Is this the preferred approach . I have read that in latest Kafka version , consumer offsets can be maintained in Kafka cluster itslef. Is there any storm spout example for this . Regards Pradeep S
