Hi Jason, There is a new module storm-kafka-client built specifically to utilize new consumer api. You can check that out.
On Wed, Jun 29, 2016 at 8:21 PM, Jason Williams <[email protected]> wrote: > Since Kafka 0.9+ introduces the new consumer clients (Zookeeper-less > consumer offsets) and TLS support, it would be nice to see Storm support > both. > > Sent via iPhone > > On Jun 29, 2016, at 06:37, Rama Nallamilli <[email protected]> wrote: > > This first line on the page says: > > Provides core Storm and Trident spout implementations for consuming data > from Apache Kafka 0.8.x. > Maybe I misunderstood but that statement to me implies that it is only for > Kafka 0.8.x. Either-way thanks for clearing that up, will give it a shot > with a newer version. > > Regards > Rama > > On 29 June 2016 at 11:36, Abhishek Agarwal <[email protected]> wrote: > >> Hi Rama, >> I don't see it mentioned anywhere that only a particular version is >> supported. storm-kafka is compiled against kafka 0.8. So long the >> interfaces are available in newer kafka versions, it should work >> seamlessly. Make sure you put the correct dependency of kafka in your pom >> and exclude any kafka dependencies coming out of storm-kafka. >> >> On Wed, Jun 29, 2016 at 3:39 PM, Rama Nallamilli <[email protected]> >> wrote: >> >>> Thanks for clarifying Abhishek. Link here: >>> http://storm.apache.org/releases/1.0.1/storm-kafka.html >>> >>> On 29 June 2016 at 11:01, Abhishek Agarwal <[email protected]> wrote: >>> >>>> can you point me to the link which suggests so? storm-kafka should work >>>> with any version of kafka client. >>>> >>>> On Wed, Jun 29, 2016 at 3:00 PM, Rama Nallamilli <[email protected]> >>>> wrote: >>>> >>>>> Hi, >>>>> >>>>> I was wondering if Storm Kafka integration is compatible with the >>>>> newer versions of Kafka (*0.9.x *and *0.10.x*). The website >>>>> documentation suggests it is only compatible with *0.8.x.* >>>>> >>>>> Is the integration compatible with the newer versions or would the >>>>> storm-kafka project need to be forked/rebuilt with the latest kafka >>>>> clients? >>>>> >>>>> Cheers >>>>> Rama >>>>> >>>> >>>> >>>> >>>> -- >>>> Regards, >>>> Abhishek Agarwal >>>> >>>> >>> >> >> >> -- >> Regards, >> Abhishek Agarwal >> >> > -- Regards, Abhishek Agarwal
