Hi Bobby, Thanks for your reply, indeed SimpleConsumer.scala doesn't support extraction of data from Kafka via. Kerberos in which case I'll start thinking to upgrade Storm to 1.2.1 and look to use storm-kafka-client, I'm specifically using Transnational Non Opaque Spout ( https://issues.apache.org/jira/browse/STORM-2974) which is still under review it, I'm thinking of using it by building it from the PR as suggested by Stig but it will be great help if we can think of making this available in 1.2.x soon.
On Tue, May 15, 2018 at 11:27 PM, Bobby Evans <[email protected]> wrote: > I am not sure you can. storm-kafka 0.10.0 uses kafka version 0.8.1.1, and > I don't think security was added into kafka yet. > > https://kafka.apache.org/081/documentation.html > > If you have overridden that version of the kafka client and are running > with a newer version of kafka, you might be able to, but storm itself has > no special support for it in those older versions because kafka didn't > support it yet. Your best bet would be to upgrade to a newer version of > storm and switch to the storm-kafka-clients package + API. > > In older versions of storm like this you might be able to place a keytab > on each of the nodes, then you will need to configure kafka to use those > keytabs for authentication. In that version of storm you can set kafka > broker properties in the kafka.broker.properties storm config as a map, > but I honestly don't know if there is more you would need to do for it. > > Thanks, > > Bobby > > > On Tue, May 15, 2018 at 2:34 AM Aniket Alhat <[email protected]> > wrote: > >> Hi Hao, Zimmer >> >> Where you guys able to get the any feedback on this? How did you get >> around this issue? >> >> On Wed, Jul 13, 2016 at 9:23 PM, Ziemer, Tom <[email protected]> >> wrote: >> >>> Hi everybody, >>> >>> >>> >>> I am facing the same problem (with Storm 1.0.1 and Kafka 0.9.0.1). Any >>> ideas? >>> >>> >>> >>> Thanks, >>> >>> Tom >>> >>> >>> >>> *From:* Hao Chen [mailto:[email protected]] >>> *Sent:* Dienstag, 12. Juli 2016 02:44 >>> *To:* [email protected] >>> *Subject:* How to use KafkaSpout to consume kafka cluster secured with >>> kerberos >>> >>> >>> >>> Hi Team, >>> >>> >>> >>> How to use KafkaSpout to consume kafka cluster secured with kerberos? I >>> can't find lots of accurate information about the API. >>> >>> >>> >>> The versions I am using are: >>> >>> - storm: 0.9.3 >>> - storm-kafka: 0.10.0 >>> >>> Thanks, >>> >>> - Hao >>> >> >> >> >> -- >> >> *Aniket Alhat* >> >> -- *Aniket Alhat*
