I'll try to find some time to review it. On Tue, May 15, 2018 at 11:56 PM Aniket Alhat <[email protected]> wrote:
> Hi Bobby, > > Thanks for your reply, indeed SimpleConsumer.scala doesn't support > extraction of data from Kafka via. Kerberos in which case I'll start > thinking to upgrade Storm to 1.2.1 and look to use storm-kafka-client, I'm > specifically using Transnational Non Opaque Spout ( > https://issues.apache.org/jira/browse/STORM-2974) which is still under > review it, I'm thinking of using it by building it from the PR as suggested > by Stig but it will be great help if we can think of making this available > in 1.2.x soon. > > On Tue, May 15, 2018 at 11:27 PM, Bobby Evans <[email protected]> wrote: > >> I am not sure you can. storm-kafka 0.10.0 uses kafka version 0.8.1.1, >> and I don't think security was added into kafka yet. >> >> https://kafka.apache.org/081/documentation.html >> >> If you have overridden that version of the kafka client and are running >> with a newer version of kafka, you might be able to, but storm itself has >> no special support for it in those older versions because kafka didn't >> support it yet. Your best bet would be to upgrade to a newer version of >> storm and switch to the storm-kafka-clients package + API. >> >> In older versions of storm like this you might be able to place a keytab >> on each of the nodes, then you will need to configure kafka to use those >> keytabs for authentication. In that version of storm you can set kafka >> broker properties in the kafka.broker.properties storm config as a map, >> but I honestly don't know if there is more you would need to do for it. >> >> Thanks, >> >> Bobby >> >> >> On Tue, May 15, 2018 at 2:34 AM Aniket Alhat <[email protected]> >> wrote: >> >>> Hi Hao, Zimmer >>> >>> Where you guys able to get the any feedback on this? How did you get >>> around this issue? >>> >>> On Wed, Jul 13, 2016 at 9:23 PM, Ziemer, Tom <[email protected]> >>> wrote: >>> >>>> Hi everybody, >>>> >>>> >>>> >>>> I am facing the same problem (with Storm 1.0.1 and Kafka 0.9.0.1). Any >>>> ideas? >>>> >>>> >>>> >>>> Thanks, >>>> >>>> Tom >>>> >>>> >>>> >>>> *From:* Hao Chen [mailto:[email protected]] >>>> *Sent:* Dienstag, 12. Juli 2016 02:44 >>>> *To:* [email protected] >>>> *Subject:* How to use KafkaSpout to consume kafka cluster secured with >>>> kerberos >>>> >>>> >>>> >>>> Hi Team, >>>> >>>> >>>> >>>> How to use KafkaSpout to consume kafka cluster secured with kerberos? I >>>> can't find lots of accurate information about the API. >>>> >>>> >>>> >>>> The versions I am using are: >>>> >>>> - storm: 0.9.3 >>>> - storm-kafka: 0.10.0 >>>> >>>> Thanks, >>>> >>>> - Hao >>>> >>> >>> >>> >>> -- >>> >>> *Aniket Alhat* >>> >>> > > > -- > > *Aniket Alhat* > >
