Kafka ACLs CLI Auth Error

2016-08-08 Thread Derar Alassi
Hi all, I have 3-node ZK and Kafka clusters. I have secured ZK with SASL. I got the keytabs done for my brokers and they can connect to the ZK ensemble just fine with no issues. All gravy! Now, I am trying to set ACLs using the kafka-acls.sh CLI. Before that, I did export the KAFKA_OPTS using th

Re: How to Identify Consumers of a Topic?

2016-08-08 Thread Derar Alassi
I use kafka-consumer-offset-checker.sh to check offsets of consumers and along that you get which consumer is attached to each partition. On Mon, Aug 8, 2016 at 3:12 PM, Jillian Cocklin < jillian.cock...@danalinc.com> wrote: > Hello, > > Our team is using Kafka for the first time and are in the t

Re: Kafka ACLs CLI Auth Error

2016-08-11 Thread Derar Alassi
cipal="kafka/hostname.abc@abc.com"; > }; > > > You can follow the blog which provides complete steps for Kafka ACLS > > https://developer.ibm.com/hadoop/2016/07/20/kafka-acls/ > > > > Thanks, > > Bharat > > > > > On Mon, Aug 8, 2016 at 2:0

Authorization with Topic Wildcards

2016-09-05 Thread Derar Alassi
Hi all, Although the documentation mentions that one can use wildcards with topic ACLs, I couldn't get that to work. Essentially, I want to set an Allow Read/Write ACL on topics com.domain.xyz.* to a certain user. This would give this user Read/Write access to topics com.domain.xyz.abc and com.dom

Re: Authorization with Topic Wildcards

2016-09-05 Thread Derar Alassi
> group01 --operation read > > It may be instructive to look at what data is in zookeeper for the acls to > debug this. > > On Mon, Sep 5, 2016 at 7:38 PM, Derar Alassi > wrote: > > > Hi all, > > > > Although the documentation mentions that one can use wi

Re: Authorization with Topic Wildcards

2016-09-06 Thread Derar Alassi
t; confusion. If you're interested to submit a PR to clarify the > documentation, that would be great. :) > > Ismael > > On Mon, Sep 5, 2016 at 7:38 PM, Derar Alassi > wrote: > > > Hi all, > > > > Although the documentation mentions that one can use wi

Re: Kafka ACL's with SSL Protocol is not working

2016-12-14 Thread Derar Alassi
Make sure that the principal ID is exactly what Kafka sees. Guessing what the principal ID is by using keytool or openssl is not going to help from my experience. The best is to add some logging to output the SSL client ID in the org.apache.kafka.common.network.SslTransportLayer.peerPrincipal() . T

Re: Kafka ACL's with SSL Protocol is not working

2016-12-16 Thread Derar Alassi
entication is being completed. > I > > > don't see any debug logs being generated for authorization part (I > might > > be > > > missing something). > > > > > > you can also set the log level to debug in properties and see whats > going > > >