Re: Performance Testing Using Consumer-Perf-Test

2019-05-15 Thread Hans Jespersen
1) Are all 10 publishers producing to the same topic? What level of ACKs do you have set? How many partitions are in your topic? Are all 10 consumers in the same consumer group or are they supposed to be independent consumers that each get the full set of messages published? 2) Depends what you

Multiple state store files

2019-05-15 Thread Parthasarathy, Mohan
Hi, I am seeing multiple state store files (.sst) created under each directory. Is this normal ? If an application crashes and comes back, would it cause this ? Thanks Mohan

Re: SASL + SSL : authentication error in broker-to-broker communication

2019-05-15 Thread Kieran JOYEUX
Hello Martin, First of all, thanks for your help on this matter. However, pardon me but I don't understand the correlation between my kafka certs and these authentication problems ? Could you detail it please ? Regarding kafka-configs.sh, I did use the same user/password as the one in the

Performance Testing Using Consumer-Perf-Test

2019-05-15 Thread M. Manna
Hello, I am trying to do some performance testing using Kafka-Consumer-Perf-Test. Could somone please help me understand whether my setup is correct? 1) I would like to run a benchmark test to have 10 publishers publishing 100 messages (4MB) each and 10 subscribers. 2) For the above, do I need

Re: SASL + SSL : authentication error in broker-to-broker communication

2019-05-15 Thread Martin Gainty
assuming ScramSaslProvider/ScramSaslServer your credentials are stored in ZK /config/users/ but you cannot see plain-text attributes in ZK so use kafka tool to view kafka-configs.sh -describe /config/users/ /*2019 update for kafka-configs.sh */ For ease of use, kafka-configs.sh will take a

SASL + SSL : authentication error in broker-to-broker communication

2019-05-15 Thread Kieran JOYEUX
Hello, I'm facing trouble activating SASL on my currrent working SSL only cluster. I have read the doc many times and my configuration seems to be good. However, It's like Kafka cannot authenticate and broker to broker communication is not working at all. Do you have any ideas ?