Re: Kafka 2 way authentication not working

2021-06-03 Thread Ran Lupovich
Adding this information that supports your assumptions that it should be dynamically supportedNotice the update mode - Dynamic Update Mode option in Broker Configurations for the update

Kafka 2 way authentication not working

2021-06-03 Thread Anjali Sharma
Dear All, When trying to configure mtls without restarting the brokers it is not working. For mutualTLS "ssl.client.auth" should be set to "required". So, if we are trying to do the dynamic update using the below command *sh /opt/kafka/bin/kafka-configs.sh --bootstrap-server localhost:28104

Re: kafka 2 way ssl authentication

2021-06-03 Thread Ran Lupovich
The default format is jks, use keytool to create a Java KeyStore (JKS) with the certificate and key for use by Kafka. You'll be prompted to create a new password for the resulting file as well as enter the password for the PKCS12 file from the previous step. Hang onto the new JKS password for

kafka 2 way ssl authentication

2021-06-03 Thread Dhirendra Singh
I am trying to setup 2 way ssl authentication. My requirement is broker should authenticate only specific clients. My organization has a CA which issue all certificates in pkcs12 format. steps i followed are as follows. 1. get a certificate for the broker and configured it in the broker keystore

Re: Weird behavior of topic retention - some are cleaned up too often, some are not at all

2021-06-03 Thread Marina Popova
For those who is interested - I've posted a detailed explanation of the reasons for these issues here: https://stackoverflow.com/questions/67625641/kafka-segments-are-deleted-too-often-or-not-at-all/67827549#67827549 In brief - it was an issue with a low=volume topic and segment rotation for

Mutual-TLS Dynamic config update not working

2021-06-03 Thread Anjali Sharma
Dear All, When trying to configure mtls without restarting the brokers it is not working. For mutualTLS "ssl.client.auth" should be set to "required". So, if we are trying to do the dynamic update using the below command *sh /opt/kafka/bin/kafka-configs.sh --bootstrap-server localhost:28104

Re: Emulating a cosumer with maximum consumption rate and its synchronization with the producer work.

2021-06-03 Thread Nikita Kretov
Hello! Interesting question, first things first I don't know the answer) But there are quotation mechanism at broker side of this equation. Maybe it's possible to implement custom quota mechanism that will use message per sec metric instead of bytes per sec. On 5/31/21 6:41 PM, Mazen

Re: Increase in consumer lag

2021-06-03 Thread Nikita Kretov
Hello! Basically , I don't think that we can simply conclude that consumer lag is dependent on number of replica fetching threads. Maybe the first thing to double check is to use kafka-confumer-group cli instead of some lag exporters (in case you using this type of monitoring for consumer lag).