please unsubscribe me

2021-06-04 Thread Sidney
several attempts to unsubscribe have been unsuccessful...

Databricks to Kafka connection error (overloaded method value createDirectStream with alternatives))

2021-06-04 Thread Meiling He
Hi, I tried to connect to Kafka from Databricks with this code, but I encountered the error: Does anyone have an idea how to fix this? Thanks, Meiling *code:* %scala import org.apache.kafka.clients.consumer.ConsumerRecord import org.apache.kafka.common.serialization.StringDeserializer import

Re: kafka-server log rename error

2021-06-04 Thread Meiling He
Hi, I tried to connect to Kafka from Databricks with this code, but I encountered the error: Does anyone have an idea how to fix this? Thanks, Meiling *code:* %scala import org.apache.kafka.clients.consumer.ConsumerRecord import org.apache.kafka.common.serialization.StringDeserializer import

Re: kafka-server log rename error

2021-06-04 Thread wenbing shen
Hi Peter You can take a look at this jira id https://issues.apache.org/jira/browse/KAFKA-10886 On 2021/06/04 01:35:53, Peter Lee wrote: > Whenever I run Kafka server in windows 10, it failed to rename > controller.log to controller.log.time > After several failed attempts, it stops running. >

kafka-server log rename error

2021-06-04 Thread Peter Lee
Whenever I run Kafka server in windows 10, it failed to rename controller.log to controller.log.time After several failed attempts, it stops running. Do you have any idea how to fix this? log4j:ERROR Failed to rename [C:\kafka_2.13-2.7.0/logs/controller.log] to

ssl principal mapping rule

2021-06-04 Thread Dhirendra Singh
Anyone please help me in understanding the kafka ssl principal mapping rule. for example in the following mapping rule RULE:^CN=(.*?),OU=(.*?),O=(.*?),L=(.*?),ST=(.*?),C=(.*?)$/$1@$2/, what is the significance of ".*?" inside parenthesis ? my distinguished name is

Re: Streams Partition Allocation Skewness

2021-06-04 Thread Bruno Cadonna
Hi Navneeth, I need some clarifications to be able to help you. First of all it would be useful to know if your topology is stateful, i.e., if it has to maintain state. Since you have two topics with 72 partitions but only 72 tasks (or partitions groups to assign) that need to be distributed

Re: kafka 2 way ssl authentication

2021-06-04 Thread Ran Lupovich
Share your new configs and logs בתאריך יום ו׳, 4 ביוני 2021, 12:06, מאת Dhirendra Singh ‏< dhirendr...@gmail.com>: > I tried the keytool command suggested by you. still getting the same error. > > On Fri, Jun 4, 2021 at 10:50 AM Ran Lupovich > wrote: > > > The default format is jks, > > > > > >

Re: kafka 2 way ssl authentication

2021-06-04 Thread Dhirendra Singh
I tried the keytool command suggested by you. still getting the same error. On Fri, Jun 4, 2021 at 10:50 AM Ran Lupovich wrote: > The default format is jks, > > > use keytool to create a Java KeyStore (JKS) with the certificate and key > for use by Kafka. You'll be prompted to create a new

Re: Kafka 2 way authentication not working

2021-06-04 Thread Anjali Sharma
Thanks for the help, can we please confirm once whether we can dynamically update this or not? On Fri, Jun 4, 2021, 14:05 Ran Lupovich wrote: > What do you mean if you can? > It is supported option. > You can set it up - but seems to do it dynamically update is not yet > implemented - but I'll

Re: Kafka 2 way authentication not working

2021-06-04 Thread Ran Lupovich
What do you mean if you can? It is supported option. You can set it up - but seems to do it dynamically update is not yet implemented - but I'll have to look into the kafka code - not going to that at the moment. בתאריך יום ו׳, 4 ביוני 2021, 11:27, מאת Anjali Sharma ‏<

Re: Kafka 2 way authentication not working

2021-06-04 Thread Anjali Sharma
But according to the documentation provided by you we can configure SSL.client.auth right?? Config options: Listener Configs listeners advertised.listeners listener.security.protocol.map Common security config principal.builder.class SSL Configs ssl.protocol ssl.provider ssl.cipher.suites

Re: Kafka 2 way authentication not working

2021-06-04 Thread Ran Lupovich
All the security configs can be dynamically configured for new listeners. In the initial implementation, only some configs will be dynamically updatable for existing listeners (e.g. SSL keystores). Support for updating other security configs dynamically for existing listeners will be added later

Re: Kafka 2 way authentication not working

2021-06-04 Thread Ran Lupovich
Thanks for checking... is there a way for you to check if this behavior is for "already connected clients" and what check only what happens to "new connections" בתאריך יום ו׳, 4 ביוני 2021, 10:47, מאת Anjali Sharma ‏< sharma.anjali.2...@gmail.com>: > Neither listener specific nor ssl.client.auth

Re: Kafka 2 way authentication not working

2021-06-04 Thread Anjali Sharma
Neither listener specific nor ssl.client.auth is working dynamically On Fri, Jun 4, 2021, 13:04 Ran Lupovich wrote: > And not* to specific listener > > בתאריך יום ו׳, 4 ביוני 2021, 10:30, מאת Ran Lupovich ‏< > ranlupov...@gmail.com > >: > > > According to documentation it is dynamic and should

Re: Kafka 2 way authentication not working

2021-06-04 Thread Ran Lupovich
And not* to specific listener בתאריך יום ו׳, 4 ביוני 2021, 10:30, מאת Ran Lupovich ‏: > According to documentation it is dynamic and should work, though it is > "general" ssl.auth of the entire broker setting and to specific listener as > you are trying out , but the logic says it should work

Re: Kafka 2 way authentication not working

2021-06-04 Thread Ran Lupovich
According to documentation it is dynamic and should work, though it is "general" ssl.auth of the entire broker setting and to specific listener as you are trying out , but the logic says it should work the same... besides that I do not have anything smart to suggest, the only understanding we need

Re: Kafka 2 way authentication not working

2021-06-04 Thread Anjali Sharma
Yes restarting the Kafka solves the problem but as it is dynamic there is no need to restart the Kafka right? On Fri, Jun 4, 2021, 12:13 Ran Lupovich wrote: > Restarting the broker solves the problem? Do your clients fully disconnect > and reconnect? > > בתאריך יום ו׳, 4 ביוני 2021, 09:24, מאת

Re: Kafka 2 way authentication not working

2021-06-04 Thread Ran Lupovich
Restarting the broker solves the problem? Do your clients fully disconnect and reconnect? בתאריך יום ו׳, 4 ביוני 2021, 09:24, מאת Anjali Sharma ‏< sharma.anjali.2...@gmail.com>: > Hi Ran, > > Thank you so much for the help, but had already gone through the > documentation, but despite doing the

Re: Kafka 2 way authentication not working

2021-06-04 Thread Anjali Sharma
Hi Ran, Thank you so much for the help, but had already gone through the documentation, but despite doing the same thing it is not working , we are not getting any client certificate request as such , is there anything that I am missing in the executing the command or we need to restart the