Kafka Issue

2020-08-11 Thread ANINDITYA SAHA
Hi, I wish to address an issue. Certificates of Kafka broker in Control plane expired which impacted Kafka Mirror maker service in all dataplanes. As a result, we renewed Kafka broker certificates manually in Control plane which restored kafka mirror maker service. Short Term actions include:

Re: Finding consumer Lag

2020-08-11 Thread Indu V
We are inserting 50,000 records to Kafka from our application. Its a single thread and transactional. Regards, Indu V From: manoj.agraw...@cognizant.com Sent: 12 August 2020 10:51 To: users@kafka.apache.org Subject: Re: Finding consumer Lag [External Email]:

Re: Finding consumer Lag

2020-08-11 Thread Manoj.Agrawal2
Can you please share what action you are performing and how ? On 8/11/20, 10:19 PM, "Indu V" wrote: [External] Hi Team, I am facing an issue in a clustered Kafka environment, org.apache.kafka.common.KafkaException: Cannot perform send because at least one previous

Exception on Producer send

2020-08-11 Thread Indu V
Hi Team, I am facing an issue in a clustered Kafka environment, org.apache.kafka.common.KafkaException: Cannot perform send because at least one previous transactional or idempotent request has failed with errors. at

Re: Finding consumer Lag

2020-08-11 Thread Indu V
Hi Team, I am facing an issue in a clustered Kafka environment, org.apache.kafka.common.KafkaException: Cannot perform send because at least one previous transactional or idempotent request has failed with errors. at

Re: [ANNOUNCE] Apache Kafka 2.5.1

2020-08-11 Thread Ismael Juma
Thanks for driving the release John! Ismael On Tue, Aug 11, 2020 at 1:40 PM John Roesler wrote: > The Apache Kafka community is pleased to announce the > release for Apache Kafka 2.5.1 > > This is a bug fix release, and it includes fixes and > improvements for 72 issues, including some

Re: [ANNOUNCE] Apache Kafka 2.5.1

2020-08-11 Thread Guozhang Wang
Thanks for driving the release John! Guozhang On Tue, Aug 11, 2020 at 1:40 PM John Roesler wrote: > The Apache Kafka community is pleased to announce the > release for Apache Kafka 2.5.1 > > This is a bug fix release, and it includes fixes and > improvements for 72 issues, including some

Re: compatible kafka version to use when using with logstash 7.5.1-1

2020-08-11 Thread Satish kumar
Hello Manoj, I did kafka rolling upgrade and sorted out errors at both producer and consumer side. but logstash 7.5 is sending empty messages to my kafka brokers where as logstash 2.4 is sending json messages normally(im seeing messages in kafka UI tool) what is the supported Kafka version

Re: Kafka compatibility with ZK

2020-08-11 Thread Ismael Juma
Note that 2.5.1 has now been released. Ismael On Sun, Aug 2, 2020 at 11:13 AM Ismael Juma wrote: > Hi Marina, > > If you upgrade to ZK 3.5.x, I highly recommend going with 3.5.8. It has a > few critical fixes when compared to 3.5.6. Also, Kafka 2.5.1 should be out > in a few days and I'd

Re: compatible kafka version to use when using with logstash 7.5.1-1

2020-08-11 Thread Ismael Juma
Note that 2.5.1 has just been released. Ismael On Tue, Aug 11, 2020 at 7:54 AM Ismael Juma wrote: > Yeah, I'd recommend upgrading to 2.5.1 (will be announced very soon) or > 2.6.0. > > Ismael > > On Tue, Aug 11, 2020, 7:43 AM REYMOND Jean-max (BPCE-IT - SYNCHRONE > TECHNOLOGIES) wrote: > >>

[ANNOUNCE] Apache Kafka 2.5.1

2020-08-11 Thread John Roesler
The Apache Kafka community is pleased to announce the release for Apache Kafka 2.5.1 This is a bug fix release, and it includes fixes and improvements for 72 issues, including some critical bugs. All of the changes in this release can be found in the release notes:

Re: New Website Layout

2020-08-11 Thread Tom Bentley
Hi Ben, Thanks for fixing that. Another problem I've just noticed is a couple of garbled headings. E.g. scroll down from https://kafka.apache.org/documentation.html#design_compactionbasics and the "What guarantees does log compaction provide?" section is rendering as $1

SSL handshake failed Error

2020-08-11 Thread Павел Шевцов
I configured Kafka to work over SSL without authorization. I rebooted Kafka and I get a certificate on a test connection. (openssl s_client -connect :9093) But when I try to connect with the producer, I get an error - "failed authentication due to: SSL handshake failed

Re: compatible kafka version to use when using with logstash 7.5.1-1

2020-08-11 Thread Ismael Juma
Yeah, I'd recommend upgrading to 2.5.1 (will be announced very soon) or 2.6.0. Ismael On Tue, Aug 11, 2020, 7:43 AM REYMOND Jean-max (BPCE-IT - SYNCHRONE TECHNOLOGIES) wrote: > Hi, > May be this issue : https://issues.apache.org/jira/browse/KAFKA-9669 ? > > -Message d'origine- > De :

Re: join not working in relation to how StreamsBuilder builds the topology

2020-08-11 Thread John Roesler
Hi Mathieu, Aaah, that is a bummer. The littlest things can be the hardest to find. Well, I'm glad I was able to help in some capacity. Cheers, -John On Tue, 2020-08-11 at 16:02 +0200, Mathieu D wrote: > Hi John, > > Thanks for your answer. > > Reading your suggestions forced me to reconsider

RE: compatible kafka version to use when using with logstash 7.5.1-1

2020-08-11 Thread REYMOND Jean-max (BPCE-IT - SYNCHRONE TECHNOLOGIES)
Hi, May be this issue : https://issues.apache.org/jira/browse/KAFKA-9669 ? -Message d'origine- De : Satish Kumar Envoyé : vendredi 7 août 2020 00:49 À : users@kafka.apache.org Objet : compatible kafka version to use when using with logstash 7.5.1-1 Hello, I upgraded kafka from 0.10 to

Re: join not working in relation to how StreamsBuilder builds the topology

2020-08-11 Thread Mathieu D
Hi John, Thanks for your answer. Reading your suggestions forced me to reconsider one more time the partitioner set on inputs. I already challenged all of them .. except one input that was provided in my test infrastructure by kafkacat. And it appears kafkacat is not using by default the same

Study On Rejected Refactorings

2020-08-11 Thread Jevgenija Pantiuchina
Dear contributors, As part of a research team from Università della Svizzera italiana (Switzerland) and University of Sannio (Italy), we have analyzed refactoring pull requests in apache/kafka repository and are looking for developers for a short 5-10 min survey

Connections to a kafka broker

2020-08-11 Thread Srinivas srihaan
Couple of Questions related to kafka connections. How to see producer and consumer connections to a specific broker? How to kill a specific connection to a broker or cluster?