Re: [VOTE] 3.7.0 RC2

2024-01-15 Thread Stanislav Kozlovski
I wanted to circle back and confirm the integration tests + system tests, plus give an overall update regarding status. The integration tests have a fair amount of flakes. I ran and inspected 3 consecutive builds (57 , 58

Re: [PROPOSAL] Add commercial support page on website

2024-01-15 Thread Viktor Somogyi-Vass
Hi Romain, Yes, you may be right that it's either everybody or nobody. Coming up with any levels of entry is going to raise questions as we see :). I wasn't aware that my idea might be against ASF guidelines as it is somewhat based on its own sponsorship page (

Re: [PROPOSAL] Add commercial support page on website

2024-01-15 Thread Romain Manni-Bucau
Hi Viktor, Having a support page is ASF friendly and quite common for the reasons mentionned in the ticket and these threads and aim at helping end users. I saw that Matthias was afraid of the maintenance of such a page but I guess it costs nothing to merge François PR - or alike, accept the

Re: [PROPOSAL] Add commercial support page on website

2024-01-15 Thread Viktor Somogyi-Vass
Hi all, I think that making and updating such a list implies tricky questions that we have to deal with. Good examples were given by Matthias, that was my first thought as well before reading his response. On the other hand I think it would be a good alternative to create a list of companies

Re: During cluster peak, KAFKA NetworkProcessorAvgIdlePercent is lower than 0.2

2024-01-15 Thread Haruki Okada
You should investigate the cause of request-queue full situation first. Since I guess low network idle ratio is the consequence of that. (Network-threads would block on queueing when request-queue is full) I recommend running async-profiler to take the profile of the broker process if possible

Re: [PROPOSAL] Add commercial support page on website

2024-01-15 Thread Francois Papon
Hi Tison, Publishing a dedicated website for that can be a good idea, however if the link of the website could not be mention in the official Apache Kafka website I'm afraid that it will not be relevant. BTW, as I understand after all the feedback of the Apache Kafka PMC and community, my

Re: [PROPOSAL] Add commercial support page on website

2024-01-15 Thread Francois Papon
Hi Matthias, Thank you for your feedback, it make sense. My proposal was to help user finding support but as you said, may be this is not the right way to address it. regards, François On 13/01/2024 00:34, Matthias J. Sax wrote: François, thanks for starting this initiative. Personally,

During cluster peak, KAFKA NetworkProcessorAvgIdlePercent is lower than 0.2

2024-01-15 Thread dong yu
This is my problem 1.The request queue is always at 500 2.There are 130 machines in the cluster, and the network idle rate of 30 machines is less than 20. This is my BROKER configuration num.io.threads=32 num.network.threads=64 How should I locate the problem? I tried to increase the parameters

Re: KAfka and syslog

2024-01-15 Thread Pasi Hiltunen
Hi, Most likely not. Many network devices do have capability to send logs to remote syslog server, and from there one can pick up those for example with Filebeat or Fluent-bit and send them to Kafka. -pasi From: Francisco Serrano Date: Thursday, 11. January 2024 at 15.41