Re: Discussion on Apache Kafka 4.0.0 Connect

2025-09-03 Thread Martin Andersson
Hello Edwin. This is the developer email list, I think your query probably belongs in the user email list. However, I believe your question highlights an issue that migrating to 4.0 and the new plugin discovery isn't documented well enough. The answer to your question is found here https://k

Re: [jira] [Created] (KAFKA-19652) Consumer throughput drops by 10 times with Kafka v3.9.0 in ZK mode

2025-09-02 Thread Martin Andersson
Hello Sharad. Can you provide more details here please? I.e. the cluster setup, number of producers, consumers, topics, partitions, etc. Regards, From: Sharad Garg (Jira) Sent: Friday, August 29, 2025 10:01 To: dev@kafka.apache.org Subject: [jira] [Created] (KA

Re: Kafka Start and Stop getting issue

2025-08-25 Thread Martin Andersson
Hello Nageswararao. This email list is not for kafka spring plugin development. To exclude a Spring Kafka issue I suggest that you create a minimal test case where you create a producer and consumer, pause the consumer, publish a message with the producer, resume the consumer, and attempt to ve

Re: [DISCUSS] The Path Forward for Saving Cross-AZ Costs KIPs

2025-08-13 Thread Martin Andersson
Hello Jun. It seems to me that some of the drawbacks of KIP-1150 are not included properly as Cons in your summary. Having a produce latency of ~1-2 sec for P99 severly limits the useability of diskless topics. I'm quite sure the company I work at would not be able to use this solution due to t

Re: Kafka Consumer Not Receiving Messages Until Restart

2025-08-04 Thread Martin Andersson
Hi Waseem This sounds like either an environment issue (i.e. something other than the kafka client/broker), or a client issue. In any case, you probably want to ask the developers of the ruby client instead. Regards, From: Waseem Anwar Sent: Friday, August 1, 2

Re: [DISCUSS] KIP-1201: Add disk threshold strategy to prevent disk full failure

2025-08-04 Thread Martin Andersson
Hello Peng. > In most use cases, Kafka serves as a messaging middleware where messages that have already been consumed are typically no longer needed and can be safely deleted. I don't think we can make these kind of assumptions about how Kafka is used. In any case, defining which consumer group