Maintaining same offset while migrating from Confluent Replicator to Apache Mirror Maker 2.0

Hi All, We are currently trying to migrate Confluent replicator to Apache Open Source Mirror Maker v2.0. We are facing an issue where the messages which are already replicated by replicator is getting replicated again when the mirror maker is started on the same topic. This should not happen

[VOTE] 2.6.1 RC2

Hello Kafka users, developers and client-developers, This is the third candidate for release of Apache Kafka 2.6.1. Since RC1, the following JIRAs have been fixed: KAFKA-10758 Release notes for the 2.6.1 release: https://home.apache.org/~mimaison/kafka-2.6.1-rc2/RELEASE_NOTES.html *** Please

Re: [VOTE] 2.7.0 RC3

Hi Tom, Thanks for reviewing the docs and providing the fix. I agree that this doesn't necessarily meet the bar for a new RC, we'll fix the 2.7 HTML -Bill On Wed, Nov 25, 2020 at 11:17 AM Tom Bentley wrote: > Hi Bill, > > One very minor problem I just spotted is >

Re: [VOTE] 2.7.0 RC3

Hi Bill, One very minor problem I just spotted is https://kafka.apache.org/27/documentation.html#brokerconfigs_listeners, because the tag is not properly closed the HTML doesn't render property (in Chromium and Firefox at least) and all the rest of the configs are shown in a monospaced font. I

[VOTE] 2.7.0 RC3

This is the fourth candidate for the release of Apache Kafka 2.7.0. This is a major release that includes many new features, including: * Configurable TCP connection timeout and improve the initial metadata fetch * Enforce broker-wide and per-listener connection creation rate (KIP-612, part 1) *

Re: Many dups received by consumer (kafka_2.13)

Liam, many thanks! We already jumped into v.2.6.0 :) I appreciate your help Regards, Den ср, 25 нояб. 2020 г. в 15:10, Liam Clarke-Hutchinson < liam.cla...@adscale.co.nz>: > Can you upgrade Kafka to 2.5.1? This problem was fixed in that release. >

Re: Reg: Max number of partitions in a topic

Yes, you can have 1000 partitions. But, there are implications of having a large number. Each partition has a leader. Clients downloading metadata to find those 1000 leaders will be a bit slower than finding 100 leaders. Producers that are buffering messages in order to use batching create a

Re: Many dups received by consumer (kafka_2.13)

Can you upgrade Kafka to 2.5.1? This problem was fixed in that release. https://issues.apache.org/jira/browse/KAFKA-9839 On Wed, Nov 25, 2020 at 9:44 PM Dev Op wrote: > Hello community! Hasn't anyone faced a similar problem? I see nobody can > give me advice on what's happening with our Kafka

Re: Many dups received by consumer (kafka_2.13)

Hello community! Hasn't anyone faced a similar problem? I see nobody can give me advice on what's happening with our Kafka cluster. :( пн, 9 нояб. 2020 г. в 10:57, Dev Op : > Hello all! > > Please, help me to understand why my consumer start receives the > duplicates. I think it is because of