Re: Out of order messages when kafka streams application catches up

Hi Tomasz, Thanks for asking. This sounds like the situation that we fixed in Apache Kafka 3.0, with KIP-695 (https://cwiki.apache.org/confluence/display/KAFKA/KIP-695%3A+Further+Improve+Kafka+Streams+Timestamp+Synchronization). Can you try upgrading and let us know if this fixes the problem?

Copy data from source cluster to target with different number of partitions

Hi, We have a cluster with topics that contain many partitions. We are going to decrease the number of partitions and looking for any solution. I t would be very useful to make it with MirrorMaker 2 but as we can see, it doesn't allow us to do it. MM2 creates missing partitions for a topic, e.g.

Re: [VOTE] 3.3.0 RC2

Thanks for the votes, everyone! Here is the best recent run of the system tests on 3.3 http://confluent-kafka-system-test-results.s3-us-west-2.amazonaws.com/3.3/2022-09-24--001.system-test-kafka-3.3--1664037736--confluentinc--3.3--b084e9068c/report.html. I'm currently re-running the failed tests

Mirror Maker: copy data from source cluster to target with different number of partitions

We have a cluster with topics that contain many partitions. We are going to decrease the number of partitions and looking for any solution. I t would be very useful to make it with MirrorMaker 2 but as we can see, it doesn't allow us to do it. MM2 creates missing partitions for a topic, e.g.

Re: [VOTE] 3.3.0 RC2

+1 provided that the system test results are good. Can you please post them along with the JUnit test results (these seem ok although there are some flakes)? I tested the kraft quick start with the Scala 2.13 binary and ran the tests on the source release. I noticed a non-blocker issue with the

Re: [VOTE] 3.3.0 RC2

+1 (non-binding). I used the staged binaries (Scala 2.13) and Maven artifacts and ran my tests. All seems to work fine. Thanks for running the release. Jakub On Wed, Sep 21, 2022 at 1:17 AM David Arthur wrote: > Hello Kafka users, developers and client-developers, > > This is the second

Re: [VOTE] 3.3.0 RC2

Hi Jose and David, Thanks for running the release! I did the following verification steps: I performed the following validations: 1. Verified all checksums and signatures. 2. Built from source and ran unit tests. 3. Ran the first quickstart steps 1. Zookeeper quick start

Re: [VOTE] 3.3.0 RC2

Thanks for running the release, José and David. I performed the following validations: * Verified all checksums and signatures. * Built from source and ran unit tests. * Ran the first quickstart steps for both ZK and KRaft. * Spotchecked the Javadocs. I have also noticed that the doc is

Re: [VOTE] 3.3.0 RC2

Thanks for running this, David! I've verified the signatures, looked at the docs, and run the quickstart (ZK and KRaft). I also ran the unit tests, as well as all the tests for Streams locally. The docs look a little malformed (the "collapse/expand" button floats over the text, the collapsed

Re: [kafka-clients] Re: [VOTE] 3.3.0 RC2

Happy Monday, everyone! I've uploaded the 3.3 docs to the website to make that part of the release validation easier https://kafka.apache.org/33/documentation.html These docs are not referenced by the top level docs page, so they can only be accessed directly via the "33" url above. I'd like to

in case of disk failure,why not recover from middle position of the log file

can we write the byte position of .log 、.index file to a position-checkpoint file, and recover from the position to rebuild the index files?

Out of order messages when kafka streams application catches up

Hi group, I wrote a simple kafka streams application with topology such as below: builder.addStateStore( > Stores.keyValueStoreBuilder( > Stores.persistentKeyValueStore("STORE"), > Serdes.String(), Serdes.String()) > .withLoggingEnabled(storeConfig))|