Tomasz you'll need to upgrade the kafka Streams dependency to 3.0 (or above)
to get the fix that John mentioned before -- this behavior is
known/expected on
earlier versions such as 2.8.1 as you are using
On Tue, Nov 15, 2022 at 2:21 AM Tomasz Gac
wrote:
> Hi John,
>
> I've reviewed the test
Hi John,
I've reviewed the test you sent and it seems to be correct, but it may not
reproduce our setup.
We are using Java 8, kafka-client 2.8.1 with kafka streams version 2.8.1
against the kafka broker version 2.1.1. We are running it as an OSGI bundle
with dependencies packaged within the
Hi again, Tomasz,
Your issue is really bugging me, since I'm pretty sure it shouldn't be
happening.
I went ahead and added an integration test with your exact scenario, as I
understand it: https://github.com/apache/kafka/pull/12706
The test passes for me.
Do you think you can check it out
Hi Tomasz,
Thanks for trying that out. It’s not the way I’d expect it to work. I don’t
remember if there were any follow-up bugs that have been solved in subsequent
releases. Just as a long shot, perhaps you can try it on the latest release
(3.3.0)?
Otherwise, I think the best path forward
I upgraded to kafka streams 3.0.0 with positive task.max.idle.ms and it did
not help.
When lag is large, the application still consumes data batches without
interleaving.
wt., 27 wrz 2022 o 05:51 John Roesler napisał(a):
> Hi Tomasz,
>
> Thanks for asking. This sounds like the situation that
Hi Tomasz,
Thanks for asking. This sounds like the situation that we fixed in Apache Kafka
3.0, with KIP-695
(https://cwiki.apache.org/confluence/display/KAFKA/KIP-695%3A+Further+Improve+Kafka+Streams+Timestamp+Synchronization).
Can you try upgrading and let us know if this fixes the problem?
Hi group,
I wrote a simple kafka streams application with topology such as below:
builder.addStateStore(
> Stores.keyValueStoreBuilder(
> Stores.persistentKeyValueStore("STORE"),
> Serdes.String(), Serdes.String())
> .withLoggingEnabled(storeConfig))|
