Re: [DISCUSS] KIP-1059: Enable the Producer flush() method to clear the latest send() error

2024-06-19 Thread Matthias J. Sax
Thanks for the KIP Alieh. I actually like the KIP as-is, but think Arthem raises very good points... Seems we have four options on how to move forward? 1. add config to allow "silent error clearance" as the KIP proposes 2. change flush() to clear error and let it throw 3. add new

[jira] [Assigned] (KAFKA-16508) Infinte loop if output topic does not exisit

2024-06-18 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax reassigned KAFKA-16508: --- Assignee: Alieh Saeedi > Infinte loop if output topic does not exi

[jira] [Updated] (KAFKA-16994) Flaky Test SlidingWindowedKStreamIntegrationTest.shouldRestoreAfterJoinRestart

2024-06-18 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-16994: Attachment: 5owo5xbyzjnao

[jira] [Created] (KAFKA-16994) Flaky Test SlidingWindowedKStreamIntegrationTest.shouldRestoreAfterJoinRestart

2024-06-18 Thread Matthias J. Sax (Jira)
Matthias J. Sax created KAFKA-16994: --- Summary: Flaky Test SlidingWindowedKStreamIntegrationTest.shouldRestoreAfterJoinRestart Key: KAFKA-16994 URL: https://issues.apache.org/jira/browse/KAFKA-16994

[jira] [Created] (KAFKA-16994) Flaky Test SlidingWindowedKStreamIntegrationTest.shouldRestoreAfterJoinRestart

2024-06-18 Thread Matthias J. Sax (Jira)
Matthias J. Sax created KAFKA-16994: --- Summary: Flaky Test SlidingWindowedKStreamIntegrationTest.shouldRestoreAfterJoinRestart Key: KAFKA-16994 URL: https://issues.apache.org/jira/browse/KAFKA-16994

[jira] [Created] (KAFKA-16993) Flaky test RestoreIntegrationTest.shouldInvokeUserDefinedGlobalStateRestoreListener.shouldInvokeUserDefinedGlobalStateRestoreListener()

2024-06-18 Thread Matthias J. Sax (Jira)
Matthias J. Sax created KAFKA-16993: --- Summary: Flaky test RestoreIntegrationTest.shouldInvokeUserDefinedGlobalStateRestoreListener.shouldInvokeUserDefinedGlobalStateRestoreListener() Key: KAFKA-16993 URL: https

[jira] [Created] (KAFKA-16993) Flaky test RestoreIntegrationTest.shouldInvokeUserDefinedGlobalStateRestoreListener.shouldInvokeUserDefinedGlobalStateRestoreListener()

2024-06-18 Thread Matthias J. Sax (Jira)
Matthias J. Sax created KAFKA-16993: --- Summary: Flaky test RestoreIntegrationTest.shouldInvokeUserDefinedGlobalStateRestoreListener.shouldInvokeUserDefinedGlobalStateRestoreListener() Key: KAFKA-16993 URL: https

[jira] [Updated] (KAFKA-16993) Flaky test RestoreIntegrationTest.shouldInvokeUserDefinedGlobalStateRestoreListener.shouldInvokeUserDefinedGlobalStateRestoreListener()

2024-06-18 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-16993: Attachment: 6u4a4e27e2oh2-org.apache.kafka.streams.integration.RestoreIntegrationTest

[jira] [Resolved] (KAFKA-16992) Flaky Test org.apache.kafka.streams.integration.EOSUncleanShutdownIntegrationTest.shouldWorkWithUncleanShutdownWipeOutStateStore[exactly_once_v2]

2024-06-18 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-16992. - Resolution: Duplicate > Flaky T

[jira] [Resolved] (KAFKA-16992) Flaky Test org.apache.kafka.streams.integration.EOSUncleanShutdownIntegrationTest.shouldWorkWithUncleanShutdownWipeOutStateStore[exactly_once_v2]

2024-06-18 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-16992. - Resolution: Duplicate > Flaky T

[jira] [Created] (KAFKA-16992) Flaky Test org.apache.kafka.streams.integration.EOSUncleanShutdownIntegrationTest.shouldWorkWithUncleanShutdownWipeOutStateStore[exactly_once_v2]

2024-06-18 Thread Matthias J. Sax (Jira)
Matthias J. Sax created KAFKA-16992: --- Summary: Flaky Test org.apache.kafka.streams.integration.EOSUncleanShutdownIntegrationTest.shouldWorkWithUncleanShutdownWipeOutStateStore[exactly_once_v2] Key: KAFKA-16992

[jira] [Updated] (KAFKA-16992) Flaky Test org.apache.kafka.streams.integration.EOSUncleanShutdownIntegrationTest.shouldWorkWithUncleanShutdownWipeOutStateStore[exactly_once_v2]

2024-06-18 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-16992: Attachment: 6u4a4e27e2oh2

[jira] [Created] (KAFKA-16992) Flaky Test org.apache.kafka.streams.integration.EOSUncleanShutdownIntegrationTest.shouldWorkWithUncleanShutdownWipeOutStateStore[exactly_once_v2]

2024-06-18 Thread Matthias J. Sax (Jira)
Matthias J. Sax created KAFKA-16992: --- Summary: Flaky Test org.apache.kafka.streams.integration.EOSUncleanShutdownIntegrationTest.shouldWorkWithUncleanShutdownWipeOutStateStore[exactly_once_v2] Key: KAFKA-16992

[jira] [Created] (KAFKA-16991) Flaky Test org.apache.kafka.streams.integration.PurgeRepartitionTopicIntegrationTest.shouldRestoreState

2024-06-18 Thread Matthias J. Sax (Jira)
Matthias J. Sax created KAFKA-16991: --- Summary: Flaky Test org.apache.kafka.streams.integration.PurgeRepartitionTopicIntegrationTest.shouldRestoreState Key: KAFKA-16991 URL: https://issues.apache.org/jira/browse

[jira] [Updated] (KAFKA-16991) Flaky Test org.apache.kafka.streams.integration.PurgeRepartitionTopicIntegrationTest.shouldRestoreState

2024-06-18 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-16991: Attachment: 5owo5xbyzjnao

[jira] [Created] (KAFKA-16991) Flaky Test org.apache.kafka.streams.integration.PurgeRepartitionTopicIntegrationTest.shouldRestoreState

2024-06-18 Thread Matthias J. Sax (Jira)
Matthias J. Sax created KAFKA-16991: --- Summary: Flaky Test org.apache.kafka.streams.integration.PurgeRepartitionTopicIntegrationTest.shouldRestoreState Key: KAFKA-16991 URL: https://issues.apache.org/jira/browse

Re: [VOTE] KIP-1038: Add Custom Error Handler to Producer

2024-06-17 Thread Matthias J. Sax
I just replied to the DISCUSS thread, proposing to DISCARD this KIP in favor of a different solution to the problem. -Matthias On 5/20/24 9:27 AM, Kirk True wrote: +1 (non-binding) Thanks Alieh! On May 20, 2024, at 6:00 AM, Walker Carlson wrote: Hey Alieh, Thanks for the KIP. +1

Re: [DISCUSS] KIP-1038: Add Custom Error Handler to Producer

2024-06-17 Thread Matthias J. Sax
.apache.org/37/javadoc/org/apache/kafka/connect/mirror/DefaultReplicationPolicy.html#INTERNAL_TOPIC_SEPARATOR_ENABLED_CONFIG Cheers, Chris On Wed, May 8, 2024 at 12:37 AM Matthias J. Sax < mj...@apache.org wrote: Very interesting discussion. Seems a central point is the question ab

Re: [DISCUSS] Apache Kafka 3.9.0 release

2024-06-17 Thread Matthias J. Sax
In general I prefer to stick with the original time frame, but I believe an additional month would be good for KIP-848. Maybe we can cut down 2 weeks for the 4.1 and 4.2 releases each, to make up for the time? Not a must; just an idea. We can also just accept a one-time shift of the release

Re: [DISCUSS] Apache Kafka 3.8.0 release

2024-06-17 Thread Matthias J. Sax
are optional in some sense and can be descoped if time runs out. For example, we can drop support for JDK 8 without immediately refactoring everything that could benefit from the improvements in JDK9+. best, Colin On Fri, Jun 14, 2024, at 15:37, Matthias J. Sax wrote: That's my understanding, and I

[jira] [Commented] (KAFKA-16960) StreamsUpgradeTest system tests fail in v3.7.1 RC1

2024-06-14 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17855167#comment-17855167 ] Matthias J. Sax commented on KAFKA-16960: - I applied Justine's patch locally and could run

Re: [VOTE] 3.7.1 RC1

2024-06-14 Thread Matthias J. Sax
Replied on https://issues.apache.org/jira/browse/KAFKA-16960 On 6/14/24 6:05 AM, Luke Chen wrote: Hi all, After running system tests, here are failing tests: 1. kafkatest.tests.core.upgrade_test failed at lz4 and snappy tests: KAFKA-16962 2.

[jira] [Comment Edited] (KAFKA-16960) StreamsUpgradeTest system tests fail in v3.7.1 RC1

2024-06-14 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17855162#comment-17855162 ] Matthias J. Sax edited comment on KAFKA-16960 at 6/15/24 1:13 AM: -- I

[jira] [Commented] (KAFKA-16960) StreamsUpgradeTest system tests fail in v3.7.1 RC1

2024-06-14 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17855162#comment-17855162 ] Matthias J. Sax commented on KAFKA-16960: - I looked into the test run and found {code:java

Re: [DISCUSS] Apache Kafka 3.9.0 release

2024-06-14 Thread Matthias J. Sax
+1 Btw: I just looked into Jira, and we have 90 tickets with "fixed version" set to 4.0.0. I would assume that most of them need to be updated to 3.9.0? https://issues.apache.org/jira/browse/KAFKA-16924?jql=project%20%3D%20KAFKA%20AND%20fixVersion%20%3D%204.0.0 For anybody who has context

Re: [DISCUSS] KIP-1056: Remove `default.` prefix for exception handler StreamsConfig

2024-06-14 Thread Matthias J. Sax
he new one is not set. If bothare set, the new one wins and we just log a WARN that the old one isignored in favor of the new one. -- It might be best to stick theestablished pattern?* Agree, we should follow the same pattern. Updated kip. Thanks, Murali On Fri, Jun 14, 2024 at 3:12 AM Matthias J.

Re: [DISCUSS] Apache Kafka 3.8.0 release

2024-06-14 Thread Matthias J. Sax
That's my understanding, and I would advocate strongly to keep the 4.0 release schedule as planed originally. The 3.9 one should really be an additional "out of schedule" release not impacting any other releases. -Matthias On 6/14/24 1:29 PM, David Jacot wrote: The plan sounds good to me.

Re: [QUESTION] What to do about conflicted KIP numbers?

2024-06-14 Thread Matthias J. Sax
I don't think that there is an official guideline. Personally, I would suggest that the corresponding KIP owners agree who is keeping the conflicting number, and how is changing it. For the ones changing the number, I would propose to restart a new DISCUSS thread using the new number to

[jira] [Updated] (KAFKA-16965) Add a "root cause" exception as a nested exception to TimeoutException for Producer

2024-06-14 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-16965: Component/s: producer > Add a "root cause" exception as a nes

Re: [DISCUSS] KIP-1056: Remove `default.` prefix for exception handler StreamsConfig

2024-06-13 Thread Matthias J. Sax
nge. Similarly in "Test Plan" section Updated kip. 102: The "Deprecation" section should explain the behavior if both, old and new configs, are set. Updated kip. I think a ConfigException has to be thrown here if both configs are set. Thanks, Murali On Thu, Jun 13, 20

Re: [DISCUSS] KIP-1052: Align the naming convention for config and default variables in *Config classes

2024-06-13 Thread Matthias J. Sax
Might be good to restart a new discuss thread using the new KIP-1035 number to split both threads? I added the KIP to the table in the wiki page in the mean time. In Kafka Streams we did rename config names in the past in the exact same way as proposed: deprecate the old config, and add the

[jira] [Resolved] (KAFKA-16001) Migrate ConsumerNetworkThreadTest away from ConsumerTestBuilder

2024-06-13 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-16001. - Resolution: Fixed > Migrate ConsumerNetworkThreadTest away from ConsumerTestBuil

[jira] [Resolved] (KAFKA-16001) Migrate ConsumerNetworkThreadTest away from ConsumerTestBuilder

2024-06-13 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-16001. - Resolution: Fixed > Migrate ConsumerNetworkThreadTest away from ConsumerTestBuil

[jira] [Resolved] (KAFKA-13298) Improve documentation on EOS KStream requirements

2024-06-13 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-13298. - Fix Version/s: 3.1.0 Assignee: Andy Chambers Resolution: Fixed

[jira] [Updated] (KAFKA-7371) Finally deprecate org.apache.kafka.common.serialization.ExtendedSerializer

2024-06-13 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-7371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-7371: --- Labels: beginner needs-kip newbie (was: needs-kip) > Finally deprec

[jira] [Commented] (KAFKA-16263) Add Kafka Streams docs about available listeners/callback

2024-06-13 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16263?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17854821#comment-17854821 ] Matthias J. Sax commented on KAFKA-16263: - [~brandboat] [~w4lt] – any updates on this ticket

[jira] [Commented] (KAFKA-16262) Add IQv2 to Kafka Streams documentation

2024-06-13 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16262?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17854822#comment-17854822 ] Matthias J. Sax commented on KAFKA-16262: - [~supremvanam] – Any updates on this ticket? >

[jira] [Resolved] (KAFKA-13298) Improve documentation on EOS KStream requirements

2024-06-13 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-13298. - Fix Version/s: 3.1.0 Assignee: Andy Chambers Resolution: Fixed

Re: [DISCUSS] KIP-655: Add deduplication processor in kafka-streams

2024-06-12 Thread Matthias J. Sax
, and second map to get back the initial key). Second map may imply a second repartitioning. However, if we do a per-task deduplication, the user may adapt to his specific use-case. Let me know what you think Ayoub Le mar. 11 juin 2024 à 20:21, Matthias J. Sax a écrit : Thanks Sebastien, that

Re: Subscribe for discussion on Kafka® development

2024-06-12 Thread Matthias J. Sax
This is self service. Please follow the instructions from the web page: https://kafka.apache.org/contact -Matthias On 6/11/24 9:38 AM, Punsak Incham wrote: I want to subscribe for discussion on Kafka® development. Best regards, A black and blue logo Description automatically generated

Re: [VOTE] KIP-1035: StateStore managed changelog offsets

2024-06-12 Thread Matthias J. Sax
Thanks Nick. +1 (binding) Looking forward to get this all merged! -Matthias On 6/12/24 9:36 AM, Nick Telford wrote: Hi everyone, I'd like to call a vote on KIP-1035[1]. Regards, Nick 1: https://cwiki.apache.org/confluence/display/KAFKA/KIP-1035%3A+StateStore+managed+changelog+offsets

Re: [VOTE] KIP-1049: Add config log.summary.interval.ms to Kafka Streams

2024-06-12 Thread Matthias J. Sax
+1 (binding) On 6/11/24 1:17 PM, Sophie Blee-Goldman wrote: +1 (binding) Thanks for the KIP! On Tue, Jun 11, 2024 at 5:37 AM jiang dou wrote: HI I would like to start a vote for KIP-1049: Add config log.summary.interval.ms to Kafka Streams KIP:

Re: [DISCUSS] KIP-1027 Add MockFixedKeyProcessorContext

2024-06-12 Thread Matthias J. Sax
Matthias J. Sax wrote: Shaswhat, any updates on this KIP? -- I still think that recommending to use `InternalFixedKeyRecordFactory` is not the best way to write test code. Changing `FixedKeyRecord` constructor (as I mentioned in my last email) might not be a good solution either. Maybe a cleaner

Re: [DISCUSS] KIP-1056: Remove `default.` prefix for exception handler StreamsConfig

2024-06-12 Thread Matthias J. Sax
the experts in this case :) Thanks, Greg On Mon, Jun 10, 2024 at 3:47 PM Matthias J. Sax wrote: Thanks for the KIP Murali, Overall LGTM. A few comments. 100: Config names are part of the public interface, and the KIP should not say "none" in this section, but call out which configs are

[jira] [Resolved] (KAFKA-13561) Consider deprecating `StreamsBuilder#build(props)` function

2024-06-12 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-13561. - Resolution: Duplicate > Consider deprecating `StreamsBuilder#build(props)` funct

[jira] [Resolved] (KAFKA-13561) Consider deprecating `StreamsBuilder#build(props)` function

2024-06-12 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-13561. - Resolution: Duplicate > Consider deprecating `StreamsBuilder#build(props)` funct

[jira] [Commented] (KAFKA-16945) Cleanup StreamsBuilder and TopologyConfig

2024-06-12 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17854578#comment-17854578 ] Matthias J. Sax commented on KAFKA-16945: - I did not look... :P Found https://issues.apache.org

[jira] [Commented] (KAFKA-16925) stream-table join does not immediately forward expired records on restart

2024-06-12 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17854577#comment-17854577 ] Matthias J. Sax commented on KAFKA-16925: - {quote}My understanding is that the processor here

[jira] [Created] (KAFKA-16945) Cleanup StreamsBuilder and TopologyConfig

2024-06-12 Thread Matthias J. Sax (Jira)
Matthias J. Sax created KAFKA-16945: --- Summary: Cleanup StreamsBuilder and TopologyConfig Key: KAFKA-16945 URL: https://issues.apache.org/jira/browse/KAFKA-16945 Project: Kafka Issue Type

[jira] [Created] (KAFKA-16945) Cleanup StreamsBuilder and TopologyConfig

2024-06-12 Thread Matthias J. Sax (Jira)
Matthias J. Sax created KAFKA-16945: --- Summary: Cleanup StreamsBuilder and TopologyConfig Key: KAFKA-16945 URL: https://issues.apache.org/jira/browse/KAFKA-16945 Project: Kafka Issue Type

[jira] [Resolved] (KAFKA-15600) KIP-990: Capability to PAUSE Tasks on DeserializationException

2024-06-11 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-15600. - Resolution: Won't Fix > KIP-990: Capability to PAUSE Tasks on DeserializationExcept

[jira] [Resolved] (KAFKA-15600) KIP-990: Capability to PAUSE Tasks on DeserializationException

2024-06-11 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-15600. - Resolution: Won't Fix > KIP-990: Capability to PAUSE Tasks on DeserializationExcept

[jira] [Updated] (KAFKA-8088) Deprecate `WindowStoreIterator` interface

2024-06-11 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-8088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-8088: --- Fix Version/s: (was: 4.0.0) > Deprecate `WindowStoreIterator` interf

[jira] [Commented] (KAFKA-16925) stream-table join does not immediately forward expired records on restart

2024-06-11 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17854205#comment-17854205 ] Matthias J. Sax commented on KAFKA-16925: - Yes, but it's tracked on a per-task basis, and thus

Re: [DISCUSS] KIP-655: Add deduplication processor in kafka-streams

2024-06-11 Thread Matthias J. Sax
e detected. This is why I would have created two different methods, as is done for GroupBy: deduplicateByKey(...) deduplicate(...) If deduplicateByKey is used, the input stream does not need to be repartitioned. thanks Sébastien De : Matthias J. Sax Envoyé : mar

Re: [DISCUSS] KIP-1027 Add MockFixedKeyProcessorContext

2024-06-10 Thread Matthias J. Sax
, it would become a non-user-facing / internal change to the "factory" we provide. -Matthias On 5/22/24 12:02 AM, Matthias J. Sax wrote: I was not aware of `InternalFixedKeyRecordFactory`. As the name indicates, it's considered an internal class, so not sure if we should recommend to u

Re: [DISCUSS] KIP-1049: Add config log.summary.interval.ms to Kafka Streams

2024-06-10 Thread Matthias J. Sax
Thanks for updating the KIP. Overall LGTM. However, "rejected alternatives" still says: add a new configuration log.summary.interval.ms to control the output interval of summary log This seems not to be rejected, but what the KIP actually proposes and should be removed? I think you can

Re: [DISCUSS] KIP-655: Add deduplication processor in kafka-streams

2024-06-10 Thread Matthias J. Sax
be up to the user to choose any deduplicationInterval that may sufficiently cover all his late data. What do you think ? Thanks, Ayoub Le mar. 4 juin 2024 à 23:58, Matthias J. Sax a écrit : Ayoub, thanks for resurrecting this KIP. I think a built-in de-duplication operator will be ver

Re: [DISCUSS] KIP-1050: Consistent error handling for Transactions

2024-06-10 Thread Matthias J. Sax
Thanks for this KIP. Great to see it. I would assume it will make KIP-691 unnecessary? I don't think I fully understand the proposal yet. It's clear, that you propose to add new sub-classed to group existing exceptions. But it's not clear to me, which of the existing exceptions (which

Re: [DISCUSS] KIP-1056: Remove `default.` prefix for exception handler StreamsConfig

2024-06-10 Thread Matthias J. Sax
Thanks for the KIP Murali, Overall LGTM. A few comments. 100: Config names are part of the public interface, and the KIP should not say "none" in this section, but call out which configs are deprecated and which ones are newly added. 101: Nit. In "Propose Changes" there is the template

Re: [DISCUSS] KIP-1035: StateStore managed changelog offsets

2024-06-10 Thread Matthias J. Sax
ase. -- Cheers, Nick On Tue, 4 Jun 2024 at 20:34, Matthias J. Sax wrote: Nick, Thanks a lot for updating the KIP. I made a pass over it. Overall LGTM. A few nits and some more minor questions: 200: nit (Javadocs for `StateStore.managesOffsets()`): This is highly recommended, if possible, t

[jira] [Resolved] (KAFKA-14567) Kafka Streams crashes after ProducerFencedException

2024-06-10 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-14567. - Assignee: (was: Kirk True) Resolution: Fixed Not 100% sure either, but I feel

[jira] [Resolved] (KAFKA-14567) Kafka Streams crashes after ProducerFencedException

2024-06-10 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-14567. - Assignee: (was: Kirk True) Resolution: Fixed Not 100% sure either, but I feel

[jira] [Commented] (KAFKA-16925) stream-table join does not immediately forward expired records on restart

2024-06-10 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17853815#comment-17853815 ] Matthias J. Sax commented on KAFKA-16925: - Thanks for filing this ticket – it's a know problem

[jira] [Commented] (KAFKA-16863) Consider removing `default.` prefix for exception handler config

2024-06-07 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17853293#comment-17853293 ] Matthias J. Sax commented on KAFKA-16863: - Yes it needs a KIP as the label "needs-kip"

[jira] [Updated] (KAFKA-16900) kafka-producer-perf-test reports error when using transaction.

2024-06-07 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-16900: Affects Version/s: (was: 2.9) > kafka-producer-perf-test reports error when us

[jira] [Updated] (KAFKA-12651) Connect should register REST extensions before REST resources

2024-06-07 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-12651: Affects Version/s: (was: 2.9) > Connect should register REST extensions before R

[jira] [Updated] (KAFKA-12383) Get RaftClusterTest.java and other KIP-500 junit tests working

2024-06-07 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-12383: Affects Version/s: (was: 2.9) > Get RaftClusterTest.java and other KIP-500 ju

[jira] [Updated] (KAFKA-14187) kafka-features.sh: add support for --metadata

2024-06-07 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-14187: Affects Version/s: (was: 3.3) > kafka-features.sh: add support for --metad

[jira] [Updated] (KAFKA-14200) kafka-features.sh must exit with non-zero error code on error

2024-06-07 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-14200: Affects Version/s: (was: 3.3) > kafka-features.sh must exit with non-zero error c

[jira] [Updated] (KAFKA-14197) Kraft broker fails to startup after topic creation failure

2024-06-07 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-14197: Affects Version/s: 3.3.0 (was: 3.3) > Kraft broker fa

[jira] [Updated] (KAFKA-14195) Fix KRaft AlterConfig policy usage for Legacy/Full case

2024-06-07 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-14195: Affects Version/s: 3.3.0 (was: 3.3) > Fix KRaft AlterCon

[jira] [Updated] (KAFKA-14051) KRaft remote controllers do not create metrics reporters

2024-06-07 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-14051: Affects Version/s: 3.3.0 (was: 3.3) > KRaft remote controll

[jira] [Updated] (KAFKA-14214) StandardAuthorizer may transiently process ACLs out of write order

2024-06-07 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-14214: Affects Version/s: 3.3.0 (was: 3.3) > StandardAuthorizer

[jira] [Updated] (KAFKA-14328) KafkaAdminClient should be Changing the exception level When an exception occurs

2024-06-07 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-14328: Affects Version/s: 3.3.0 (was: 3.3) > KafkaAdminClient sho

[jira] [Updated] (KAFKA-16300) Wrong documentation for producer config retries

2024-06-07 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-16300: Affects Version/s: 3.3.0 (was: 3.3) > Wrong documentat

[jira] [Updated] (KAFKA-15063) Throttle number of active PIDs

2024-06-07 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-15063: Affects Version/s: (was: 3.3) > Throttle number of active P

[jira] [Updated] (KAFKA-14250) Exception during normal operation in MirrorSourceTask causes the task to fail instead of shutting down gracefully

2024-06-07 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-14250: Affects Version/s: 3.3.0 (was: 3.3) > Exception during nor

[jira] [Updated] (KAFKA-14571) ZkMetadataCache.getClusterMetadata is missing rack information in aliveNodes

2024-06-07 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-14571: Affects Version/s: 3.3.0 (was: 3.3

[jira] [Updated] (KAFKA-13755) Broker heartbeat event should have deadline

2024-06-07 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-13755: Fix Version/s: 3.3.0 (was: 3.3) > Broker heartbeat event sho

[jira] [Updated] (KAFKA-13902) Support online metadata.version upgrades for KIP-704 in KRaft

2024-06-07 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-13902: Fix Version/s: 3.3.0 (was: 3.3) > Support online metadata.vers

[jira] [Updated] (KAFKA-14275) KRaft Controllers should crash after failing to apply any metadata record

2024-06-07 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-14275: Fix Version/s: 3.6.2 3.7.0 3.5.2

[jira] [Updated] (KAFKA-14062) OAuth client token refresh fails with SASL extensions

2024-06-07 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-14062: Fix Version/s: 3.3.0 (was: 3.3) > OAuth client token refresh fa

[jira] [Updated] (KAFKA-14062) OAuth client token refresh fails with SASL extensions

2024-06-07 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-14062: Affects Version/s: (was: 3.3) > OAuth client token refresh fails with SASL extensi

[jira] [Updated] (KAFKA-13850) kafka-metadata-shell is missing some record types

2024-06-07 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-13850: Fix Version/s: 3.3.0 (was: 3.3) > kafka-metadata-shell is miss

[jira] [Updated] (KAFKA-13943) Fix flaky test QuorumControllerTest.testMissingInMemorySnapshot()

2024-06-07 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-13943: Fix Version/s: (was: 3.3) > Fix flaky t

[jira] [Updated] (KAFKA-13858) Kraft should not shutdown metadata listener until controller shutdown is finished

2024-06-07 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-13858: Fix Version/s: 3.3.0 (was: 3.3) > Kraft should not shutd

[jira] [Updated] (KAFKA-13649) StandardAuthorizer should not finish loading until it is ready

2024-06-07 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-13649: Fix Version/s: 3.3.0 (was: 3.3) > StandardAuthorizer sho

[jira] [Updated] (KAFKA-14217) app-reset-tool.html should remove reference to --zookeeper flag that no longer exists

2024-06-07 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-14217: Fix Version/s: 3.3.0 (was: 3.3) > app-reset-tool.html sho

[jira] [Updated] (KAFKA-14217) app-reset-tool.html should remove reference to --zookeeper flag that no longer exists

2024-06-07 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-14217: Affects Version/s: (was: 3.3) > app-reset-tool.html should remove refere

[jira] [Updated] (KAFKA-14215) KRaft forwarded requests have no quota enforcement

2024-06-07 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-14215: Fix Version/s: (was: 3.3) > KRaft forwarded requests have no quota enforcem

[jira] [Updated] (KAFKA-14216) Remove ZK reference from org.apache.kafka.server.quota.ClientQuotaCallback javadoc

2024-06-07 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-14216: Affects Version/s: (was: 3.3) > Remove ZK reference f

[jira] [Updated] (KAFKA-14216) Remove ZK reference from org.apache.kafka.server.quota.ClientQuotaCallback javadoc

2024-06-07 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-14216: Fix Version/s: 3.3.0 (was: 3.3) > Remove ZK reference f

[jira] [Updated] (KAFKA-14170) KRaft Controller: Possible NPE when we remove topics with any offline partitions in the cluster

2024-06-07 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-14170: Fix Version/s: 3.3.0 (was: 3.3) > KRaft Controller: Possible

[jira] [Updated] (KAFKA-14170) KRaft Controller: Possible NPE when we remove topics with any offline partitions in the cluster

2024-06-07 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-14170: Affects Version/s: 3.3.0 (was: 3.3) > KRaft Control

[jira] [Updated] (KAFKA-14215) KRaft forwarded requests have no quota enforcement

2024-06-07 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-14215: Affects Version/s: (was: 3.3) > KRaft forwarded requests have no quota enforcem

[jira] [Updated] (KAFKA-16692) InvalidRequestException: ADD_PARTITIONS_TO_TXN with version 4 which is not enabled when upgrading from kafka 3.5 to 3.6

2024-06-07 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-16692: Affects Version/s: 3.8.0 (was: 3.8) > InvalidRequestExcept

[jira] [Resolved] (KAFKA-16911) Kafka Streams topology optimization docs incomplete

2024-06-07 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-16911. - Fix Version/s: 3.8.0 Resolution: Fixed > Kafka Streams topology optimizat

[jira] [Resolved] (KAFKA-16911) Kafka Streams topology optimization docs incomplete

2024-06-07 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-16911. - Fix Version/s: 3.8.0 Resolution: Fixed > Kafka Streams topology optimizat

[jira] [Assigned] (KAFKA-16911) Kafka Streams topology optimization docs incomplete

2024-06-07 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax reassigned KAFKA-16911: --- Assignee: James Galasyn > Kafka Streams topology optimization docs incompl

  1   2   3   4   5   6   7   8   9   10   >