[jira] [Resolved] (KAFKA-12549) Allow state stores to opt-in transactional support

2024-02-22 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-12549. - Resolution: Duplicate Closing this ticket in favor of K14412. > Allow state stores

[jira] [Resolved] (KAFKA-12549) Allow state stores to opt-in transactional support

2024-02-22 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-12549. - Resolution: Duplicate Closing this ticket in favor of K14412. > Allow state stores

Re: [DISCUSS] KIP-844: Transactional State Stores

2024-02-22 Thread Matthias J. Sax
To close the loop on this thread. KIP-892 was accepted and is currently implemented. Thus I'll go a head and mark this KIP a discarded. Thanks a lot Alex for spending so much time on this very important feature! Without your ground work, we would not have KIP-892 and your contributions are not

[jira] [Updated] (KAFKA-16302) Builds failing due to streams test execution failures

2024-02-22 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-16302: Component/s: streams unit tests > Builds failing due to streams t

[jira] [Assigned] (KAFKA-16302) Builds failing due to streams test execution failures

2024-02-22 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax reassigned KAFKA-16302: --- Assignee: Justine Olshan > Builds failing due to streams test execution failu

Re: [DISCUSS] KIP-1020: Deprecate `window.size.ms` in `StreamsConfig`

2024-02-21 Thread Matthias J. Sax
Thanks for the KIP. Sounds like a nice cleanup. window.size.ms is not a true KafkaStreams config, and results in an error when set from a KStreams application What error? Given that the configs is used by `TimeWindowedDeserializer` I am wondering if we should additionally add public cla

Re: GlobalKTable with RocksDB - queries before state RUNNING?

2024-02-21 Thread Matthias J. Sax
Filed https://issues.apache.org/jira/browse/KAFKA-16295 Also, for global store support, we do have a ticket already: https://issues.apache.org/jira/browse/KAFKA-13523 It's actually a little bit more involved due to position tracking... I guess we might need a KIP to fix this. And yes: if an

[jira] [Created] (KAFKA-16295) Align RocksDB and in-memory store inti() sequence

2024-02-21 Thread Matthias J. Sax (Jira)
Matthias J. Sax created KAFKA-16295: --- Summary: Align RocksDB and in-memory store inti() sequence Key: KAFKA-16295 URL: https://issues.apache.org/jira/browse/KAFKA-16295 Project: Kafka

[jira] [Created] (KAFKA-16295) Align RocksDB and in-memory store inti() sequence

2024-02-21 Thread Matthias J. Sax (Jira)
Matthias J. Sax created KAFKA-16295: --- Summary: Align RocksDB and in-memory store inti() sequence Key: KAFKA-16295 URL: https://issues.apache.org/jira/browse/KAFKA-16295 Project: Kafka

Re: [VOTE] KIP-1019: Expose method to determine Metric Measurability

2024-02-20 Thread Matthias J. Sax
+1 (binding) On 2/20/24 2:55 AM, Manikumar wrote: +1 (binding). Thanks for the KIP. Manikumar On Tue, Feb 20, 2024 at 2:31 PM Andrew Schofield < andrew_schofield_j...@outlook.com> wrote: Hi Apoorv, Thanks for the KIP. +1 (non-binding) Thanks, Andrew On 19 Feb 2024, at 22:31, Apoorv Mitt

[jira] [Updated] (KAFKA-16284) Performance regression in RocksDB

2024-02-20 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-16284: Affects Version/s: 3.8.0 > Performance regression in Rock

[jira] [Created] (KAFKA-16279) Avoid leaking abstractions of `StateStore`

2024-02-19 Thread Matthias J. Sax (Jira)
Matthias J. Sax created KAFKA-16279: --- Summary: Avoid leaking abstractions of `StateStore` Key: KAFKA-16279 URL: https://issues.apache.org/jira/browse/KAFKA-16279 Project: Kafka Issue Type

[jira] [Created] (KAFKA-16279) Avoid leaking abstractions of `StateStore`

2024-02-19 Thread Matthias J. Sax (Jira)
Matthias J. Sax created KAFKA-16279: --- Summary: Avoid leaking abstractions of `StateStore` Key: KAFKA-16279 URL: https://issues.apache.org/jira/browse/KAFKA-16279 Project: Kafka Issue Type

[jira] [Updated] (KAFKA-14049) Relax Non Null Requirement for KStreamGlobalKTable Left Join

2024-02-18 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-14049: Fix Version/s: 3.7.0 > Relax Non Null Requirement for KStreamGlobalKTable Left J

[jira] [Updated] (KAFKA-15143) MockFixedKeyProcessorContext is missing from test-utils

2024-02-16 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-15143: Labels: needs-kip (was: ) > MockFixedKeyProcessorContext is missing from test-ut

[jira] [Assigned] (KAFKA-15143) MockFixedKeyProcessorContext is missing from test-utils

2024-02-16 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax reassigned KAFKA-15143: --- Assignee: Shashwat Pandey > MockFixedKeyProcessorContext is missing from t

Re: [Discuss] KIP-1019: Expose method to determine Metric Measurability

2024-02-16 Thread Matthias J. Sax
Thanks for the KIP. Seems there is not much we need to discuss about it. Feel free to start a VOTE. -Matthias On 2/15/24 7:24 AM, Manikumar wrote: LGTM, Thanks for the KIP. On Thu, Feb 15, 2024 at 8:50 PM Doğuşcan Namal wrote: LGTM thanks for the KIP. +1(non-binding) On Wed, 14 Feb 2024

[jira] [Created] (KAFKA-16263) Add Kafka Streams docs about available listeners/callback

2024-02-15 Thread Matthias J. Sax (Jira)
Matthias J. Sax created KAFKA-16263: --- Summary: Add Kafka Streams docs about available listeners/callback Key: KAFKA-16263 URL: https://issues.apache.org/jira/browse/KAFKA-16263 Project: Kafka

[jira] [Created] (KAFKA-16263) Add Kafka Streams docs about available listeners/callback

2024-02-15 Thread Matthias J. Sax (Jira)
Matthias J. Sax created KAFKA-16263: --- Summary: Add Kafka Streams docs about available listeners/callback Key: KAFKA-16263 URL: https://issues.apache.org/jira/browse/KAFKA-16263 Project: Kafka

[jira] [Created] (KAFKA-16262) Add IQv2 to Kafka Streams documentation

2024-02-15 Thread Matthias J. Sax (Jira)
Matthias J. Sax created KAFKA-16262: --- Summary: Add IQv2 to Kafka Streams documentation Key: KAFKA-16262 URL: https://issues.apache.org/jira/browse/KAFKA-16262 Project: Kafka Issue Type

[jira] [Created] (KAFKA-16262) Add IQv2 to Kafka Streams documentation

2024-02-15 Thread Matthias J. Sax (Jira)
Matthias J. Sax created KAFKA-16262: --- Summary: Add IQv2 to Kafka Streams documentation Key: KAFKA-16262 URL: https://issues.apache.org/jira/browse/KAFKA-16262 Project: Kafka Issue Type

[jira] [Commented] (KAFKA-12317) Relax non-null key requirement for left/outer KStream joins

2024-02-15 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12317?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17817833#comment-17817833 ] Matthias J. Sax commented on KAFKA-12317: - [~aki] – I was just looking

[jira] [Commented] (KAFKA-14049) Relax Non Null Requirement for KStreamGlobalKTable Left Join

2024-02-15 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17817827#comment-17817827 ] Matthias J. Sax commented on KAFKA-14049: - [~aki] does KIP-962 cover

[jira] [Updated] (KAFKA-16260) Remove window.size.ms from StreamsConfig

2024-02-14 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-16260: Component/s: streams > Remove window.size.ms from StreamsCon

[jira] [Updated] (KAFKA-16260) Remove window.size.ms from StreamsConfig

2024-02-14 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-16260: Labels: needs-kip (was: ) > Remove window.size.ms from StreamsCon

[jira] [Assigned] (KAFKA-16260) Remove window.size.ms from StreamsConfig

2024-02-14 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax reassigned KAFKA-16260: --- Assignee: Lucia Cerchie > Remove window.size.ms from StreamsCon

Re: EOS date for Kafka 3.5.1

2024-02-12 Thread Matthias J. Sax
https://cwiki.apache.org/confluence/display/KAFKA/Time+Based+Release+Plan#TimeBasedReleasePlan-WhatIsOurEOLPolicy? On 2/11/24 8:08 PM, Sahil Sharma D wrote: Hi team, Can you please share the EOS date for Kafka Version 3.5.1? Regards, Sahil

[jira] [Resolved] (KAFKA-14957) Default value for state.dir is confusing

2024-02-10 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-14957. - Fix Version/s: 3.8.0 Resolution: Fixed > Default value for state.dir

[jira] [Resolved] (KAFKA-14957) Default value for state.dir is confusing

2024-02-10 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-14957. - Fix Version/s: 3.8.0 Resolution: Fixed > Default value for state.dir

[jira] [Commented] (KAFKA-16241) Kafka Streams hits IllegalStateException trying to recycle a task

2024-02-09 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17816238#comment-17816238 ] Matthias J. Sax commented on KAFKA-16241: - {quote} Detected out-of-order KT

[jira] [Updated] (KAFKA-16241) Kafka Streams hits IllegalStateException trying to recycle a task

2024-02-09 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-16241: Affects Version/s: 3.6.1 > Kafka Streams hits IllegalStateException trying to recycl

[jira] [Updated] (KAFKA-16241) Kafka Streams hits IllegalStateException trying to recycle a task

2024-02-09 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-16241: Attachment: streams-3.zip > Kafka Streams hits IllegalStateException trying to recycl

[jira] [Updated] (KAFKA-16241) Kafka Streams hits IllegalStateException trying to recycle a task

2024-02-09 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-16241: Attachment: streams-2.zip > Kafka Streams hits IllegalStateException trying to recycl

[jira] [Updated] (KAFKA-16241) Kafka Streams hits IllegalStateException trying to recycle a task

2024-02-09 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-16241: Attachment: streams-1.zip > Kafka Streams hits IllegalStateException trying to recycl

[jira] [Created] (KAFKA-16241) Kafka Streams hits IllegalStateException trying to recycle a task

2024-02-09 Thread Matthias J. Sax (Jira)
Matthias J. Sax created KAFKA-16241: --- Summary: Kafka Streams hits IllegalStateException trying to recycle a task Key: KAFKA-16241 URL: https://issues.apache.org/jira/browse/KAFKA-16241 Project

[jira] [Created] (KAFKA-16241) Kafka Streams hits IllegalStateException trying to recycle a task

2024-02-09 Thread Matthias J. Sax (Jira)
Matthias J. Sax created KAFKA-16241: --- Summary: Kafka Streams hits IllegalStateException trying to recycle a task Key: KAFKA-16241 URL: https://issues.apache.org/jira/browse/KAFKA-16241 Project

Re: [DISCUSS] KIP-877: Mechanism for plugins and connectors to register metrics

2024-02-08 Thread Matthias J. Sax
Still need to digest the KIP, but one thing coming to mind: Instead of requiring existing interfaces to implement `Closable`, would it make sense to make `Monitorable extends Closable` to sidestep this issue? -Matthias On 1/25/24 9:03 AM, Mickael Maison wrote: Hi Luke, The reason vary for

Re: Kafka-Streams-Scala for Scala 3

2024-02-08 Thread Matthias J. Sax
e_2.13 in the tests? Cheers, Lucas On Wed, Jan 31, 2024 at 9:20 PM Matthias J. Sax wrote: Thanks for raising this. The `kafka-streams-scala` module seems to be an important feature for Kafka Streams and I am generally in favor of your proposal to add Scala 3 support. However, I am persona

[jira] [Updated] (KAFKA-16237) Kafka-Streams-Scala for Scala 3

2024-02-08 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-16237: Labels: needs-kip (was: ) > Kafka-Streams-Scala for Scal

[jira] [Commented] (KAFKA-16237) Kafka-Streams-Scala for Scala 3

2024-02-08 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16237?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17815763#comment-17815763 ] Matthias J. Sax commented on KAFKA-16237: - Thanks for filing the ticket

[jira] [Assigned] (KAFKA-16237) Kafka-Streams-Scala for Scala 3

2024-02-08 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax reassigned KAFKA-16237: --- Assignee: Matthias Berndt > Kafka-Streams-Scala for Scal

[jira] [Resolved] (KAFKA-16236) Interactive Query v2 does not support Global KTables

2024-02-08 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-16236. - Resolution: Duplicate Thanks for filing this tickets. It's duplicate of

[jira] [Comment Edited] (KAFKA-16236) Interactive Query v2 does not support Global KTables

2024-02-08 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16236?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17815760#comment-17815760 ] Matthias J. Sax edited comment on KAFKA-16236 at 2/8/24 4:5

[jira] [Resolved] (KAFKA-16236) Interactive Query v2 does not support Global KTables

2024-02-08 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-16236. - Resolution: Duplicate Thanks for filing this tickets. It's duplicate of

[jira] [Commented] (KAFKA-14747) FK join should record discarded subscription responses

2024-02-08 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17815759#comment-17815759 ] Matthias J. Sax commented on KAFKA-14747: - It seems [~kma] did never

Re: Re-key by multiple properties without composite key

2024-02-07 Thread Matthias J. Sax
in order to build an aggregate person. There are 14 sub topologies... - measuring the e2e latency shows values around 600ms which seems rather high to me. Does that sound crazy? ;) Best wishes Karsten Am Do., 1. Feb. 2024 um 19:02 Uhr schrieb Matthias J. Sax : I see. You need to ensure that you get

[jira] [Commented] (KAFKA-13292) InvalidPidMappingException: The producer attempted to use a producer id which is not currently assigned to its transactional id

2024-02-07 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17815404#comment-17815404 ] Matthias J. Sax commented on KAFKA-13292: - Sounds like a question about Sp

[jira] [Commented] (KAFKA-12823) Remove Deprecated method KStream#through

2024-02-06 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17815089#comment-17815089 ] Matthias J. Sax commented on KAFKA-12823: - Look for ticket labeled "

[jira] [Updated] (KAFKA-14567) Kafka Streams crashes after ProducerFencedException

2024-02-06 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-14567: Description: Running a Kafka Streams application with EOS-v2. We first see a

[jira] [Resolved] (KAFKA-16221) IllegalStateException from Producer

2024-02-05 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-16221. - Resolution: Fixed > IllegalStateException from Produ

[jira] [Commented] (KAFKA-16221) IllegalStateException from Producer

2024-02-05 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17814437#comment-17814437 ] Matthias J. Sax commented on KAFKA-16221: - Marking this as resolved to 3.7

[jira] [Resolved] (KAFKA-16221) IllegalStateException from Producer

2024-02-05 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-16221. - Resolution: Fixed > IllegalStateException from Produ

[jira] [Updated] (KAFKA-16221) IllegalStateException from Producer

2024-02-05 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-16221: Fix Version/s: 3.7.0 > IllegalStateException from Produ

[jira] [Updated] (KAFKA-16221) IllegalStateException from Producer

2024-02-04 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-16221: Description: https://issues.apache.org/jira/browse/KAFKA-14831 fixed a producer bug about

[jira] [Updated] (KAFKA-16221) IllegalStateException from Producer

2024-02-04 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-16221: Description: https://issues.apache.org/jira/browse/KAFKA-14831 fixed a producer bug about

[jira] [Updated] (KAFKA-16221) IllegalStateException from Producer

2024-02-04 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-16221: Description: https://issues.apache.org/jira/browse/KAFKA-14831 fixed a producer bug about

[jira] [Created] (KAFKA-16221) IllegalStateException from Producer

2024-02-04 Thread Matthias J. Sax (Jira)
Matthias J. Sax created KAFKA-16221: --- Summary: IllegalStateException from Producer Key: KAFKA-16221 URL: https://issues.apache.org/jira/browse/KAFKA-16221 Project: Kafka Issue Type: Bug

[jira] [Created] (KAFKA-16221) IllegalStateException from Producer

2024-02-04 Thread Matthias J. Sax (Jira)
Matthias J. Sax created KAFKA-16221: --- Summary: IllegalStateException from Producer Key: KAFKA-16221 URL: https://issues.apache.org/jira/browse/KAFKA-16221 Project: Kafka Issue Type: Bug

[jira] [Updated] (KAFKA-16217) Transactional producer stuck in IllegalStateException during close

2024-02-01 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-16217: Component/s: producer > Transactional producer stuck in IllegalStateException dur

Re: Re-key by multiple properties without composite key

2024-02-01 Thread Matthias J. Sax
hen using that for three independent re-key-operations is not allowed. Best wishes, Karsten Am Do., 1. Feb. 2024 um 02:16 Uhr schrieb Matthias J. Sax : Thanks for the details. This does make sense. So it seems you can read all topic as table (ie, builder.table("topic") -- no need to

Re: Re-key by multiple properties without composite key

2024-01-31 Thread Matthias J. Sax
is 1 as per Kafka UI, as I've specified no extra configuration for them. Best wishes, Karsten Am Di., 30. Jan. 2024 um 20:03 Uhr schrieb Matthias J. Sax : Both fk1 and fk2 point to the PK of another entity (not shown for brevity, of no relevance to the question). It this two independent FK, or

[jira] [Commented] (KAFKA-12549) Allow state stores to opt-in transactional support

2024-01-31 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17812993#comment-17812993 ] Matthias J. Sax commented on KAFKA-12549: - [~high.lee] – this ticke

Re: Kafka-Streams-Scala for Scala 3

2024-01-31 Thread Matthias J. Sax
Thanks for raising this. The `kafka-streams-scala` module seems to be an important feature for Kafka Streams and I am generally in favor of your proposal to add Scala 3 support. However, I am personally no Scala person and it sounds like quite some overhead. If you are willing to drive and own

Re: What does kafka streams groupBy does internally?

2024-01-30 Thread Matthias J. Sax
Did reply on SO. -Matthias On 1/24/24 2:18 AM, warrior2...@gmail.com wrote: Let's say there's a topic in which chunks of different files are all mixed up represented by a tuple |(FileId, Chunk)|. Chunks of a same file also can be a little out of order. The task is to aggregate all files and

Re: Re-key by multiple properties without composite key

2024-01-30 Thread Matthias J. Sax
Both fk1 and fk2 point to the PK of another entity (not shown for brevity, of no relevance to the question). It this two independent FK, or one two-column FK? Ingesting the topic into a Kafka Streams application, how can I re-key the resulting KTable by both fk1 and fk2? If you read the top

Re: Kafka consumer group crashing and not able to consume once service is up

2024-01-30 Thread Matthias J. Sax
I am a not sure if I can follow completely. From the figures you show, you have a topic with 4 partitions, and 4 consumer groups. Thus, each consumer group should read all 4 partitions, but the figure indicate that each group would read a single partition only? Can you clarify? Are you using

[jira] [Resolved] (KAFKA-10184) Flaky HighAvailabilityTaskAssignorIntegrationTest.shouldScaleOutWithWarmupTasksAndPersistentStores

2024-01-30 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-10184. - Assignee: (was: John Roesler) Resolution: Cannot Reproduce This ticket is

[jira] [Resolved] (KAFKA-10184) Flaky HighAvailabilityTaskAssignorIntegrationTest.shouldScaleOutWithWarmupTasksAndPersistentStores

2024-01-30 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-10184. - Assignee: (was: John Roesler) Resolution: Cannot Reproduce This ticket is

[jira] [Updated] (KAFKA-16017) Checkpointed offset is incorrect when task is revived and restoring

2024-01-29 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-16017: Fix Version/s: 3.5.3 3.4.2 3.6.2 > Checkpoin

[jira] [Updated] (KAFKA-16141) StreamsStandbyTask##test_standby_tasks_rebalanceArguments:{ “metadata_quorum”: “ISOLATED_KRAFT”, “use_new_coordinator”: false} fails consistently in 3.7

2024-01-17 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-16141: Fix Version/s: 3.7.0 > StreamsStandbyTask##test_standby_tasks_rebalanceArgume

Re: [VOTE] 3.7.0 RC2

2024-01-17 Thread Matthias J. Sax
Stan, thanks for driving this all forward! Excellent job. About StreamsStandbyTask - https://issues.apache.org/jira/browse/KAFKA-16141 StreamsUpgradeTest - https://issues.apache.org/jira/browse/KAFKA-16139 For `StreamsUpgradeTest` it was a test setup issue and should be fixed now in trunk an

[jira] [Updated] (KAFKA-16141) StreamsStandbyTask##test_standby_tasks_rebalanceArguments:{ “metadata_quorum”: “ISOLATED_KRAFT”, “use_new_coordinator”: false} fails consistently in 3.7

2024-01-17 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-16141: Component/s: streams > StreamsStandbyTask##test_standby_tasks_rebalanceArgume

[jira] [Updated] (KAFKA-16139) StreamsUpgradeTest fails consistently in 3.7.0

2024-01-17 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-16139: Component/s: streams system tests > StreamsUpgradeTest fa

[jira] [Assigned] (KAFKA-15770) org.apache.kafka.streams.integration.ConsistencyVectorIntegrationTest.shouldHaveSamePositionBoundActiveAndStandBy is flaky

2024-01-17 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax reassigned KAFKA-15770: --- Assignee: Matthias J. Sax

[jira] [Updated] (KAFKA-16123) KStreamKStreamJoinProcessor forwards null records for left/outer joins unconditionally of the join window.

2024-01-17 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-16123: Component/s: streams > KStreamKStreamJoinProcessor forwards null records for left/ou

[jira] [Updated] (KAFKA-16159) Prune excessive logging from Telemetry Reporter

2024-01-17 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-16159: Affects Version/s: 3.7.0 > Prune excessive logging from Telemetry Repor

[jira] [Updated] (KAFKA-16159) Prune excessive logging from Telemetry Reporter

2024-01-17 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-16159: Fix Version/s: (was: 3.8.0) > Prune excessive logging from Telemetry Repor

[jira] [Resolved] (KAFKA-16139) StreamsUpgradeTest fails consistently in 3.7.0

2024-01-17 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-16139. - Fix Version/s: 3.7.0 3.6.1 Resolution: Fixed

[jira] [Resolved] (KAFKA-16139) StreamsUpgradeTest fails consistently in 3.7.0

2024-01-17 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-16139. - Fix Version/s: 3.7.0 3.6.1 Resolution: Fixed

[jira] [Updated] (KAFKA-16141) StreamsStandbyTask##test_standby_tasks_rebalanceArguments:{ “metadata_quorum”: “ISOLATED_KRAFT”, “use_new_coordinator”: false} fails consistently in 3.7

2024-01-17 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-16141: Issue Type: Bug (was: Test) > StreamsStandbyTask##test_standby_tasks_rebalanceArgume

[jira] [Comment Edited] (KAFKA-16141) StreamsStandbyTask##test_standby_tasks_rebalanceArguments:{ “metadata_quorum”: “ISOLATED_KRAFT”, “use_new_coordinator”: false} fails consistently in 3.7

2024-01-17 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17807890#comment-17807890 ] Matthias J. Sax edited comment on KAFKA-16141 at 1/17/24 9:1

[jira] [Created] (KAFKA-16158) Cleanup usage of `TimestampedBytesStore` interface

2024-01-17 Thread Matthias J. Sax (Jira)
Matthias J. Sax created KAFKA-16158: --- Summary: Cleanup usage of `TimestampedBytesStore` interface Key: KAFKA-16158 URL: https://issues.apache.org/jira/browse/KAFKA-16158 Project: Kafka

[jira] [Created] (KAFKA-16158) Cleanup usage of `TimestampedBytesStore` interface

2024-01-17 Thread Matthias J. Sax (Jira)
Matthias J. Sax created KAFKA-16158: --- Summary: Cleanup usage of `TimestampedBytesStore` interface Key: KAFKA-16158 URL: https://issues.apache.org/jira/browse/KAFKA-16158 Project: Kafka

[jira] [Commented] (KAFKA-16141) StreamsStandbyTask##test_standby_tasks_rebalanceArguments:{ “metadata_quorum”: “ISOLATED_KRAFT”, “use_new_coordinator”: false} fails consistently in 3.7

2024-01-17 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17807890#comment-17807890 ] Matthias J. Sax commented on KAFKA-16141: - After discussion with Almog

[jira] [Assigned] (KAFKA-16141) StreamsStandbyTask##test_standby_tasks_rebalanceArguments:{ “metadata_quorum”: “ISOLATED_KRAFT”, “use_new_coordinator”: false} fails consistently in 3.7

2024-01-17 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax reassigned KAFKA-16141: --- Assignee: Matthias J. Sax (was: Almog Gavra) > StreamsStandbyT

Re: [Kafka Streams], Processor API for KTable and KGroupedStream

2024-01-17 Thread Matthias J. Sax
ped stream here ???/* On 2024-Jan-13 01:22, Matthias J. Sax wrote: `KGroupedStream` is just an "intermediate representation" to get a better flow in the DSL. It's not a "top level" abstraction like KStream/KTable. For `KTable` there is `transformValue()` -- there is

[jira] [Commented] (KAFKA-16141) StreamsStandbyTask##test_standby_tasks_rebalanceArguments:{ “metadata_quorum”: “ISOLATED_KRAFT”, “use_new_coordinator”: false} fails consistently in 3.7

2024-01-16 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17807543#comment-17807543 ] Matthias J. Sax commented on KAFKA-16141: - Thanks. I am wondering if the r

[jira] [Commented] (KAFKA-16141) StreamsStandbyTask##test_standby_tasks_rebalanceArguments:{ “metadata_quorum”: “ISOLATED_KRAFT”, “use_new_coordinator”: false} fails consistently in 3.7

2024-01-16 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17807411#comment-17807411 ] Matthias J. Sax commented on KAFKA-16141: - Assigned to [~agavra] and marke

[jira] [Updated] (KAFKA-16141) StreamsStandbyTask##test_standby_tasks_rebalanceArguments:{ “metadata_quorum”: “ISOLATED_KRAFT”, “use_new_coordinator”: false} fails consistently in 3.7

2024-01-16 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-16141: Priority: Blocker (was: Major) > StreamsStandbyT

[jira] [Assigned] (KAFKA-16141) StreamsStandbyTask##test_standby_tasks_rebalanceArguments:{ “metadata_quorum”: “ISOLATED_KRAFT”, “use_new_coordinator”: false} fails consistently in 3.7

2024-01-16 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax reassigned KAFKA-16141: --- Assignee: Almog Gavra > StreamsStandbyTask##test_standby_tasks_rebalanceArgume

Re: [PROPOSAL] Add commercial support page on website

2024-01-12 Thread Matthias J. Sax
François, thanks for starting this initiative. Personally, I don't think it's necessarily harmful for the project to add such a new page, however, I share the same concerns others raised already. I understand your motivation that people had issues finding commercial support, but I am not sur

Re: [PROPOSAL] Add commercial support page on website

2024-01-12 Thread Matthias J. Sax
François, thanks for starting this initiative. Personally, I don't think it's necessarily harmful for the project to add such a new page, however, I share the same concerns others raised already. I understand your motivation that people had issues finding commercial support, but I am not sur

Re: [Kafka Streams], Processor API for KTable and KGroupedStream

2024-01-12 Thread Matthias J. Sax
`KGroupedStream` is just an "intermediate representation" to get a better flow in the DSL. It's not a "top level" abstraction like KStream/KTable. For `KTable` there is `transformValue()` -- there is no `transform()` because keying must be preserved -- if you want to change the keying you ne

Re: [Kafka Streams], Processor API for KTable and KGroupedStream

2024-01-12 Thread Matthias J. Sax
`KGroupedStream` is just an "intermediate representation" to get a better flow in the DSL. It's not a "top level" abstraction like KStream/KTable. For `KTable` there is `transformValue()` -- there is no `transform()` because keying must be preserved -- if you want to change the keying you ne

[jira] [Commented] (KAFKA-16089) Kafka Streams still leaking memory

2024-01-12 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17806217#comment-17806217 ] Matthias J. Sax commented on KAFKA-16089: - Great job! > Kafka Stream

[jira] [Resolved] (KAFKA-14949) Add Streams upgrade tests from AK 3.4

2024-01-09 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-14949. - Resolution: Fixed > Add Streams upgrade tests from AK

[jira] [Resolved] (KAFKA-14949) Add Streams upgrade tests from AK 3.4

2024-01-09 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-14949. - Resolution: Fixed > Add Streams upgrade tests from AK

[jira] [Assigned] (KAFKA-14949) Add Streams upgrade tests from AK 3.4

2024-01-09 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax reassigned KAFKA-14949: --- Assignee: Mickael Maison > Add Streams upgrade tests from AK

[jira] [Updated] (KAFKA-16092) Queues for Kafka

2024-01-08 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-16092: Issue Type: New Feature (was: Improvement) > Queues for Ka

[jira] [Commented] (KAFKA-14404) Fix & update docs on client configs controlled by Streams

2024-01-05 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17803543#comment-17803543 ] Matthias J. Sax commented on KAFKA-14404: - It seems [~sujayopensource]

<    4   5   6   7   8   9   10   11   12   13   >