Re: [DISCUSS] KIP-659: Improve TimeWindowedDeserializer and TimeWindowedSerde to handle window size

have been > a lot more trouble than they're worth overall. That said, these particular > configs > don't appear to have hurt anyone thus far, at least not that we know of > (possibly > because no one is using it anyway) so there's no strong motivation to do so > > On Wed, Aug 26, 20

Re: [DISCUSS] KIP-659: Improve TimeWindowedDeserializer and TimeWindowedSerde to handle window size

gt; and why we're going to add an error to the existing > implicit. On the other hand, removing the existing implicit > will cause compiler errors when the type system is no longer > able to find a suitable argument for an implicit parameter, > so we don't want to just remove the existing

Re: [VOTE] KIP-659: Improve TimeWindowedDeserializer and TimeWindowedSerde to handle window size

; Sophie > >> > >> On Mon, Aug 24, 2020 at 5:06 PM John Roesler > wrote: > >> > >>> Thanks Leah, > >>> I’m +1 (binding) > >>> > >>> -John > >>> > >>> On Mon, Aug 24, 2020, at 16:54, Leah Thoma

Re: [VOTE] KIP-659: Improve TimeWindowedDeserializer and TimeWindowedSerde to handle window size

uot; > default.window.size.ms" and make that clear in the description as well? > Also we'd better also include its default value which I think would still > be MAX_VALUE for compatibility. > > > Guozhang > > > On Tue, Sep 8, 2020 at 9:38 AM Leah Thomas wrote: > > >

Re: [VOTE] KIP-659: Improve TimeWindowedDeserializer and TimeWindowedSerde to handle window size

f the main motivations of this KIP, and the whole > point of > deprecating the TimeWindowedSerde(innerClass) constructor. > > I actually would have advocated to remove this config entirely, but as John > pointed > out, we still need it to configure things like the console consu

Re: [DISCUSS] Apache Kafka 2.7.0 release

Hi Bill, Could you also add KIP-450 to the release plan? It's been merged. https://cwiki.apache.org/confluence/display/KAFKA/KIP-450%3A+Sliding+Window+Aggregations+in+the+DSL Cheers, Leah On Tue, Sep 8, 2020 at 9:32 AM Bill Bejeck wrote: > Hi Bruno, > > Thanks for letting me know, I've added

Re: [ANNOUNCE] New committer: A. Sophie Blee-Goldman

Congrats Sophie! On Mon, Oct 19, 2020 at 11:41 AM Matthias J. Sax wrote: > Hi all, > > I am excited to announce that A. Sophie Blee-Goldman has accepted her > invitation to become an Apache Kafka committer. > > Sophie is actively contributing to Kafka since Feb 2019 and has > accumulated 140

Re: [DISCUSS] KIP-659: Improve TimeWindowedDeserializer and TimeWindowedSerde to handle window size

you think we should do? > > Thanks, > -John > > On Fri, 2020-08-21 at 16:05 -0500, Leah Thomas wrote: > > Thanks for the typo catch, John. > > > > Let me know if anyone else has thoughts or ideas. > > > > Cheers, > > Leah > > > > On

Re: [DISCUSS] KIP-659: Improve TimeWindowedDeserializer and TimeWindowedSerde to handle window size

-0700, Walker Carlson wrote: > > Hi Leah, > > > > Could you explain a bit more why we do not wish to > > let TimeWindowedDeserializer and WindowedSerdes be created without a > > specified time as a parameter? > > > > I understand the long.MAX_VALUE could

Re: [DISCUSS] KIP-659: Improve TimeWindowedDeserializer and TimeWindowedSerde to handle window size

a > > > > One last quick side note: the reason we don't really need to discuss > > SessionWindows here > > is that they already encode both the start and end time for the window. > > This is probably the best > > way to go for TimeWindows as well, but making thi

[DISCUSS] KIP-659: Improve TimeWindowedDeserializer and TimeWindowedSerde to handle window size

Hi all, I'd like to start a discussion for KIP-659: https://cwiki.apache.org/confluence/display/KAFKA/KIP-659%3A+Improve+TimeWindowedDeserializer+and+TimeWindowedSerde+to+handle+window+size The goal of the KIP is to ensure that window size is passed to the consumer when needed, which will

[VOTE] KIP-659: Improve TimeWindowedDeserializer and TimeWindowedSerde to handle window size

Hi everyone, I'd like to kick-off the vote for KIP-659: Improve TimeWindowedDeserializer and TimeWindowedSerde to handle window size. https://cwiki.apache.org/confluence/display/KAFKA/KIP-659%3A+Improve+TimeWindowedDeserializer+and+TimeWindowedSerde+to+handle+window+size Thanks, Leah

Re: [VOTE] KIP-671: Add method to Shutdown entire Streams Application

Hey Walker, Thanks for the KIP! I'm +1, non-binding. Cheers, Leah On Tue, Sep 29, 2020 at 1:56 PM Walker Carlson wrote: > Hello all, > > I made some changes to the KIP the descriptions are on the discussion > thread. If you have already voted I would ask you to confirm your vote. > >

Re: [DISCUSS] KIP-450: Sliding Windows

> > that added session windows? It could provides some good insights.) > -- I > > > > believe the same rational applies to sliding windows? > > > > > > > > > > > > > > > > -Matthias > > > > > > > > > >

Re: [VOTE] KIP-450: Sliding Window Aggregations in the DSL

gt; > > > On 7/28/20 4:35 PM, Sophie Blee-Goldman wrote: > > > > > Thanks for the KIP! It's been an enlightening discussion > > > > > > > > > > +1 (non-binding) > > > > > > > > > > Sophie > > > > > >

Re: [DISCUSS] KIP-450: Sliding Windows

; > thanks a lot for the KIP. Very well written. > > The KIP does not talk about the handling of out-of-order data though. > How do you propose to address this? > > > -Matthias > > On 7/8/20 5:33 PM, Leah Thomas wrote: > > Hi all, > > I'd like to kick-off the discus

[DISCUSS] KIP-450: Sliding Windows

Hi all, I'd like to kick-off the discussion for KIP-450, adding sliding window aggregation support to Kafka Streams. https://cwiki.apache.org/confluence/display/KAFKA/KIP-450%3A+Sliding+Window+Aggregations+in+the+DSL Let me know what you think, Leah

Re: [DISCUSS] KIP-450: Sliding Windows

, Leah On Thu, Jul 23, 2020 at 7:34 PM Leah Thomas wrote: > Thanks for the discussion about extending TimeWindows. I agree that making > it future proof is important, and the implementation of SlidingWindows is > unique enough that it seems logical to make it its own final class. > &g

[VOTE] KIP-450: Sliding Window Aggregations in the DSL

Hi all, I'd like to kick-off the vote for KIP-450 , adding sliding window aggregations to the DSL. The discussion thread is here

Re: [DISCUSS] KIP-450: Sliding Windows

*. The new builder will be *withTimeDifferenceAndGrace*, keeping with other conventions. Let me know if there are any concerns! The vote thread is open as well here: http://mail-archives.apache.org/mod_mbox/kafka-dev/202007.mbox/browser Best, Leah On Mon, Jul 27, 2020 at 3:58 PM Leah Thomas wrote

Re: [DISCUSS] KIP-450: Sliding Windows

iss count) > > - "Two new windows will be created by the late record" > > late -> out-of-order > > > -Matthias > > > > On 7/28/20 4:34 PM, Sophie Blee-Goldman wrote: > > Thanks for the update Leah -- I think that all makes sense. > > > >

Re: [VOTE] KIP-617: Allow Kafka Streams State Stores to be iterated backwards

Hi Jorge, Looks great. +1 (non-binding) Best, Leah On Thu, Jul 16, 2020 at 6:39 PM Sophie Blee-Goldman wrote: > Hey Jorge, > > Thanks for the reminder -- +1 (non-binding) > > Cheers, > Sophie > > On Thu, Jul 16, 2020 at 4:06 PM Jorge Esteban Quilcate Otoya < > quilcate.jo...@gmail.com> wrote:

Re: [DISCUSS] KIP-450: Sliding Windows

) on the public API. If anyone has any comments or thoughts let me know. Otherwise, I'll take this to vote shortly. Best, Leah On Fri, Jul 24, 2020 at 3:45 PM Leah Thomas wrote: > To accommodate the change to a final class, I've added another > *windowedBy()* function in *CogroupedKStream.java *to

Re: [DISCUSS] KIP-450: Sliding Windows

store the computed view) and also make it > > > > >> queriable. > > > > >> It would be illegal for the "queriable, materialized view" to > differ > > > in > > > > >> any way > > > > >> from the "view". So, it

Re: [DISCUSS] KIP-450: Sliding Windows

, JoinWindows do it already wrong > and we just repeat the same mistake). However, it seems our window > hierarchy is "broken" already and it might be out of scope for this KIP > to fix it. Hence, I am ok that we bite the bullet for now and clean it > up later. >

[DISCUSS] KIP-689: Extend `StreamJoined` to allow more store configs

Hi all, I'd like to kick-off the discussion for KIP-689: Extend `StreamJoined` to allow more store configs. This builds off the work of KIP-479 to add options to enable/disable both logging and

Re: [DISCUSS] KIP-689: Extend `StreamJoined` to allow more store configs

, 2020 at 9:54 AM Leah Thomas wrote: > Hi all, > > I'd like to kick-off the discussion for KIP-689: Extend `StreamJoined` to > allow more store configs. This builds off the work of KIP-479 > <https://cwiki.apache.org/confluence/display/KAFKA/KIP-479%3A+Add+StreamJoined+con

Re: [VOTE] KIP-689: Extend `StreamJoined` to allow more store configs

M Walker Carlson > > > > > wrote: > > > > > > > > > +1 (non-binding) > > > > > > > > > > Thank you, > > > > > walker > > > > > > > > > > On Wed, Dec 2, 2020 at 8:15 AM Bruno C

Re: [DISCUSS] KIP-689: Extend `StreamJoined` to allow more store configs

the additional functionality at once for the Scala API. WDYT? On Wed, Dec 2, 2020 at 5:40 PM Matthias J. Sax wrote: > One more follow up: do we need to update the Scala API, too? > > > -Matthias > > On 12/2/20 7:51 AM, Leah Thomas wrote: > > Thanks for the feedback! I'll go ahead

Re: [DISCUSS] KIP-689: Extend `StreamJoined` to allow more store configs

automatically. > > > -Matthias > > On 12/3/20 7:16 AM, Leah Thomas wrote: > > Thanks for thinking of that Matthias. After looking at what we currently > > have for `StreamJoined` in scala, we just have bare bones functionality, > > allowing users to use `StreamJoined` t

Re: [VOTE] KIP-696: Update Streams FSM to clarify ERROR state meaning

Looks good, thanks Walker! +1 (non-binding) Leah On Wed, Dec 9, 2020 at 1:04 PM John Roesler wrote: > Thanks, Walker! > > I'm also +1 (binding) > > -John > > On Wed, 2020-12-09 at 11:03 -0800, Guozhang Wang wrote: > > +1. Thanks Walker. > > > > On Wed, Dec 9, 2020 at 10:58 AM Walker Carlson >

Re: [DISCUSS] KIP-689: Extend `StreamJoined` to allow more store configs

plier(final WindowBytesStoreSupplier > otherStoreSupplier)` and `withOtherStoreSupplier(final > WindowBytesStoreSupplier otherStoreSupplier)`. Why do we need to duplicate > them when the `retentionPeriod` can be set through them? > > Thanks, > Walker > > On Mon, Nov 30, 2020 at 8

Re: [DISCUSS] KIP-689: Extend `StreamJoined` to allow more store configs

ack on again? I can see having the > > enableLoging for completeness so it's not that important probably. > > > > Anyways other than that it looks good! > > > > Walker > > > > On Mon, Nov 30, 2020 at 12:06 PM Leah Thomas > wrote: > > > >> Hey Walker, &g

Re: [DISCUSS] KIP-689: Extend `StreamJoined` to allow more store configs

anges. It makes more sense now to me. Overall > LGTM > > > > walker > > > > On Tue, Dec 1, 2020 at 3:39 PM Sophie Blee-Goldman > > wrote: > > > >> Thanks for the KIP! I'm happy with the state of things after your latest > >> update, &

[VOTE] KIP-689: Extend `StreamJoined` to allow more store configs

Hi all, I'd like to start the vote for KIP-689 for enabling/disabling logging for `StreamJoined`. https://cwiki.apache.org/confluence/display/KAFKA/KIP-689%3A+Extend+%60StreamJoined%60+to+allow+more+store+configs Thanks, Leah

Re: [VOTE] KIP-698: Add Explicit User Initialization of Broker-side State to Kafka Streams

Thanks for the KIP Bruno, LGTM. +1 (non-binding) Cheers, Leah On Mon, Dec 14, 2020 at 4:29 AM Bruno Cadonna wrote: > Hi, > > I'd like to start the voting on KIP-698 that proposes an explicit user > initialization of broker-side state for Kafka Streams instead of letting > Kafka Streams setting

Re: [DISCUSS] Apache Kafka 2.8.0 release

Hi John, KIP-659 was just accepted as well, can it be added to the release plan? https://cwiki.apache.org/confluence/display/KAFKA/KIP-659%3A+Improve+TimeWindowedDeserializer+and+TimeWindowedSerde+to+handle+window+size Thanks, Leah On Thu, Jan 14, 2021 at 9:36 AM John Roesler wrote: > Hi

Re: [VOTE] KIP-659: Improve TimeWindowedDeserializer and TimeWindowedSerde to handle window size

gt; >> counts :) > >> > >> On Wed, Jan 13, 2021 at 2:04 PM Sophie Blee-Goldman < > sop...@confluent.io> > >> wrote: > >> > >>> That sounds good to me. Thanks for reviving this > >>> > >>> Sophie > >>>

Re: [VOTE] KIP-659: Improve TimeWindowedDeserializer and TimeWindowedSerde to handle window size

gt; the > > >> Serde's > > >> constructor? If anything, it seems worse to put physical and mental > > >> distance between > > >> the specification and the actual usage of such parameters. What if you > > add > > >> another > > &

Re: [VOTE] KIP-698: Add Explicit User Initialization of Broker-side State to Kafka Streams

Since `init()` is a blocking call (we only return after all topics > >>> are > >>>>> confirmed to be created), should we have a timeout for this call as > >>> well > >>>> or > >>>>> not; > >>>> > >>

[DISCUSS] KIP-741: Change default serde to be null

Hi all, I'd like to kick-off what I think should be a small discussion for KIP-741: Change default serde to be null. The wiki is here: https://cwiki.apache.org/confluence/display/KAFKA/KIP-741%3A+Change+default+serde+to+be+null Thanks, Leah

Re: [DISCUSS] KIP-741: Change default serde to be null

h will now return > > null, whereas they used to return the ByteArraySerde? If they're not a > > public API then you can remove them > > from the KIP, otherwise can you just update this section to clarify what > > class/file these belong to, etc? > > > > -Sophie &

Re: [DISCUSS] KIP-741: Change default serde to be null

>> necessarily all at once, but gradually after this KIP) > > >> > > >> Thoughts? > > >> > > >> On Wed, May 19, 2021 at 10:31 AM Guozhang Wang > > wrote: > > >> > > >>> Leah, thanks for the KIP. > > >>&

[VOTE] KIP-741: Change default serde to be null

Hi, I'd like to kick-off voting for KIP-741: Change default serde to be null. The discussion is linked on the KIP for context. Cheers, Leah

Re: [VOTE] KIP-741: Change default serde to be null

; >> Thanks, > > >> Dongjin > > >> > > >> On Tue, May 25, 2021 at 10:12 AM John Roesler > > >> wrote: > > >> > > >>> +1 (binding) from me. Thanks for the KIP! > > >>> -John > > >>> >

Re: [DISCUSS] KIP-741: Change default serde to be null

If there are no further notes, I'll go ahead and start the voting thread today. Thanks, Leah On Thu, May 20, 2021 at 2:58 PM Leah Thomas wrote: > Thanks for finding that, Guozhang. Consistency seems like the best option > to me as well, for the time being. I updated the KIP with that

Re: [DISCUSS] KIP-725: Streamlining configurations for TimeWindowedDeserializer.

Hey Sagar, Thanks for picking this up! The proposal looks good to me after Sophie and John's changes. Cheers, Leah On Fri, Apr 2, 2021 at 6:21 AM Sagar wrote: > Thanks John! > > Yeah I think window.inner.class.deserializer sounds good. Your thoughts > @Sophie? > > Thanks! > Sagar. > > > On

Re: [VOTE] KIP-725: Streamlining configurations for TimeWindowedDeserializer.

Hi Sagar, +1 non-binding. Thanks again for doing this. Leah On Mon, Apr 5, 2021 at 9:40 PM John Roesler wrote: > Thanks, Sagar! > > I’m +1 (binding) > > -John > > On Mon, Apr 5, 2021, at 21:35, Sophie Blee-Goldman wrote: > > Thanks for the KIP! +1 (binding) from me > > > > Cheers, > > Sophie >

Re: [VOTE] KIP-633: Drop 24 hour default of grace period in Streams

Thanks for picking this up, Sophie. +1 from me, non-binding. Leah On Mon, Apr 5, 2021 at 9:42 PM John Roesler wrote: > Thanks, Sophie, > > I’m +1 (binding) > > -John > > On Mon, Apr 5, 2021, at 21:34, Sophie Blee-Goldman wrote: > > Hey all, > > > > I'd like to start the voting on KIP-633, to

Re: [VOTE] KIP-715: Expose Committed offset in streams

Hey Walker, Thanks for leading this discussion. +1 from me, non-binding Leah On Mon, Mar 1, 2021 at 12:37 AM Boyang Chen wrote: > Thanks Walker for the proposal, +1 (binding) from me. > > On Fri, Feb 26, 2021 at 12:42 PM Walker Carlson > wrote: > > > Hello all, > > > > I would like to bring

Re: [DISCUSS] KIP-761: Add total blocked time metric to streams

Thanks for the KIP Rohan. I had a question - it seems like from the descriptions of `txn-commit-time-total` and `offset-commit-time-total` that they measure similar processes for ALOS and EOS, but only `txn-commit-time-total` is included in `blocked-time-total`. Why isn't

Re: [VOTE] KIP-761: Add Total Blocked Time Metric to Streams

Hey Rohan, Thanks for pushing this KIP through. I'm +1, non-binding. Leah On Wed, Jul 21, 2021 at 7:09 PM Rohan Desai wrote: > Now that the discussion thread's been open for a few days, I'm calling for > a vote on > >

Re: [VOTE] KIP-834: Pause / Resume KafkaStreams Topologies

Thanks Jim, great discussion. +1 from me (non-binding) Cheers, Leah On Wed, May 11, 2022 at 10:14 AM Bill Bejeck wrote: > Thanks for the KIP! > > +1 (binding) > > -Bill > > On Wed, May 11, 2022 at 9:36 AM Luke Chen wrote: > > > Hi Jim, > > > > I'm +1. (please add some note in KIP about the

[jira] [Resolved] (KAFKA-5636) Add Sliding-Window support for Aggregations

[ https://issues.apache.org/jira/browse/KAFKA-5636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Leah Thomas resolved KAFKA-5636. Resolution: Fixed > Add Sliding-Window support for Aggregati

[jira] [Created] (KAFKA-10366) TimeWindowedDeserializer doesn't allow users to set a custom window size

Leah Thomas created KAFKA-10366: --- Summary: TimeWindowedDeserializer doesn't allow users to set a custom window size Key: KAFKA-10366 URL: https://issues.apache.org/jira/browse/KAFKA-10366 Project

[jira] [Resolved] (KAFKA-4996) Fix findbugs multithreaded correctness warnings for streams

[ https://issues.apache.org/jira/browse/KAFKA-4996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Leah Thomas resolved KAFKA-4996. Resolution: Fixed > Fix findbugs multithreaded correctness warnings for stre

[jira] [Resolved] (KAFKA-9126) Extend `StreamJoined` to allow more store configs

[ https://issues.apache.org/jira/browse/KAFKA-9126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Leah Thomas resolved KAFKA-9126. Fix Version/s: 2.8.0 Resolution: Fixed > Extend `StreamJoined` to allow more store conf

[jira] [Resolved] (KAFKA-10417) suppress() with cogroup() throws ClassCastException

[ https://issues.apache.org/jira/browse/KAFKA-10417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Leah Thomas resolved KAFKA-10417. - Resolution: Fixed > suppress() with cogroup() throws ClassCastExcept

[jira] [Resolved] (KAFKA-10366) TimeWindowedDeserializer doesn't allow users to set a custom window size

[ https://issues.apache.org/jira/browse/KAFKA-10366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Leah Thomas resolved KAFKA-10366. - Fix Version/s: 2.8.0 Resolution: Fixed > TimeWindowedDeserializer doesn't allow us

[jira] [Resolved] (KAFKA-9649) Remove/Warn on use of TimeWindowedSerde with no specified window size

[ https://issues.apache.org/jira/browse/KAFKA-9649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Leah Thomas resolved KAFKA-9649. Fix Version/s: 2.8.0 Resolution: Fixed > Remove/Warn on use of TimeWindowedSe

[jira] [Created] (KAFKA-13052) Replace uses of SerDes in the docs with Serdes

Leah Thomas created KAFKA-13052: --- Summary: Replace uses of SerDes in the docs with Serdes Key: KAFKA-13052 URL: https://issues.apache.org/jira/browse/KAFKA-13052 Project: Kafka Issue Type

[jira] [Created] (KAFKA-12344) Support SlidingWindows in the Scala API

Leah Thomas created KAFKA-12344: --- Summary: Support SlidingWindows in the Scala API Key: KAFKA-12344 URL: https://issues.apache.org/jira/browse/KAFKA-12344 Project: Kafka Issue Type

[jira] [Created] (KAFKA-13120) Flesh out `streams_static_membership_test` to be more robust

Leah Thomas created KAFKA-13120: --- Summary: Flesh out `streams_static_membership_test` to be more robust Key: KAFKA-13120 URL: https://issues.apache.org/jira/browse/KAFKA-13120 Project: Kafka

[jira] [Created] (KAFKA-13811) Investigate sliding windows performance

Leah Thomas created KAFKA-13811: --- Summary: Investigate sliding windows performance Key: KAFKA-13811 URL: https://issues.apache.org/jira/browse/KAFKA-13811 Project: Kafka Issue Type: Task