Re: [DISCUSS] Apache Kafka 3.0.0 release plan with new updated dates

+1 on the new schedule. On Wed, May 26, 2021 at 8:14 PM Sophie Blee-Goldman wrote: > Ah ok, thanks Konstantine. I won't bug you about every new KIP that comes > in between now and KIP Freeze :P > > +1 on the scheduling changes as well > > On Wed, May 26, 2021 at 4:00 PM David Arthur wrote: > >

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #166

See

Re: [DISCUSS] Apache Kafka 3.0.0 release

Perfect, thanks. On Wed, May 26, 2021, 2:43 PM Konstantine Karantasis wrote: > Thanks for bringing up this suggestion, Ismael. > > Given that the date for adopting new features (aka KIP Freeze) remains the > same and that this release is a major release with goals such as the ones > mentioned

[GitHub] [kafka-site] prince-mahajan commented on pull request #356: Fix broken link

prince-mahajan commented on pull request #356: URL: https://github.com/apache/kafka-site/pull/356#issuecomment-84920 > Thanks @prince-mahajan Thanks! Can you also approve this please? https://github.com/apache/kafka/pull/10771 (same change in a different place). -- This is an

Re: [DISCUSS] Apache Kafka 3.0.0 release plan with new updated dates

Ah ok, thanks Konstantine. I won't bug you about every new KIP that comes in between now and KIP Freeze :P +1 on the scheduling changes as well On Wed, May 26, 2021 at 4:00 PM David Arthur wrote: > The new schedule looks good to me, +1 > > On Wed, May 26, 2021 at 6:29 PM Ismael Juma wrote: >

[GitHub] [kafka-site] prince-mahajan opened a new pull request #356: Fix broken link

prince-mahajan opened a new pull request #356: URL: https://github.com/apache/kafka-site/pull/356 Fixing the link to a cited blog. The existing link now points to a steroid website so need to pull the blog from internet archives. -- This is an automated message from the Apache Git

Re: Permission to create KIPs

Hello Josep, I saw your id "josep.prat" is already added on the wiki, you should be able to create KIPs now. On Wed, May 26, 2021 at 10:09 AM Josep Prat wrote: > Hi there, > > I would like to have permissions to create KIPs on the wiki. > My username should be josep.prat. > > Thanks, > > ——— >

[GitHub] [kafka-site] guozhangwang commented on pull request #356: Fix broken link

guozhangwang commented on pull request #356: URL: https://github.com/apache/kafka-site/pull/356#issuecomment-849183797 Thanks @prince-mahajan -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [kafka-site] guozhangwang merged pull request #356: Fix broken link

guozhangwang merged pull request #356: URL: https://github.com/apache/kafka-site/pull/356 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service,

Re: [DISCUSS] Apache Kafka 3.0.0 release plan with new updated dates

The new schedule looks good to me, +1 On Wed, May 26, 2021 at 6:29 PM Ismael Juma wrote: > Thanks Konstantine, +1 from me. > > Ismael > > On Wed, May 26, 2021 at 2:48 PM Konstantine Karantasis > wrote: > > > Hi all, > > > > Please find below the updated release plan for the Apache Kafka 3.0.0

Re: EXTERNAL: Re: [DISCUSS] Apache Kafka 3.0.0 release plan with new updated dates

Hi Meiling, Could you double check if the email sent is from non-sanboxed " m...@rockwellautomation.com" instead of "m...@rockwellautomation.com.invalid"? I believe the dev-unsubscr...@kafka.apache.org does work. On Wed, May 26, 2021 at 3:32 PM Meiling He wrote: > Can anyone instruct me how to

Re: EXTERNAL: Re: [DISCUSS] Apache Kafka 3.0.0 release plan with new updated dates

Can anyone instruct me how to unsubscribe from this mail list, please!! dev-unsubscr...@kafka.apache.org doesn’t work. From: Ismael Juma Sent: Wednesday, May 26, 2021 5:29:03 PM To: dev Subject: EXTERNAL: Re: [DISCUSS] Apache Kafka 3.0.0 release plan with new

Re: [DISCUSS] Apache Kafka 3.0.0 release plan with new updated dates

Thanks Konstantine, +1 from me. Ismael On Wed, May 26, 2021 at 2:48 PM Konstantine Karantasis wrote: > Hi all, > > Please find below the updated release plan for the Apache Kafka 3.0.0 > release. > > https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=177046466 > > New suggested

Re: [DISCUSS] Apache Kafka 3.0.0 release plan with new updated dates

Thanks Sophie. I'm also tracking the updates on the main KIP page and the Adopted KIPs table periodically, moving newly adopted KIPs to the release plan. But we'll definitely use the mailing list more as we approach KIP Freeze and make sure we include everything that is ready by the time we hit

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #165

See

Re: [DISCUSS] Apache Kafka 3.0.0 release plan with new updated dates

Hey Konstantine, I did a quick skim over the Streams KIPs and found two more which had not been moved to the "Adopted" section on the main KIP page and are missing from the release notes. These are: - KIP-466: Add support for List serialization and deserialization

[DISCUSS] Apache Kafka 3.0.0 release plan with new updated dates

Hi all, Please find below the updated release plan for the Apache Kafka 3.0.0 release. https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=177046466 New suggested dates for the release are as follows: KIP Freeze is 09 June 2021 (same date as in the initial plan) Feature Freeze is

Re: [DISCUSS] Apache Kafka 3.0.0 release

Thanks for bringing up this suggestion, Ismael. Given that the date for adopting new features (aka KIP Freeze) remains the same and that this release is a major release with goals such as the ones mentioned by Israel I'm also open to and in agreement with the extension of Feature Freeze, Code

[jira] [Created] (KAFKA-12854) Add a config to allow skipping metadata cache update when topic partition is unassigned

Lincong Li created KAFKA-12854: -- Summary: Add a config to allow skipping metadata cache update when topic partition is unassigned Key: KAFKA-12854 URL: https://issues.apache.org/jira/browse/KAFKA-12854

[jira] [Created] (KAFKA-12853) Implement broker-side KRaft snapshots

Colin McCabe created KAFKA-12853: Summary: Implement broker-side KRaft snapshots Key: KAFKA-12853 URL: https://issues.apache.org/jira/browse/KAFKA-12853 Project: Kafka Issue Type:

[jira] [Created] (KAFKA-12852) Log.splitOverflowedSegment() doesn't generate producer snapshot for new segment

Jun Rao created KAFKA-12852: --- Summary: Log.splitOverflowedSegment() doesn't generate producer snapshot for new segment Key: KAFKA-12852 URL: https://issues.apache.org/jira/browse/KAFKA-12852 Project: Kafka

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #164

See

[jira] [Created] (KAFKA-12851) Flaky Test RaftEventSimulationTest.canMakeProgressIfMajorityIsReachable

A. Sophie Blee-Goldman created KAFKA-12851: -- Summary: Flaky Test RaftEventSimulationTest.canMakeProgressIfMajorityIsReachable Key: KAFKA-12851 URL: https://issues.apache.org/jira/browse/KAFKA-12851

Permission to create KIPs

Hi there, I would like to have permissions to create KIPs on the wiki. My username should be josep.prat. Thanks, ——— Josep Prat Aiven Deutschland GmbH Immanuelkirchstraße 26, 10405 Berlin Amtsgericht Charlottenburg, HRB 209739 B Geschäftsführer: Oskari Saarenmaa & Hannu Valtonen m:

Re: [DISCUSS] Apache Kafka 3.0.0 release

On Wed, May 26, 2021, at 07:18, Ismael Juma wrote: > Hi Konstantine, > > Looking at the schedule and some of the ongoing work in KIP-500 (one of the > KIPs that is important to land in 3.0), I think we'll need a bit more time. > We definitely do not want to cause a disruption to our time-based

Re: [DISCUSS] KIP-739: Block Less on KafkaProducer#send

Hi Ryanne, Apologies to bring this here then! :) On Wed, May 26, 2021 at 5:27 PM Ryanne Dolan wrote: > Josep, that is being done as KIP-707. Looking forward to that as well :) > > Ryanne > > On Wed, May 26, 2021, 9:08 AM Josep Prat > wrote: > > > Sorry, I meant `CompletionStage` (instead of

Re: [DISCUSS] KIP-739: Block Less on KafkaProducer#send

Josep, that is being done as KIP-707. Looking forward to that as well :) Ryanne On Wed, May 26, 2021, 9:08 AM Josep Prat wrote: > Sorry, I meant `CompletionStage` (instead of CompletableFuture) as this is > the interface. > > Best, > ——— > Josep Prat > > Aiven Deutschland GmbH > >

Re: [DISCUSS] Apache Kafka 3.0.0 release

I would definitely second this though I would like to hear from other contributors, committers and the PMC as well before any adjustments to the schedules are finalized. The KIP-500 work (and all its child KIPs) is crucial to the success of the next major release (in stability and feature

Re: [DISCUSS] KIP-655: Windowed "Distinct" Operation for KStream

Hi John! I think that your proposal is just fantastic, it simplifies things a lot! I also felt uncomfortable due to the fact that the proposed `distinct()` is not somewhere near `count()` and `reduce(..)`. But `selectKey(..).groupByKey().windowedBy(..).distinct()` didn't look like a correct

Re: [DISCUSS] Apache Kafka 3.0.0 release

Hi Konstantine, Looking at the schedule and some of the ongoing work in KIP-500 (one of the KIPs that is important to land in 3.0), I think we'll need a bit more time. We definitely do not want to cause a disruption to our time-based release process, but given that this is a major release, I

Re: [DISCUSS] KIP-739: Block Less on KafkaProducer#send

Sorry, I meant `CompletionStage` (instead of CompletableFuture) as this is the interface. Best, ——— Josep Prat Aiven Deutschland GmbH Immanuelkirchstraße 26, 10405 Berlin Amtsgericht Charlottenburg, HRB 209739 B Geschäftsführer: Oskari Saarenmaa & Hannu Valtonen m: +491715557497 w: aiven.io

Re: [DISCUSS] KIP-739: Block Less on KafkaProducer#send

Hi, If I may, I would like to suggest that instead of using Java's `Future` class on the API's, it would be better to use `CompletableFuture`. This would offer the possibility of applying callbacks on its completion for example. Best, On Wed, May 26, 2021 at 3:28 PM Matthew de Detrich wrote: >

Re: [DISCUSS] KIP-739: Block Less on KafkaProducer#send

Maybe there was a miscommunication but I agree with everything you said, I was just clarifying what my definition of blocking is (because I think there was a misunderstanding). And yes you are right, there is a limited amount of threads which is why blocking is a bad thing because having threads

Re: [DISCUSS] KIP-739: Block Less on KafkaProducer#send

Matthew, it's more than performance tho. In many frameworks the number of request threads is purposefully constrained, and blocking one means you have one less to handle requests with. When you're handling a large amount of requests with a small number of threads, any blocking can lead to thread

Re: [DISCUSS] Apache Kafka 3.0.0 release

Hi Konstantine, I greatly appreciate your guidance. Sure, I will notify you again when KIP-719 is approved. Regards, Dongjin On Wed, May 26, 2021 at 4:08 PM Konstantine Karantasis wrote: > Hi Dongjin, > > Thanks for the update. > > Added KIP-653 since it has been adopted. I also added "3.0.0

Re: [DISCUSS] KIP-719: Add Log4J2 Appender

CC'd the +1ers of KIP-653 with detailed context: When I submitted and got the approval of KIP-653: Upgrade log4j to log4j2 , I thought the log4j2-appender should not be the scope of the work. But it was wrong.

Re: [DISCUSS] KIP-739: Block Less on KafkaProducer#send

I think we may need to clarify terminology here, at least to me blocking means suspending a current thread to wait for some operation (which is wasteful if we are dealing with IO bound tasks). In other words, the "blocking" is an implementation detail on how to wait rather than whether we need to

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #163

See

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #162

See

[jira] [Created] (KAFKA-12850) Use JDK16 for builds instead of JDK15

Josep Prat created KAFKA-12850: -- Summary: Use JDK16 for builds instead of JDK15 Key: KAFKA-12850 URL: https://issues.apache.org/jira/browse/KAFKA-12850 Project: Kafka Issue Type: Improvement

Re: [DISCUSS] Apache Kafka 3.0.0 release

Hi Dongjin, Thanks for the update. Added KIP-653 since it has been adopted. I also added "3.0.0 (WIP)" in the Release column of the Adopted KIPs table in https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Improvement+Proposals because the work (according to KAFKA-9366) is currently in