[jira] [Resolved] (KAFKA-16157) Topic recreation with offline disk doesn't update leadership/shrink ISR correctly

2024-02-02 Thread Luke Chen (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Chen resolved KAFKA-16157. --- Resolution: Fixed > Topic recreation with offline disk doesn't update leadership/shrink ISR > corre

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #2617

2024-02-02 Thread Apache Jenkins Server
See

Jenkins build is still unstable: Kafka » Kafka Branch Builder » 3.7 #86

2024-02-02 Thread Apache Jenkins Server
See

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #2616

2024-02-02 Thread Apache Jenkins Server
See

Re: [DISCUSS] KIP-939: Support Participation in 2PC

2024-02-02 Thread Artem Livshits
Hi Jun, > Then, should we change the following in the example to use InitProducerId(true) instead? We could. I just thought that it's good to make the example self-contained by starting from a clean state. > Also, could Flink just follow the dual-write recipe? I think it would bring some unnec

Jenkins build is still unstable: Kafka » Kafka Branch Builder » 3.7 #85

2024-02-02 Thread Apache Jenkins Server
See

Re: [DISCUSS] KIP-890 Server Side Defense

2024-02-02 Thread Justine Olshan
Hey Jun, Yes, the idea is that if we downgrade TV (transaction version) we will stop using the add partitions to txn optimization and stop writing the flexible feature version of the log. In the compatibility section I included some explanations on how this is done. Thanks, Justine On Fri, Feb 2

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #2615

2024-02-02 Thread Apache Jenkins Server
See

Re: [DISCUSS] KIP-890 Server Side Defense

2024-02-02 Thread Jun Rao
Hi, Justine, Thanks for the update. If we ever downgrade the transaction feature, any feature depending on changes on top of those RPC/record (AddPartitionsToTxnRequest/TransactionLogValue) changes made in KIP-890 will be automatically downgraded too? Jun On Tue, Jan 30, 2024 at 3:32 PM Justine

Re: [DISCUSS] KIP-853: KRaft Controller Membership Changes

2024-02-02 Thread Jun Rao
Hi, Jose, Thanks for the KIP. A few comments below. 10. kraft.version: Functionality wise, this seems very similar to metadata.version, which is to make sure that all brokers/controllers are on a supported version before enabling a new feature. Could you explain why we need a new one instead of j

Re: ZK vs KRaft benchmarking - latency differences?

2024-02-02 Thread Michael K. Edwards
Take everything I say with a grain of salt; I haven't set up a new Kafka cluster from scratch in several years. And realistically, most users' needs are better met with a simple deployment model with adequate performance rather than a heavily tuned system. My attention was just drawn to the bench

Re: [VOTE] 3.7.0 RC2

2024-02-02 Thread Mickael Maison
Hi Stanislav, I merged https://github.com/apache/kafka/pull/15308 in trunk. I let you cherry-pick it to 3.7. I think fixing the absolute show stoppers and calling JBOD support in KRaft early access in 3.7.0 is probably the right call. Even without the bugs we found, there's still quite a few JBOD

Re: [VOTE] KIP-974: Docker Image for GraalVM based Native Kafka Broker

2024-02-02 Thread Justine Olshan
Hi Krishna, Thanks for following up on my questions in the discussion thread. +1 (binding) from me :) Justine On Mon, Jan 29, 2024 at 9:00 AM Krishna Agarwal < krishna0608agar...@gmail.com> wrote: > Hi, > A gentle nudge to cast your vote on the KIP. > Your input is highly valued. > > Regards, >

Re: [DISCUSS] KIP-974 Docker Image for GraalVM based Native Kafka Broker

2024-02-02 Thread Justine Olshan
Thanks Krishna. I will go ahead and vote. Justine On Fri, Feb 2, 2024 at 1:30 AM Krishna Agarwal wrote: > Hi Justine, > Thanks for the feedback. > > I have added the above comparison results to the KIP. > > Given the widespread use of Alpine, the likelihood of encountering issues > is minimal.

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #2614

2024-02-02 Thread Apache Jenkins Server
See

[jira] [Resolved] (KAFKA-16115) AsyncKafkaConsumer: Add missing heartbeat metrics

2024-02-02 Thread Philip Nee (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Philip Nee resolved KAFKA-16115. Resolution: Fixed > AsyncKafkaConsumer: Add missing heartbeat metrics > --

Re: Apache Kafka 3.7.0 Release

2024-02-02 Thread Divij Vaidya
Hey folks The release plan for 3.7.0 [1] calls out KIP 848 as "Targeting a Preview in 3.7". Is that still true? If yes, then we should perhaps add that in the blog, call it out in the release notes and prepare a preview document similar to what we did for Tiered Storage Early Access release[2] I

Re: [VOTE] 3.7.0 RC2

2024-02-02 Thread Stanislav Kozlovski
Thanks for the work everybody. Providing a status update at the end of the week: - docs change explaining migration was merged - the blocker KAFKA-16162 was merged - the blocker KAFKA-14616

Re: [DISCUSS] KIP-1016 Make MM2 heartbeats topic name configurable

2024-02-02 Thread Omnia Ibrahim
I noticed you have something addressed in the rejected alternatives in your KIP regarding KIP-690, however, as the KIP is implementing one of the previous rejected alternatives for KIP-690 I think it would be nice to update the motivation section in the new KIP with some clarification for why wh

Re: [DISCUSS] KIP-1016 Make MM2 heartbeats topic name configurable

2024-02-02 Thread Omnia Ibrahim
Hi Thanks for the KIP. I don’t know if you had a look before into the rejection alternatives in KIP-690 https://cwiki.apache.org/confluence/display/KAFKA/KIP-690%3A+Add+additional+configuration+to+control+MirrorMaker+2+internal+topics+naming+convention#KIP690:AddadditionalconfigurationtocontrolM

[jira] [Resolved] (KAFKA-15728) KRaft support in DescribeUserScramCredentialsRequestNotAuthorizedTest

2024-02-02 Thread Mickael Maison (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mickael Maison resolved KAFKA-15728. Fix Version/s: 3.8.0 Resolution: Fixed > KRaft support in DescribeUserScramCredenti

[jira] [Resolved] (KAFKA-9693) Kafka latency spikes caused by log segment flush on roll

2024-02-02 Thread Divij Vaidya (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Divij Vaidya resolved KAFKA-9693. - Resolution: Fixed This performance regression where producer snapshot fsync leads to high P99 la

[jira] [Resolved] (KAFKA-10047) Unnecessary widening of (int to long) scope in FloatSerializer

2024-02-02 Thread Mickael Maison (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mickael Maison resolved KAFKA-10047. Fix Version/s: 3.8.0 Resolution: Fixed > Unnecessary widening of (int to long) scop

Re: ZK vs KRaft benchmarking - latency differences?

2024-02-02 Thread Doğuşcan Namal
Hey Michael, thanks for your comments. I think the first of the improvements you mentioned, the faster controller failover is a known improvement to me. But the second one you suggest is a faster consumer group failover, could you open that up a bit for me why do you think it will be better on KRaf

Re: [VOTE] KIP-910: Update Source offsets for Source Connectors without producing records

2024-02-02 Thread Sagar
Thanks Yash! I am hoping to have this released in 3.8 so it would be good to get the remaining 2 votes. Thanks! Sagar. On Tue, Jan 30, 2024 at 3:18 PM Yash Mayya wrote: > Hi Sagar, > > Thanks for the KIP and apologies for the extremely long delay here! I think > we could do with some wordsmit

Re: [DISCUSS] KIP-956: Tiered Storage Quotas

2024-02-02 Thread Abhijeet Kumar
Yes, it is part of V1. I have added it now. I will follow up on the KIP comments in the next couple of days and try to close the review in the next few weeks. Regards. On Thu, Feb 1, 2024 at 7:40 PM Francois Visconte wrote: > > Hi, > > I see that the ticket has been left untouched since a while

[jira] [Created] (KAFKA-16220) KTableKTableForeignKeyInnerJoinCustomPartitionerIntegrationTest#shouldThrowIllegalArgumentExceptionWhenCustomPartionerReturnsMultiplePartitions flaky

2024-02-02 Thread Lucas Brutschy (Jira)
Lucas Brutschy created KAFKA-16220: -- Summary: KTableKTableForeignKeyInnerJoinCustomPartitionerIntegrationTest#shouldThrowIllegalArgumentExceptionWhenCustomPartionerReturnsMultiplePartitions flaky Key: KAFKA-16220

[jira] [Created] (KAFKA-16219) Tsl13SelectorTest::testExpireClosedConnectionWithPendingReceives hangs infinitely

2024-02-02 Thread Gaurav Narula (Jira)
Gaurav Narula created KAFKA-16219: - Summary: Tsl13SelectorTest::testExpireClosedConnectionWithPendingReceives hangs infinitely Key: KAFKA-16219 URL: https://issues.apache.org/jira/browse/KAFKA-16219

Re: [DISCUSS] KIP-974 Docker Image for GraalVM based Native Kafka Broker

2024-02-02 Thread Krishna Agarwal
Hi Justine, Thanks for the feedback. I have added the above comparison results to the KIP. Given the widespread use of Alpine, the likelihood of encountering issues is minimal. Ubuntu, being a more comprehensive image, is expected to be lesser prone to such challenges. Considering that we are ini

[jira] [Resolved] (KAFKA-5561) Java based TopicCommand to use the Admin client

2024-02-02 Thread Mickael Maison (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-5561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mickael Maison resolved KAFKA-5561. --- Resolution: Duplicate > Java based TopicCommand to use the Admin client > ---

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #2613

2024-02-02 Thread Apache Jenkins Server
See