[jira] [Created] (KAFKA-15245) Improve Tiered Storage Metrics

Abhijeet Kumar created KAFKA-15245: -- Summary: Improve Tiered Storage Metrics Key: KAFKA-15245 URL: https://issues.apache.org/jira/browse/KAFKA-15245 Project: Kafka Issue Type: Sub-task

[jira] [Resolved] (KAFKA-15005) Status of KafkaConnect task not correct

[ https://issues.apache.org/jira/browse/KAFKA-15005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Rao resolved KAFKA-15005. --- Resolution: Duplicate > Status of KafkaConnect task not correct >

Re: Apache Kafka 3.6.0 release

Thanks Colin for the update on the mentioned KIPs. ~Satish. On Mon, 24 Jul 2023 at 23:09, Colin McCabe wrote: > > Hi Satish, > > I removed "KIP-866 ZooKeeper to KRaft Migration" from the list of pending > KIPs, since that one was shipped in 3.4. I added "KIP-868 Metadata > Transactions",

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #2033

See Changes: -- [...truncated 393817 lines...] Gradle Test Run :streams:integrationTest > Gradle Test Executor 181 > StoreQueryIntegrationTest >

[jira] [Created] (KAFKA-15244) Connect PluginType.from(Class) result is incorrect when subclassing multiple plugin interfaces

Greg Harris created KAFKA-15244: --- Summary: Connect PluginType.from(Class) result is incorrect when subclassing multiple plugin interfaces Key: KAFKA-15244 URL: https://issues.apache.org/jira/browse/KAFKA-15244

Jenkins build is unstable: Kafka » Kafka Branch Builder » trunk #2032

See

[jira] [Resolved] (KAFKA-14920) Address timeouts and out of order sequences

[ https://issues.apache.org/jira/browse/KAFKA-14920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Justine Olshan resolved KAFKA-14920. Resolution: Fixed > Address timeouts and out of order sequences >

Re: [DISCUSS] KIP-954: expand default DSL store configuration to custom types

Awesome summary (seriously) -- would you kindly offer your organizational skills to every ongoing KIP from henceforth? We need you :P A few answers/comments: A2: I think there is a 3rd sub-option here, which is to leave versioned-ness out of this KIP entirely, return only the non-versioned

[GitHub] [kafka-site] mjsax commented on pull request #528: MINOR: Add statmenet about ZK deprecation to 3.5 release blog post

mjsax commented on PR #528: URL: https://github.com/apache/kafka-site/pull/528#issuecomment-1648602694 Follow up PR to get the latest comments back ported to `kafka.git`: https://github.com/apache/kafka/pull/14085 -- This is an automated message from the Apache Git Service. To respond to

[GitHub] [kafka-site] mjsax merged pull request #528: MINOR: Add statmenet about ZK deprecation to 3.5 release blog post

mjsax merged PR #528: URL: https://github.com/apache/kafka-site/pull/528 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [DISCUSS] KIP-759: Unneeded repartition canceling

Thanks Shay! You and Matthias have convinced me, I'm happy with the current proposal. I think once you make the minor updates to the KIP document this will be ready for voting again. Cheers, Sophie On Mon, Jul 24, 2023 at 8:26 AM Shay Lin wrote: > Hi Sophie and Matthias, thanks for your

Re: Re: [DISCUSS] KIP-951: Leader discovery optimisations for the client

I updated the wiki to include both results along with their average. Thank you, Crispin On Mon, Jul 24, 2023 at 10:58 AM Ismael Juma wrote: > Hi Crispin, > > One additional question, the wiki says "The results are averaged over 2 > runs.". Can you please provide some measure of variance in the

[DISCUSS] KIP-955: Add stream-table join on foreign key

Hello developers of the Kafka Streams, I would like to start discussion on KIP-955: Add stream-table join on foreign key This KIP proposes the new API to join KStrem with KTable based on foreign

[VOTE] KIP-951: Leader discovery optimisations for the client

Hi all Opening the voting process for this KIP, given the deadline for KIP acceptance for 3.6 is impending. Open to keep the discussion going if the community needs more time to converge. KIP -> https://cwiki.apache.org/confluence/x/F4uzDw Thanks for participating in the discussion so far! --

Re: Re: [DISCUSS] KIP-951: Leader discovery optimisations for the client

David, We never backport new features to old releases. This new feature will be > only available from 3.6 (or 3.7) onwards for both client and server. Good to know. I think that makes the argument for bumping the version even stronger. On Mon, Jul 24, 2023 at 5:01 PM David Jacot wrote: > Hi

Re: Apache Kafka 3.6.0 release

Hi Satish, I removed "KIP-866 ZooKeeper to KRaft Migration" from the list of pending KIPs, since that one was shipped in 3.4. I added "KIP-868 Metadata Transactions", since we are planning on implementing this in 3.6. (The KIP was approved a while ago, but not yet shipped.) I also added

[VOTE] KIP-919: Allow AdminClient to Talk Directly with the KRaft Controller Quorum and add Controller Registration

Hi all, I'd like to start the vote for KIP-919: Allow AdminClient to Talk Directly with the KRaft Controller Quorum and add Controller Registration. The KIP is here: https://cwiki.apache.org/confluence/x/Owo0Dw Thanks to everyone who reviewed the proposal. best, Colin

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #2031

See Changes: -- [...truncated 294842 lines...] streams-0: SMOKE-TEST-CLIENT-CLOSED streams-3: SMOKE-TEST-CLIENT-CLOSED streams-0: SMOKE-TEST-CLIENT-CLOSED streams-1:

Bug wile create users

Hi everyone! We think we found a bug, we dug deep and found the solution. Please take a look at the bug reported, I am happy to deliver the patch https://issues.apache.org/jira/browse/KAFKA-15243 Thanks!

Re: [DISCUSS] KIP-954: expand default DSL store configuration to custom types

Lots of thoughts! Happy to see the thriving discussion on this post - lots going on so I'm trying to enumerate them to keep things organized (prefix "A" for "Almog" so we can use numbers in responses for other things ;P). A1. Question around closing implementation gaps (e.g. no rocks based

[jira] [Created] (KAFKA-15243) User creation mismatch

Sergio Troiano created KAFKA-15243: -- Summary: User creation mismatch Key: KAFKA-15243 URL: https://issues.apache.org/jira/browse/KAFKA-15243 Project: Kafka Issue Type: Bug Affects

Re: [VOTE] KIP-944 Support async runtimes in consumer, votes needed!

Hello Xiangyuan LI, I am not familiar with coroutines, nor with Kotlin. You will have to work with the documentation: https://kotlinlang.org/docs/coroutines-overview.html However, I am familiar with Zio and Cats-effects (both Scala libraries). In both Zio and Cats-effects one creates

Re: Re: [DISCUSS] KIP-951: Leader discovery optimisations for the client

Hi Mayank, We never backport new features to old releases. This new feature will be only available from 3.6 (or 3.7) onwards for both client and server. Best, David On Mon, Jul 24, 2023 at 5:20 PM Mayank Shekhar Narula < mayanks.nar...@gmail.com> wrote: > Thanks Jose/David/Ismael for your

Re: Re: [DISCUSS] KIP-951: Leader discovery optimisations for the client

Hi Mayank, On Mon, Jul 24, 2023 at 8:21 AM Mayank Shekhar Narula wrote: > > Thanks Jose/David/Ismael for your inputs. > > Not bumping the version, would require both broker & client to backport > changes. Especially for FetchResponse, as backporting would have to be done > all the way back to

Re: [DISCUSS] KIP-759: Unneeded repartition canceling

Hi Sophie and Matthias, thanks for your comments and replies. 1. Scope of change: KStreams only or KStreams/KTable I took some time to digest your points, looking through how KStreams triggers repartitions today. I noticed that `repartitionRequired`is a flag in KStreamImpl etc and not in

Re: [ANNOUNCE] Apache Kafka 3.5.1

Thanks Divij :) On Mon, Jul 24, 2023 at 2:28 PM Luke Chen wrote: > > Thanks for running the release! > > Luke > > On Mon, Jul 24, 2023 at 6:35 PM Manyanda Chitimbo < > manyanda.chiti...@gmail.com> wrote: > > > Thanks for running the release Divij. > > > > On Mon 24 Jul 2023 at 12:15, Kamal

Re: Re: [DISCUSS] KIP-951: Leader discovery optimisations for the client

Thanks Jose/David/Ismael for your inputs. Not bumping the version, would require both broker & client to backport changes. Especially for FetchResponse, as backporting would have to be done all the way back to 3.1, so this effort isn't trivial, and was originally underestimated. Considering

Re: Re: [DISCUSS] KIP-951: Leader discovery optimisations for the client

Hi Crispin, One additional question, the wiki says "The results are averaged over 2 runs.". Can you please provide some measure of variance in the distribution, i.e. were both results similar to each other for both cases? Ismael On Fri, Jul 21, 2023 at 11:31 AM Ismael Juma wrote: > Thanks for

Re: Re: [DISCUSS] KIP-951: Leader discovery optimisations for the client

On Mon, Jul 24, 2023 at 3:32 PM David Jacot wrote: > 01. Hum... I understand your reasoning. I think that this is mainly > beneficial for clients lagging behind in terms of supported versions. > However, it is the opposite for the java client which is up to date. > Personally, I would rather

Re: [DISCUSS] KIP-714: Client metrics and observability

Hi Milind, Thanks for your questions about the KIP. 1) I did some archaeology and looked at historical versions of the KIP. I think this is just a mistake. 5 minutes is the default metric push interval. 30 minutes is a mystery to me. I’ve updated the KIP. 2) I think there are two situations in

Re: Re: [DISCUSS] KIP-951: Leader discovery optimisations for the client

Hi Mayank, 01. Hum... I understand your reasoning. I think that this is mainly beneficial for clients lagging behind in terms of supported versions. However, it is the opposite for the java client which is up to date. Personally, I would rather prefer to bump both versions and to add the tagged

Re: [VOTE] KIP-949: Add flag to enable the usage of topic separator in MM2 DefaultReplicationPolicy

Hi Chris, I updated the KIP to address your feedback. Thanks for the vote. On Mon, Jul 24, 2023 at 1:30 PM Chris Egerton wrote: > Hi Omnia, > > I think there's a few clarifications that should still be made on the KIP, > but assuming these are agreeable, I'm +1 (binding) > > - In the

Re: Re: [DISCUSS] KIP-951: Leader discovery optimisations for the client

Hey Mayank, It is probably binary compatible to have the NodeEndponts fielld at taggedVersion 12+ but I think it is misleading as a code reviewer. The Java Kafka client at version 12 will never be able to handle those fields. Or are you planning to backport these improvements to those clients and

[jira] [Created] (KAFKA-15242) FixedKeyProcessor testing is unusable

Zlstibor Veljkovic created KAFKA-15242: -- Summary: FixedKeyProcessor testing is unusable Key: KAFKA-15242 URL: https://issues.apache.org/jira/browse/KAFKA-15242 Project: Kafka Issue

Re: [DISCUSS] KIP-942: Add Power(ppc64le) support

Hi Vaibhav 1. Could you please add the details that we discussed here in this thread to the KIP (e.g. why is it safe to add this infra now and which other projects are using it). This would help to have KIP as a source of record if someone wants to read about this decision in future. 2. Given

Re: [VOTE] KIP-949: Add flag to enable the usage of topic separator in MM2 DefaultReplicationPolicy

Hi Omnia, I think there's a few clarifications that should still be made on the KIP, but assuming these are agreeable, I'm +1 (binding) - In the description for the replication.policy.internal.topic.separator.enabled property (in the "Public Interfaces" section), we should specify that it

Re: [ANNOUNCE] Apache Kafka 3.5.1

Thanks for running the release! Luke On Mon, Jul 24, 2023 at 6:35 PM Manyanda Chitimbo < manyanda.chiti...@gmail.com> wrote: > Thanks for running the release Divij. > > On Mon 24 Jul 2023 at 12:15, Kamal Chandraprakash < > kamal.chandraprak...@gmail.com> wrote: > > > Thanks for running the

Re: Apache Kafka 3.6.0 release

A gentle reminder on the KIP freeze date: 26th Jul. Please try to close discussion/vote threads asap. Thanks, Satish. On Sun, 23 Jul 2023 at 11:10, Satish Duggana wrote: > > Thanks Colov/Divij for adding the KIP-952. I do not think it is a > blocker for 3.6.0. We can discuss the KIP in the

Re: [ANNOUNCE] Apache Kafka 3.5.1

Thanks for running the release Divij. On Mon 24 Jul 2023 at 12:15, Kamal Chandraprakash < kamal.chandraprak...@gmail.com> wrote: > Thanks for running the release, Divij! > > On Mon, Jul 24, 2023 at 3:17 PM Divij Vaidya wrote: > > > The Apache Kafka community is pleased to announce the release

Re: [ANNOUNCE] Apache Kafka 3.5.1

Thanks for running the release, Divij! On Mon, Jul 24, 2023 at 3:17 PM Divij Vaidya wrote: > The Apache Kafka community is pleased to announce the release for Apache > Kafka 3.5.1 > > This release is a security patch release. It upgrades the dependency, > snappy-java, to a version which is not

[jira] [Created] (KAFKA-15241) Compute tiered offset by keeping the respective epochs in scope.

Satish Duggana created KAFKA-15241: -- Summary: Compute tiered offset by keeping the respective epochs in scope. Key: KAFKA-15241 URL: https://issues.apache.org/jira/browse/KAFKA-15241 Project: Kafka

[ANNOUNCE] Apache Kafka 3.5.1

The Apache Kafka community is pleased to announce the release for Apache Kafka 3.5.1 This release is a security patch release. It upgrades the dependency, snappy-java, to a version which is not vulnerable to CVE-2023-34455. You can find more information about the CVE at Kafka CVE list

[jira] [Created] (KAFKA-15240) BrokerToControllerChannelManager cache activeController error cause DefaultAlterPartitionManager send AlterPartition request failed

shilin Lu created KAFKA-15240: - Summary: BrokerToControllerChannelManager cache activeController error cause DefaultAlterPartitionManager send AlterPartition request failed Key: KAFKA-15240 URL:

[DISCUSS] KIP-930: Tiered Storage Metrics

Hi All, I created KIP-930 for adding RemoteIndexCache stats and also to rename some tiered storage metrics added as part of KIP-405 to remove ambiguity.

[GitHub] [kafka-site] divijvaidya merged pull request #533: MINOR: Website changes for 3.5.1 release

divijvaidya merged PR #533: URL: https://github.com/apache/kafka-site/pull/533 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[jira] [Created] (KAFKA-15239) producerPerformance system test for old client failed after v3.5.0

Luke Chen created KAFKA-15239: - Summary: producerPerformance system test for old client failed after v3.5.0 Key: KAFKA-15239 URL: https://issues.apache.org/jira/browse/KAFKA-15239 Project: Kafka

[jira] [Created] (KAFKA-15238) Connect workers can be disabled by DLQ related stuck admin client calls

Yash Mayya created KAFKA-15238: -- Summary: Connect workers can be disabled by DLQ related stuck admin client calls Key: KAFKA-15238 URL: https://issues.apache.org/jira/browse/KAFKA-15238 Project: Kafka

[jira] [Created] (KAFKA-15237) Implement `offsets.commit.timeout.ms` setting

David Jacot created KAFKA-15237: --- Summary: Implement `offsets.commit.timeout.ms` setting Key: KAFKA-15237 URL: https://issues.apache.org/jira/browse/KAFKA-15237 Project: Kafka Issue Type:

Re: [VOTE] KIP-949: Add flag to enable the usage of topic separator in MM2 DefaultReplicationPolicy

+1 (non binding) Thanks Fede On Sun, Jul 23, 2023 at 6:30 PM Omnia Ibrahim wrote: > > Hi everyone, > I would like to open a vote for KIP-949. The proposal is here >