Re: [DISCUSS] KIP-1014: Managing Unstable Metadata Versions in Apache Kafka

On Fri, Jan 12, 2024, at 11:32, Artem Livshits wrote: > I think using feature flags (whether we support a framework and tooling for > feature flags or just an ad-hoc XyzEnabled flag) can be an alternative to > this KIP. I think the value of this KIP is that it's trying to propose a > systemic

[jira] [Resolved] (KAFKA-16121) Partition reassignments in ZK migration dual write mode stalled until leader epoch incremented

[ https://issues.apache.org/jira/browse/KAFKA-16121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin McCabe resolved KAFKA-16121. -- Fix Version/s: 3.7.0 Reviewer: Colin McCabe Assignee: David Mao

[jira] [Created] (KAFKA-16144) Controller leader checkQuorum timer should skip only 1 controller case

Luke Chen created KAFKA-16144: - Summary: Controller leader checkQuorum timer should skip only 1 controller case Key: KAFKA-16144 URL: https://issues.apache.org/jira/browse/KAFKA-16144 Project: Kafka

[jira] [Resolved] (KAFKA-15809) Update broker's metadata schema to include TS enable status

[ https://issues.apache.org/jira/browse/KAFKA-15809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Phuc Hong Tran resolved KAFKA-15809. Resolution: Won't Fix > Update broker's metadata schema to include TS enable status >

Re: [VOTE] KIP-1005: Expose EarliestLocalOffset and TieredOffset

+1 binding from me. Thanks for the KIP! Luke On Fri, Jan 12, 2024 at 5:41 PM Federico Valeri wrote: > +1 non binding > > Thanks > > On Fri, Jan 12, 2024 at 1:31 AM Boudjelda Mohamed Said > wrote: > > > > +1 (binding) > > > > > > On Fri, Jan 12, 2024 at 1:21 AM Satish Duggana > > > wrote: > >

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #2575

See

Jenkins build is still unstable: Kafka » Kafka Branch Builder » 3.7 #63

See

[jira] [Created] (KAFKA-16142) Update metrics documentation for errors and new metrics

Kirk True created KAFKA-16142: - Summary: Update metrics documentation for errors and new metrics Key: KAFKA-16142 URL: https://issues.apache.org/jira/browse/KAFKA-16142 Project: Kafka Issue

[jira] [Created] (KAFKA-16143) New metrics for KIP-848 protocol

Kirk True created KAFKA-16143: - Summary: New metrics for KIP-848 protocol Key: KAFKA-16143 URL: https://issues.apache.org/jira/browse/KAFKA-16143 Project: Kafka Issue Type: Task

Re: [DISCUSS] KIP-971 Expose replication-offset-lag MirrorMaker2 metric

Apologies, forgot to reply on your last comment about the metric name. I believe both replication-lag and record-lag are a little too abstract - what do you think about either leaving it as replication-offset-lag or renaming to replication-record-lag? Thanks On Wed, 10 Jan 2024 at 15:31, Mickael

Re: [DISCUSS] KIP-971 Expose replication-offset-lag MirrorMaker2 metric

Hi Mickael, Thanks for the response. I've added the proposed default value for the refresh interval config. I've also added a new config to the KIP that will enable a TTL-based eviction policy for the in-memory LRO cache, as @huqedi suggested - also added a proposed default for this configuration.

Re: [DISCUSS] KIP-981: Manage Connect topics with custom implementation of Admin

Hi It has been a while! but can I have a feedback on this. It would be nice to unify this between MM2 and Connect as well. Thanks On Thu, Oct 19, 2023 at 3:14 PM Omnia Ibrahim wrote: > Hi, any thoughts on this kip? > > Thanks > > On Tue, Sep 19, 2023 at 6:04 PM Omnia Ibrahim > wrote: > >> Hi

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #2574

See

Re: [VOTE] 3.7.0 RC2

Hi Stanislav, On Sun, Jan 14, 2024, at 1:17 PM, Stanislav Kozlovski wrote: > Hey Kirk and Chris, > > Unless I'm missing something - KAFKALESS-16029 is simply a bad log due to > improper closing. And the PR description implies this has been present > since 3.5. While annoying, I don't see a

Re: [VOTE] 3.7.0 RC2

I wanted to circle back and confirm the integration tests + system tests, plus give an overall update regarding status. The integration tests have a fair amount of flakes. I ran and inspected 3 consecutive builds (57 , 58

[jira] [Created] (KAFKA-16141) StreamsStandbyTask##test_standby_tasks_rebalanceArguments:{ “metadata_quorum”: “ISOLATED_KRAFT”, “use_new_coordinator”: false} fails consistently in 3.7

Stanislav Kozlovski created KAFKA-16141: --- Summary: StreamsStandbyTask##test_standby_tasks_rebalanceArguments:{ “metadata_quorum”: “ISOLATED_KRAFT”, “use_new_coordinator”: false} fails consistently in 3.7 Key: KAFKA-16141

[jira] [Created] (KAFKA-16140) zookeeper_migration_test#TestMigration#test_recooncile_kraft_to_zk system test fails concistently on 3.7

Stanislav Kozlovski created KAFKA-16140: --- Summary: zookeeper_migration_test#TestMigration#test_recooncile_kraft_to_zk system test fails concistently on 3.7 Key: KAFKA-16140 URL:

[jira] [Created] (KAFKA-16139) StreamsUpgradeTest fails consistently in 3.7.0

Stanislav Kozlovski created KAFKA-16139: --- Summary: StreamsUpgradeTest fails consistently in 3.7.0 Key: KAFKA-16139 URL: https://issues.apache.org/jira/browse/KAFKA-16139 Project: Kafka

[jira] [Created] (KAFKA-16138) QuotaTest system test fails consistently in 3.7

Stanislav Kozlovski created KAFKA-16138: --- Summary: QuotaTest system test fails consistently in 3.7 Key: KAFKA-16138 URL: https://issues.apache.org/jira/browse/KAFKA-16138 Project: Kafka

[jira] [Created] (KAFKA-16137) ListClientMetricsResourcesResponse definition is missing field descriptions

Andrew Schofield created KAFKA-16137: Summary: ListClientMetricsResourcesResponse definition is missing field descriptions Key: KAFKA-16137 URL: https://issues.apache.org/jira/browse/KAFKA-16137

[REVIEW REQUEST] Move StorageTool to tools

Hi folks, this PR has been open for some time now, can anyone have a look? https://github.com/apache/kafka/pull/14847 Thanks.

[jira] [Created] (KAFKA-16136) CoordinatorTest.testTaskRequestWithOldStartMsGetsUpdated() is very flaky

Stanislav Kozlovski created KAFKA-16136: --- Summary: CoordinatorTest.testTaskRequestWithOldStartMsGetsUpdated() is very flaky Key: KAFKA-16136 URL: https://issues.apache.org/jira/browse/KAFKA-16136

[jira] [Created] (KAFKA-16135) kafka.api.PlaintextConsumerTest.testPerPartitionLeadMetricsCleanUpWithSubscribe(String, String).quorum=kraft+kip848.groupProtocol=consumer is flaky

Stanislav Kozlovski created KAFKA-16135: --- Summary: kafka.api.PlaintextConsumerTest.testPerPartitionLeadMetricsCleanUpWithSubscribe(String, String).quorum=kraft+kip848.groupProtocol=consumer is flaky Key: KAFKA-16135

[jira] [Created] (KAFKA-16134) kafka.api.PlaintextConsumerTest.testPerPartitionLagMetricsCleanUpWithSubscribe(String, String).quorum=kraft+kip848.groupProtocol=consumer is flaky

Stanislav Kozlovski created KAFKA-16134: --- Summary: kafka.api.PlaintextConsumerTest.testPerPartitionLagMetricsCleanUpWithSubscribe(String, String).quorum=kraft+kip848.groupProtocol=consumer is flaky Key: KAFKA-16134

Re: [REVIEW REQUEST] ConsumerGroupCommand move to tools

Hello. The PRs still need review. Please, take a look - https://github.com/apache/kafka/pull/14856 > 12 дек. 2023 г., в 11:01, Николай Ижиков написал(а): > > Hello. > > Please, take a time and help me with moving ConsumerGroupCommand move tools > First patch in the series are waiting for

Re: [PROPOSAL] Add commercial support page on website

Hi all, I think that making and updating such a list implies tricky questions that we have to deal with. Good examples were given by Matthias, that was my first thought as well before reading his response. On the other hand I think it would be a good alternative to create a list of companies

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #2573

See

[jira] [Created] (KAFKA-16133) Commits during reconciliation always time out

Lucas Brutschy created KAFKA-16133: -- Summary: Commits during reconciliation always time out Key: KAFKA-16133 URL: https://issues.apache.org/jira/browse/KAFKA-16133 Project: Kafka Issue

[jira] [Created] (KAFKA-16132) Upgrading from 3.6 to 3.7 in KRaft will have seconds of partitions unavailable

Luke Chen created KAFKA-16132: - Summary: Upgrading from 3.6 to 3.7 in KRaft will have seconds of partitions unavailable Key: KAFKA-16132 URL: https://issues.apache.org/jira/browse/KAFKA-16132 Project:

Re: [DISCUSS] KIP-1005: Add EarliestLocalOffset to GetOffsetShell

Heya! Okay, your suggestion also makes sense to me! I have updated the KIP. Best, Christo On Mon, 15 Jan 2024 at 11:51, Luke Chen wrote: > Hi Christo, > > Thanks for the update. > For "-4 or earliest-local" but tiered storage disabled, I agree it should > work as requesting for as "-2 or

[VOTE] KIP-991: Allow DropHeaders SMT to drop headers by wildcard/regexp

Hi all, Thank you for your feedback on the suggested KIP so far. As there seem to be no new updates / suggestions I'd like to start a vote on the (SMT-) KIP 991. Please have a look at KIP-991 . Thanks, Roman

Re: [DISCUSS] KIP-1005: Add EarliestLocalOffset to GetOffsetShell

Hi Christo, Thanks for the update. For "-4 or earliest-local" but tiered storage disabled, I agree it should work as requesting for as "-2 or earliest". For "-5 or latest-tiered" but tiered storage disabled, returning the earliest timestamp doesn't make sense to me. I'm thinking if we can return

[jira] [Resolved] (KAFKA-15740) KRaft support in DeleteOffsetsConsumerGroupCommandIntegrationTest

[ https://issues.apache.org/jira/browse/KAFKA-15740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mickael Maison resolved KAFKA-15740. Fix Version/s: 3.8.0 Resolution: Fixed > KRaft support in

Re: [DISCUSS] KIP-1005: Add EarliestLocalOffset to GetOffsetShell

Heya Luke, Thank for the question! I have expanded in the KIP - in my opinion if -5 (latest-tiered) is requested when tiered storage is disabled Kafka should return -2. My reasoning is that if there is no remote storage then we should be returning an offset which is within the bounds of the log.

Re: [VOTE] 3.7.0 RC2

*> Hi Jakub,> > Thanks for trying the RC. I think what you found is a blocker bug because it * *> will generate huge amount of logspam. I guess we didn't find it in junit tests * *> since logspam doesn't fail the automated tests. But certainly it's not suitable * *> for production. Did you file a

[jira] [Created] (KAFKA-16131) Repeated UnsupportedVersionException logged when running Kafka 3.7.0-RC2 KRaft cluster with metadata version 3.6

Jakub Scholz created KAFKA-16131: Summary: Repeated UnsupportedVersionException logged when running Kafka 3.7.0-RC2 KRaft cluster with metadata version 3.6 Key: KAFKA-16131 URL:

Re: [PR] Add get support page [kafka-site]

fpapon commented on PR #577: URL: https://github.com/apache/kafka-site/pull/577#issuecomment-1891670491 > @fpapon I guess you mean Kafka PMC :) Not Karaf :) Ah yes, sorry, split brain :) I fixed. -- This is an automated message from the Apache Git Service. To respond to the

Re: [PR] Add get support page [kafka-site]

jbonofre commented on PR #577: URL: https://github.com/apache/kafka-site/pull/577#issuecomment-1891649260 @fpapon I guess you mean Kafka PMC :) Not Karaf :) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

Re: [PR] Add get support page [kafka-site]

fpapon commented on PR #577: URL: https://github.com/apache/kafka-site/pull/577#issuecomment-1891642675 As the Apache Karaf PMC rejeted this proposal on the mailing list, I'm closing this PR. Link to the thread: https://lists.apache.org/thread/sld85ly7fvvvlb5bh2856qqcpnckg2on --

Re: [PR] Add get support page [kafka-site]

fpapon closed pull request #577: Add get support page URL: https://github.com/apache/kafka-site/pull/577 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe,

[jira] [Created] (KAFKA-16130) Test migration rollback

Mickael Maison created KAFKA-16130: -- Summary: Test migration rollback Key: KAFKA-16130 URL: https://issues.apache.org/jira/browse/KAFKA-16130 Project: Kafka Issue Type: Sub-task

Re: [PROPOSAL] Add commercial support page on website

Hi Tison, Publishing a dedicated website for that can be a good idea, however if the link of the website could not be mention in the official Apache Kafka website I'm afraid that it will not be relevant. BTW, as I understand after all the feedback of the Apache Kafka PMC and community, my

Re: [PROPOSAL] Add commercial support page on website

Hi Matthias, Thank you for your feedback, it make sense. My proposal was to help user finding support but as you said, may be this is not the right way to address it. regards, François On 13/01/2024 00:34, Matthias J. Sax wrote: François, thanks for starting this initiative. Personally,

Re: Permission to contribute

Hi Rowland, Thanks for your interest in Apache Kafka! Your accounts are all set. Let me know if you have any questions. Best, On Sun, Jan 14, 2024 at 2:17 AM Rowland Smith wrote: > I would like permission to contribute to Kafka. I have created Wiki and > Jira ID's 'rowls'. > > I will be

Re: [VOTE] 3.7.0 RC2

Hi Paolo, Colin, Let's discuss detail about this issue in the PR: https://github.com/apache/kafka/pull/15193 . On Mon, Jan 15, 2024 at 4:21 PM Paolo Patierno wrote: > Hi Colin, > I was the one raising the issue about rollback and I also already tried > what you mentioned but with no success. >

Jenkins build is still unstable: Kafka » Kafka Branch Builder » 3.7 #62

See

Re: [VOTE] 3.7.0 RC2

Hi Colin, I was the one raising the issue about rollback and I also already tried what you mentioned but with no success. During the first rolling, I left the zookeeper.metadata.migration.enable=true but removed controller.quorum.voters and controller.listener.names. This is what I get from the

Re: [VOTE] 3.7.0 RC2

Docs fix discussed in the thread is here: https://github.com/apache/kafka/pull/15193 best, Colin On Sun, Jan 14, 2024, at 23:56, Colin McCabe wrote: > Hi Stanislav, > > Thanks for making the first RC. The fact that it's titled RC2 is > messing with my mind a bit. I hope this doesn't make

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #2572

See