Re: [DISCUSS] KIP-853: KRaft Controller Membership Changes

2024-01-09 Thread Colin McCabe
On Tue, Jan 9, 2024, at 17:07, Jason Gustafson wrote: > Hi Jose, > > Thanks for the KIP! A few initial questions below: > > 1. In the user experience section, the user is expected to provide supply > the UUID for each voter. I'm assuming this is the directory.id coming from > KIP-858. I thought it

Re: [PR] Add get support page [kafka-site]

2024-01-09 Thread via GitHub
showuon commented on code in PR #577: URL: https://github.com/apache/kafka-site/pull/577#discussion_r1446975450 ## support.html: ## @@ -0,0 +1,54 @@ + + + + + + + Support + Community support + + +

[jira] [Resolved] (KAFKA-15735) KRaft support in SaslMultiMechanismConsumerTest

2024-01-09 Thread Manikumar (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikumar resolved KAFKA-15735. --- Fix Version/s: 3.8.0 Resolution: Fixed > KRaft support in SaslMultiMechanismConsumerTest >

Re: [DISCUSS] KIP-1014: Managing Unstable Metadata Versions in Apache Kafka

2024-01-09 Thread Colin McCabe
On Tue, Jan 9, 2024, at 18:56, Proven Provenzano wrote: > Hi folks, > > Thank you for the questions. > > Let me clarify about reorder first. The reorder of unstable metadata > versions should be infrequent. Why does it need to be infrequent? We should be able to reorder unstable metadata

Re: [PR] Add get support page [kafka-site]

2024-01-09 Thread via GitHub
fpapon commented on code in PR #577: URL: https://github.com/apache/kafka-site/pull/577#discussion_r1446950508 ## support.html: ## @@ -0,0 +1,54 @@ + + + + + + + Support + Community support + + +

Re: [PR] Add get support page [kafka-site]

2024-01-09 Thread via GitHub
fpapon commented on code in PR #577: URL: https://github.com/apache/kafka-site/pull/577#discussion_r1446949226 ## support.html: ## @@ -0,0 +1,54 @@ + + + + + + + Support + Community support + + +

Re: [PR] Add get support page [kafka-site]

2024-01-09 Thread via GitHub
fpapon commented on code in PR #577: URL: https://github.com/apache/kafka-site/pull/577#discussion_r1446947444 ## support.html: ## @@ -0,0 +1,54 @@ + + + + + + + Support + Community support + + +

Re: [PR] Add get support page [kafka-site]

2024-01-09 Thread via GitHub
fpapon commented on code in PR #577: URL: https://github.com/apache/kafka-site/pull/577#discussion_r1446946324 ## support.html: ## @@ -0,0 +1,54 @@ + + + + + + + Support + Community support + + +

Re: [PR] Add get support page [kafka-site]

2024-01-09 Thread via GitHub
fpapon commented on code in PR #577: URL: https://github.com/apache/kafka-site/pull/577#discussion_r1446946944 ## support.html: ## @@ -0,0 +1,54 @@ + + + + + + + Support + Community support + + +

PR https://github.com/apache/kafka/pull/14531

2024-01-09 Thread James Olsen
Would appreciate it if someone would take a look at https://github.com/apache/kafka/pull/14531. A fairly simple enhancement to allow me to stop using a deprecated API. Thanks.

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #2555

2024-01-09 Thread Apache Jenkins Server
See

Jenkins build is unstable: Kafka » Kafka Branch Builder » 3.7 #56

2024-01-09 Thread Apache Jenkins Server
See

Re: [DISCUSS] KIP-1014: Managing Unstable Metadata Versions in Apache Kafka

2024-01-09 Thread Proven Provenzano
Hi folks, Thank you for the questions. Let me clarify about reorder first. The reorder of unstable metadata versions should be infrequent. The time you reorder is when a feature that requires a higher metadata version to enable becomes "production ready" and the features with unstable metadata

Re: [DISCUSS] KIP-853: KRaft Controller Membership Changes

2024-01-09 Thread Jason Gustafson
Hi Jose, Thanks for the KIP! A few initial questions below: 1. In the user experience section, the user is expected to provide supply the UUID for each voter. I'm assuming this is the directory.id coming from KIP-858. I thought it was generated by the format comand automatically? It seems like

Re: [DISCUSS] KIP-853: KRaft Controller Membership Changes

2024-01-09 Thread Colin McCabe
Hi José, Thanks for the revisions. I'm really excited to see this going forward for Kafka 3.8. One important piece of feedback that a lot of people have given me is that they really want auto-formatting in KRaft mode. In other words, they want to start up a process and just have it do the

[jira] [Resolved] (KAFKA-16094) BrokerRegistrationRequest.logDirs field must be ignorable

2024-01-09 Thread Colin McCabe (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin McCabe resolved KAFKA-16094. -- Fix Version/s: 3.7.0 Resolution: Fixed > BrokerRegistrationRequest.logDirs field must

Re: Apache Kafka 3.7.0 Release

2024-01-09 Thread Colin McCabe
KAFKA-16094 has been fixed and backported to 3.7. Colin On Mon, Jan 8, 2024, at 14:52, Colin McCabe wrote: > On an unrelated note, I found a blocker bug related to upgrades from > 3.6 (and earlier) to 3.7. > > The JIRA is here: > https://issues.apache.org/jira/browse/KAFKA-16094 > > Fix

Re: [PR] Add get support page [kafka-site]

2024-01-09 Thread via GitHub
rmannibucau commented on code in PR #577: URL: https://github.com/apache/kafka-site/pull/577#discussion_r1446679772 ## support.html: ## @@ -0,0 +1,54 @@ + + + + + + + Support + Community support + + +

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #2554

2024-01-09 Thread Apache Jenkins Server
See

[jira] [Resolved] (KAFKA-15946) AsyncKafkaConsumer should retry commits on the application thread instead of auto-retry

2024-01-09 Thread Lianet Magrans (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lianet Magrans resolved KAFKA-15946. Fix Version/s: 3.7.0 (was: 3.8.0) Assignee: Lianet Magrans

[jira] [Resolved] (KAFKA-15967) Fix revocation in reconcilation logic

2024-01-09 Thread Lianet Magrans (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lianet Magrans resolved KAFKA-15967. Fix Version/s: 3.7.0 (was: 3.8.0) Assignee: Lianet Magrans

Re: [PR] Add get support page [kafka-site]

2024-01-09 Thread via GitHub
ableegoldman commented on code in PR #577: URL: https://github.com/apache/kafka-site/pull/577#discussion_r1446628388 ## support.html: ## @@ -0,0 +1,54 @@ + + + + + + + Support + Community support + + +

[jira] [Resolved] (KAFKA-15872) Investigate autocommit retry logic

2024-01-09 Thread Lianet Magrans (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lianet Magrans resolved KAFKA-15872. Fix Version/s: (was: 3.8.0) Resolution: Duplicate > Investigate autocommit

[jira] [Resolved] (KAFKA-15455) Add support for OffsetCommit version 9 in consumer

2024-01-09 Thread Lianet Magrans (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lianet Magrans resolved KAFKA-15455. Fix Version/s: 3.7.0 (was: 3.8.0) Resolution: Fixed > Add

Re: [DISCUSS] KIP-1014: Managing Unstable Metadata Versions in Apache Kafka

2024-01-09 Thread Colin McCabe
Hi Justine, Yes, this is an important point to clarify. Proven can comment more, but my understanding is that we can do anything to unstable metadata versions. Reorder them, delete them, change them in any other way. There are no stability guarantees. If the current text is unclear let's add

Re: Kafka trunk test & build stability

2024-01-09 Thread Colin McCabe
Sorry, but to put it bluntly, the current build setup isn't good enough at partial rebuilds that build caching would make sense. All Kafka devs have had the experience of needing to clean the build directory in order to get a valid build. The scala code esspecially seems to have this issue.

[jira] [Created] (KAFKA-16106) group size counters do not reflect the actual sizes when operations fail

2024-01-09 Thread Jeff Kim (Jira)
Jeff Kim created KAFKA-16106: Summary: group size counters do not reflect the actual sizes when operations fail Key: KAFKA-16106 URL: https://issues.apache.org/jira/browse/KAFKA-16106 Project: Kafka

[jira] [Reopened] (KAFKA-15250) DefaultBackgroundThread is running tight loop

2024-01-09 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True reopened KAFKA-15250: --- Assignee: Kirk True (was: Philip Nee) > DefaultBackgroundThread is running tight loop >

[jira] [Resolved] (KAFKA-15941) Flaky test: shouldRestoreNullRecord() – org.apache.kafka.streams.integration.RestoreIntegrationTest

2024-01-09 Thread Lucas Brutschy (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lucas Brutschy resolved KAFKA-15941. Resolution: Cannot Reproduce > Flaky test: shouldRestoreNullRecord() – >

[jira] [Resolved] (KAFKA-16099) Handle timeouts for AsyncKafkaConsumer.commitSync

2024-01-09 Thread Lianet Magrans (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lianet Magrans resolved KAFKA-16099. Fix Version/s: 3.7.0 Resolution: Fixed > Handle timeouts for

Re: [VOTE] KIP-994: Minor Enhancements to ListTransactions and DescribeTransactions APIs

2024-01-09 Thread Justine Olshan
Thanks Raman. +1 (binding) from me as well. Justine On Tue, Jan 9, 2024 at 10:12 AM Jun Rao wrote: > Hi, Raman, > > Thanks for the KIP. +1 from me. > > Jun > > On Tue, Dec 26, 2023 at 11:32 AM Raman Verma > wrote: > > > I would like to start a Vote on KIP-994 > > > > > > >

[jira] [Created] (KAFKA-16105) Reassignment of tiered topics is failing due to RemoteStorageException

2024-01-09 Thread Anatolii Popov (Jira)
Anatolii Popov created KAFKA-16105: -- Summary: Reassignment of tiered topics is failing due to RemoteStorageException Key: KAFKA-16105 URL: https://issues.apache.org/jira/browse/KAFKA-16105 Project:

Re: [VOTE] KIP-994: Minor Enhancements to ListTransactions and DescribeTransactions APIs

2024-01-09 Thread Jun Rao
Hi, Raman, Thanks for the KIP. +1 from me. Jun On Tue, Dec 26, 2023 at 11:32 AM Raman Verma wrote: > I would like to start a Vote on KIP-994 > > > https://cwiki.apache.org/confluence/display/KAFKA/KIP-994%3A+Minor+Enhancements+to+ListTransactions+and+DescribeTransactions+APIs >

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #2553

2024-01-09 Thread Apache Jenkins Server
See

Re: [PR] Add get support page [kafka-site]

2024-01-09 Thread via GitHub
fpapon commented on PR #577: URL: https://github.com/apache/kafka-site/pull/577#issuecomment-1883454200 @C0urante good catch! Sorry for the copy/paste error, it's ok now. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

Re: [PR] Add get support page [kafka-site]

2024-01-09 Thread via GitHub
rmannibucau commented on PR #577: URL: https://github.com/apache/kafka-site/pull/577#issuecomment-1883451784 @C0urante yes, this is a small typo @fpapon is aware of but the proposal follows ASF guidelines and the fix is trivial (before or after the merge) so a clear plus for Kafka

Re: [PR] Add get support page [kafka-site]

2024-01-09 Thread via GitHub
jbonofre commented on code in PR #577: URL: https://github.com/apache/kafka-site/pull/577#discussion_r1446363532 ## support.html: ## @@ -0,0 +1,54 @@ + + + + + + + Support + Community support + + +

Re: [PR] Add get support page [kafka-site]

2024-01-09 Thread via GitHub
C0urante commented on code in PR #577: URL: https://github.com/apache/kafka-site/pull/577#discussion_r1446362361 ## support.html: ## @@ -0,0 +1,54 @@ + + + + + + + Support + Community support + + +

Re: [PR] Add get support page [kafka-site]

2024-01-09 Thread via GitHub
jbonofre commented on PR #577: URL: https://github.com/apache/kafka-site/pull/577#issuecomment-1883435388 @C0urante yup it's a copy paste from Camel. I already asked @fpapon to update the page to mention Kafka instead of Camel. -- This is an automated message from the Apache Git Service.

Re: [PR] Add get support page [kafka-site]

2024-01-09 Thread via GitHub
C0urante commented on PR #577: URL: https://github.com/apache/kafka-site/pull/577#issuecomment-1883431881 @jbonofre @rmannibucau did you actually review this PR? Part of it is copy+pasted with no changes from the [Apache Camel

[PR] Add get support page [kafka-site]

2024-01-09 Thread via GitHub
fpapon opened a new pull request, #577: URL: https://github.com/apache/kafka-site/pull/577 Proposal to add a `get support` page to describe how community and commercial support is working, like we have in many other Apache projects. -- This is an automated message from the Apache Git

Build failed in Jenkins: Kafka » Kafka Branch Builder » 3.7 #55

2024-01-09 Thread Apache Jenkins Server
See Changes: -- [...truncated 458989 lines...] > Task :storage:storage-api:compileTestJava > Task :storage:storage-api:testClasses > Task :server:compileTestJava > Task

Re: [VOTE] KIP-995: Allow users to specify initial offsets while creating connectors

2024-01-09 Thread Chris Egerton
Thanks for the KIP! +1 (binding) On Mon, Jan 8, 2024 at 9:35 AM Ashwin wrote: > Hi All, > > I would like to start a vote on KIP-995. > > > https://cwiki.apache.org/confluence/display/KAFKA/KIP-995%3A+Allow+users+to+specify+initial+offsets+while+creating+connectors > > Discussion thread - >

[jira] [Created] (KAFKA-16104) Enable additional PlaintextConsumerTest tests for new consumer

2024-01-09 Thread Andrew Schofield (Jira)
Andrew Schofield created KAFKA-16104: Summary: Enable additional PlaintextConsumerTest tests for new consumer Key: KAFKA-16104 URL: https://issues.apache.org/jira/browse/KAFKA-16104 Project:

[jira] [Created] (KAFKA-16103) Review client logic for triggering offset commit callbacks

2024-01-09 Thread Lianet Magrans (Jira)
Lianet Magrans created KAFKA-16103: -- Summary: Review client logic for triggering offset commit callbacks Key: KAFKA-16103 URL: https://issues.apache.org/jira/browse/KAFKA-16103 Project: Kafka

[jira] [Created] (KAFKA-16102) about DynamicListenerConfig, the dynamic modification of the listener's port or IP does not take effect.

2024-01-09 Thread Jialun Peng (Jira)
Jialun Peng created KAFKA-16102: --- Summary: about DynamicListenerConfig, the dynamic modification of the listener's port or IP does not take effect. Key: KAFKA-16102 URL:

[jira] [Resolved] (KAFKA-15982) Move GenericGroup state metrics to `GroupCoordinatorMetricsShard`

2024-01-09 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot resolved KAFKA-15982. - Resolution: Duplicate Done in KAFKA-15870. > Move GenericGroup state metrics to

[jira] [Resolved] (KAFKA-14949) Add Streams upgrade tests from AK 3.4

2024-01-09 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-14949. - Resolution: Fixed > Add Streams upgrade tests from AK 3.4 >

[jira] [Resolved] (KAFKA-15741) KRaft support in DescribeConsumerGroupTest

2024-01-09 Thread Mickael Maison (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mickael Maison resolved KAFKA-15741. Fix Version/s: 3.8.0 Resolution: Fixed > KRaft support in

[jira] [Resolved] (KAFKA-15870) Move new group coordinator metrics from Yammer to Metrics

2024-01-09 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot resolved KAFKA-15870. - Fix Version/s: 3.7.0 Resolution: Fixed > Move new group coordinator metrics from Yammer

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #2552

2024-01-09 Thread Apache Jenkins Server
See

Jenkins build is still unstable: Kafka » Kafka Branch Builder » 3.7 #54

2024-01-09 Thread Apache Jenkins Server
See

[jira] [Created] (KAFKA-16101) Kafka cluster unavailable during KRaft migration rollback procedure

2024-01-09 Thread Paolo Patierno (Jira)
Paolo Patierno created KAFKA-16101: -- Summary: Kafka cluster unavailable during KRaft migration rollback procedure Key: KAFKA-16101 URL: https://issues.apache.org/jira/browse/KAFKA-16101 Project:

[jira] [Created] (KAFKA-16100) Consistent handling of timeouts and responses for new consumer ApplicationEvents

2024-01-09 Thread Andrew Schofield (Jira)
Andrew Schofield created KAFKA-16100: Summary: Consistent handling of timeouts and responses for new consumer ApplicationEvents Key: KAFKA-16100 URL: https://issues.apache.org/jira/browse/KAFKA-16100

[jira] [Created] (KAFKA-16099) Handle timeouts for AsyncKafkaConsumer.commitSync

2024-01-09 Thread Andrew Schofield (Jira)
Andrew Schofield created KAFKA-16099: Summary: Handle timeouts for AsyncKafkaConsumer.commitSync Key: KAFKA-16099 URL: https://issues.apache.org/jira/browse/KAFKA-16099 Project: Kafka

[jira] [Resolved] (KAFKA-14519) Add metrics to the new coordinator

2024-01-09 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot resolved KAFKA-14519. - Fix Version/s: 3.7.0 Resolution: Fixed > Add metrics to the new coordinator >

[jira] [Resolved] (KAFKA-15726) KRaft support in ProduceRequestTest

2024-01-09 Thread Manikumar (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikumar resolved KAFKA-15726. --- Fix Version/s: 3.8.0 Resolution: Fixed > KRaft support in ProduceRequestTest >

Re: [VOTE] KIP-1012: The need for a Kafka 3.8.x release

2024-01-09 Thread Josep Prat
Hi all, the vote passes with: - 4 binding votes: Colin, Chris, Greg and myself - 1 non-binding vote: Anton Thanks everyone for the discussion and feedback! Best, On Mon, Jan 8, 2024 at 11:08 PM Colin McCabe wrote: > Hi Chris, > > Based on some of the offline discussions we had, people

RE: [DISCUSS] KIP-950: Tiered Storage Disablement

2024-01-09 Thread Doğuşcan Namal
Hi everyone, any progress on the status of this KIP? Overall looks good to me but I wonder whether we still need to support it for Zookeeper mode given that it will be deprecated in the next 3 months. On 2023/07/21 20:16:46 "Beyene, Mehari" wrote: > Hi everyone, > I would like to start a

[jira] [Created] (KAFKA-16098) State updater may attempt to resume a task that is not assigned anymore

2024-01-09 Thread Lucas Brutschy (Jira)
Lucas Brutschy created KAFKA-16098: -- Summary: State updater may attempt to resume a task that is not assigned anymore Key: KAFKA-16098 URL: https://issues.apache.org/jira/browse/KAFKA-16098 Project:

[jira] [Created] (KAFKA-16097) State updater removes task without pending action in EOSv2

2024-01-09 Thread Lucas Brutschy (Jira)
Lucas Brutschy created KAFKA-16097: -- Summary: State updater removes task without pending action in EOSv2 Key: KAFKA-16097 URL: https://issues.apache.org/jira/browse/KAFKA-16097 Project: Kafka

[jira] [Created] (KAFKA-16096) Drop broker and tools support for Java 11 in Kafka 4.0 (deprecate in 3.7) (KIP-1013)

2024-01-09 Thread Ismael Juma (Jira)
Ismael Juma created KAFKA-16096: --- Summary: Drop broker and tools support for Java 11 in Kafka 4.0 (deprecate in 3.7) (KIP-1013) Key: KAFKA-16096 URL: https://issues.apache.org/jira/browse/KAFKA-16096

Re: [VOTE] KIP-1013: Drop broker and tools support for Java 11 in Kafka 4.0 (deprecate in 3.7)

2024-01-09 Thread Ismael Juma
Hi all, The vote passes with: * 8 binding votes (Justine Olshan, Satish Duggana, Viktor Somogyi-Vass, Divij Vaidya, Mickael Maison, Greg Harris, David Arthur, myself) * 1 non-binding vote (Kamal Chandraprakash) Thanks, Ismael On Wed, Jan 3, 2024 at 2:28 AM Ismael Juma wrote: > Hi all, > > I