RE: Re: [DISCUSS] KIP-1150 Diskless Topics

Greg, Thanks for the revisions on KIP-1150 and KIP-1163. I like the idea of reusing KIP-405 tiered storage and Kafka’s strength on using page cache and local log segment file which greatly simplifies the design and implementation. I have a few questions: HC1: The design is aiming for both dis

Jenkins build is still unstable: Kafka » Kafka PowerPC Daily » test-powerpc #410

See

Jenkins build is unstable: Kafka » Kafka Branch Builder » 3.9 #219

See

Re: [DISCUSS] The Path Forward for Saving Cross-AZ Costs KIPs

Hi all, Thanks for looking into the cost-saving KIPs holistically. KIP-1150 has changed substantially, so i'll copy the summary I posted from the other thread: > We have just updated KIP-1150 and KIP-1163 with a new design. To summarize the changes: > 1. The design prioritizes integrating with th

Re: Discussion on Apache Kafka 4.0.0 Connect

Hi Edwin, Thanks for your question. If you're seeing that WARN message, you're in the default hybrid_warn mode and shouldn't experience any change in operating behavior. That message may be unrelated/a distraction from the problem you're experiencing. > I have explicitly defined the plugin.path

Re: [DISCUSS] KIP-1150 Diskless Topics

Hi all, Thank you all for your questions and design input on KIP-1150. We have just updated KIP-1150 and KIP-1163 with a new design. To summarize the changes: 1. The design prioritizes integrating with the existing KIP-405 Tiered Storage interfaces, permitting data produced to a Diskless topic t

[jira] [Resolved] (KAFKA-19432) Add an ERROR log message if broker.heartbeat.interval.ms is too large

[ https://issues.apache.org/jira/browse/KAFKA-19432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-19432. Fix Version/s: 4.2.0 Resolution: Fixed > Add an ERROR log message if broker.heartbe

[jira] [Resolved] (KAFKA-19535) add integration tests for DescribeProducersOptions#brokerId

[ https://issues.apache.org/jira/browse/KAFKA-19535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-19535. Fix Version/s: 4.2.0 Resolution: Fixed > add integration tests for DescribeProducer

[jira] [Resolved] (KAFKA-19011) Improve EndToEndLatency Tool with argument parser and message key/header support

[ https://issues.apache.org/jira/browse/KAFKA-19011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-19011. Fix Version/s: 4.2.0 Resolution: Fixed > Improve EndToEndLatency Tool with argument

[jira] [Created] (KAFKA-19669) Improve repartition optimization

Matthias J. Sax created KAFKA-19669: --- Summary: Improve repartition optimization Key: KAFKA-19669 URL: https://issues.apache.org/jira/browse/KAFKA-19669 Project: Kafka Issue Type: Bug

Re: [DISCUSS] KIP-1159: Large message reference based Serializer

Hi Greg, sorry for late respond as I was away for few days > Thanks for pointing this out, I agree that KIP-1163 does not address these > multi-tenant concerns. I brought up KIP-1163 because I thought it would > solve some but not all of the large-message concerns. > However, the technical proble

Re: [VOTE] 4.0.1 RC1

Heya Matthias, I have no issue with creating a new RC once the solution is in. The issue does sound critical enough to be fixed given that the previous method was removed. Best, Christo On Wed, 3 Sept 2025 at 17:58, Matthias J. Sax wrote: > Hello, > > I hate to be the messenger (again), but we

Re: [VOTE] 4.0.1 RC1

Hello, I hate to be the messenger (again), but we just found another critical bug in Kafka Streams: https://issues.apache.org/jira/browse/KAFKA-19668 This one is a little bit more tricky, as it is technically not a regression, ie, the issue exists since AK 3.3.0 release. However, with AK 4.0

Re: [DISCUSS] KIP-1206: Strict max fetch records in share fetch

Hi Jimmy, Thank you for the KIP. I'm sure I'll have more comments yet as I think through how it will work in practice, and also the work that we are looking to do in the consumer as part of Kafka 4.2 around flow control and memory usage. The behaviour in KIP-932 is expecting that the consuming ap

[jira] [Created] (KAFKA-19668) processValues() must be declared as value-changing operation

Matthias J. Sax created KAFKA-19668: --- Summary: processValues() must be declared as value-changing operation Key: KAFKA-19668 URL: https://issues.apache.org/jira/browse/KAFKA-19668 Project: Kafka

Re: [VOTE] 4.0.1 RC1

Hello! Thank you everyone for carrying out checks and pointing out misses on my side! I have opened 2 PRs against the asf-site repository: One contains the Javadocs as per RC1 - https://github.com/apache/kafka-site/pull/718 The other contains the site-docs as per RC1 - https://github.com/apache/k

Re: [PR] MINOR: Add 4.0.1 docs [kafka-site]

clolov commented on PR #719: URL: https://github.com/apache/kafka-site/pull/719#issuecomment-3249665912 I had a quick check, because I was surprised to see the protocol_messages.html being included. As far as I can see the additions (I spot-checked some of them), have been present since Dec

[PR] MINOR: Add 4.0.1 docs [kafka-site]

clolov opened a new pull request, #719: URL: https://github.com/apache/kafka-site/pull/719 (no comment) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-ma

Re: [DISCUSS] KIP-1198: implement a ConfigKey.Builder class

Greetings, I started this topic awhile back and have had no comments so I assume that there is no objection to the proposal. I have created an implementation and updated an earlier PR that requested the KIP process be followed. I would appreciate a review of the PR and/or comments on the KIP.

[PR] Add Javadoc for 4.0.1 [kafka-site]

clolov opened a new pull request, #718: URL: https://github.com/apache/kafka-site/pull/718 This PR is to add the updated 4.0.1 Javadocs to the Kafka website. I have decided to split the Javadoc addition from the remaining documentation addition. -- This is an automated message from the Ap

[jira] [Resolved] (KAFKA-19653) Improve metavariable names for verifiable producer/consumer

[ https://issues.apache.org/jira/browse/KAFKA-19653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Schofield resolved KAFKA-19653. -- Resolution: Fixed > Improve metavariable names for verifiable producer/consumer >

Re: [VOTE] 4.0.1 RC1

Hi Christo, I verified 4.0.1-rc1 as follows: - Built and ran all unit and integration tests from the source tarball (OpenJDK 23 Zulu) - Verified basic produce and consume functionality - Verified signatures and checksums of the downloaded artifacts +1 (non-binding) Thanks for the release! Hong-

[jira] [Resolved] (KAFKA-19417) Clear static member assignment on join with different subscription

[ https://issues.apache.org/jira/browse/KAFKA-19417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot resolved KAFKA-19417. - Resolution: Duplicate > Clear static member assignment on join with different subscription > ---

[jira] [Resolved] (KAFKA-18220) Refactor AsyncConsumerMetrics so they are appropriate for share consumers

[ https://issues.apache.org/jira/browse/KAFKA-18220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Schofield resolved KAFKA-18220. -- Fix Version/s: 4.2.0 Resolution: Fixed > Refactor AsyncConsumerMetrics so they

Re: [VOTE] 4.0.1 RC1

+1 (non-binding). I did some smoke testing with the staged binaries, and I also ran the Strimzi test suite against the 4.0.1 release. All seems to work fine. Thanks for running the release. Jakub On Tue, Aug 19, 2025 at 5:43 PM Christo Lolov wrote: > Hello Kafka users, developers and client-de

Re: [DISCUSS] KIP-1209: Add configuration to control internal topic creation in Kafka Connect

Thanks for your question. The *auto.create.topics.enable* configuration will remain a broker-level setting. The new proposed configuration,* internal.topics.creation*, will be a Kafka Connect–level setting. For Kafka Connect internal topics, there is a requirement that these topics must have *cle

[jira] [Created] (KAFKA-19667) Close ShareConsumer in ShareConsumerPerformance only after metrics displayed

Andrew Schofield created KAFKA-19667: Summary: Close ShareConsumer in ShareConsumerPerformance only after metrics displayed Key: KAFKA-19667 URL: https://issues.apache.org/jira/browse/KAFKA-19667

Re: [VOTE] 4.1.0 RC3

Hi Mickael, I did the following: - Run quickstart using the artifacts - Verified the static quorum upgrading to dynamic quorum works - Browsed the document, focusing on the dynamic quorum sections - Browsed the java doc +1 (binding) from me. Thank you, Luke On Mon, Sep 1, 2025 at 7:05 PM 黃竣陽 w

[jira] [Resolved] (KAFKA-19574) Improve producer and consumer config files

[ https://issues.apache.org/jira/browse/KAFKA-19574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Chen resolved KAFKA-19574. --- Resolution: Fixed > Improve producer and consumer config files > ---

Re: [VOTE] 4.0.1 RC1

Hi Christo, I did the following: 1. Verified the signatures and checksum. 2. Run all the quickstart 3. Verified the kraft.version cannot be upgraded to 1. 4. Verified the "state-change" log name is correct Note: I didn't see the v4.0.1 document update PR in kafka-site repo. Please remember to upd

[jira] [Created] (KAFKA-19661) Streams groups sometimes describe as NOT_READY when STABLE

Lucas Brutschy created KAFKA-19661: -- Summary: Streams groups sometimes describe as NOT_READY when STABLE Key: KAFKA-19661 URL: https://issues.apache.org/jira/browse/KAFKA-19661 Project: Kafka

Re: Re: [DISCUSS] KIP-1209: Add configuration to control internal topic creation in Kafka Connect

Thanks for the idea. I’ve updated the KIP and PR to use the new config name On Tue, Sep 2, 2025 at 5:53 PM Andrei Rudkouski wrote: > Hi Anton, > > Thanks for the KIP! > > Maybe it would be better to name the variable similarly to the existing > topic.creation.enable, for example internal.topic.c

[jira] [Created] (KAFKA-19665) Reduce waiting on event completion in AsyncKafkaConsumer.pollForRecords()

Kirk True created KAFKA-19665: - Summary: Reduce waiting on event completion in AsyncKafkaConsumer.pollForRecords() Key: KAFKA-19665 URL: https://issues.apache.org/jira/browse/KAFKA-19665 Project: Kafka

[jira] [Created] (KAFKA-19659) Wrong generic type for UnregisterBrokerOptions

Luke Chen created KAFKA-19659: - Summary: Wrong generic type for UnregisterBrokerOptions Key: KAFKA-19659 URL: https://issues.apache.org/jira/browse/KAFKA-19659 Project: Kafka Issue Type: Bug

[PR] Updated the documentation to align with broker changes. [kafka-site]

elmoctarebnou opened a new pull request, #717: URL: https://github.com/apache/kafka-site/pull/717 Updated the documentation to align with broker changes. The config group.coordinator.rebalance.protocols no longer accepts share as a valid value. Share Groups should instead be enabled through

Re: Discussion on Apache Kafka 4.0.0 Connect

Hello Edwin. This is the developer email list, I think your query probably belongs in the user email list. However, I believe your question highlights an issue that migrating to 4.0 and the new plugin discovery isn't documented well enough. The answer to your question is found here https://k