Re: [PR] KAFKA-19658: Tweak org.apache.kafka.clients.consumer.OffsetAndMetadata [kafka]

2025-09-03 Thread via GitHub
chia7712 commented on PR #20451: URL: https://github.com/apache/kafka/pull/20451#issuecomment-3250540921 > had in mind for items 1 and 3. `leaderEpoch=" + leaderEpoch().orElse(null)` looks good to me > Were we supposed to add tests for metadata null -> "" normalization too?

Re: [PR] MINOR: Cleanup Connect Module (5/n) [kafka]

2025-09-03 Thread via GitHub
sjhajharia commented on code in PR #20393: URL: https://github.com/apache/kafka/pull/20393#discussion_r2320832128 ## connect/runtime/src/main/java/org/apache/kafka/connect/runtime/rest/entities/PluginInfo.java: ## @@ -19,85 +19,30 @@ import org.apache.kafka.connect.runtime.isol

Re: [PR] KAFKA-19255: KRaft request manager should support one in-flight request per request type [kafka]

2025-09-03 Thread via GitHub
github-actions[bot] commented on PR #19668: URL: https://github.com/apache/kafka/pull/19668#issuecomment-3251693693 This PR is being marked as stale since it has not had any activity in 90 days. If you would like to keep this PR alive, please leave a comment asking for a review. If the P

Re: [PR] KAFKA-3987: Replace MD5 for FIPS 140-3 compliance in Log Cleaner. [kafka]

2025-09-03 Thread via GitHub
github-actions[bot] commented on PR #19035: URL: https://github.com/apache/kafka/pull/19035#issuecomment-3251693584 This PR is being marked as stale since it has not had any activity in 90 days. If you would like to keep this PR alive, please leave a comment asking for a review. If the P

Re: [PR] KAFKA-18913: Remove state.updater.enabled flag from StreamThread and … [kafka]

2025-09-03 Thread via GitHub
github-actions[bot] commented on PR #20392: URL: https://github.com/apache/kafka/pull/20392#issuecomment-3251632128 A label of 'needs-attention' was automatically added to this PR in order to raise the attention of the committers. Once this issue has been triaged, the `triage` label s

Re: [PR] POC: conditional creation of internal topics in Kafka Connect [kafka]

2025-09-03 Thread via GitHub
github-actions[bot] commented on PR #20384: URL: https://github.com/apache/kafka/pull/20384#issuecomment-3251632214 A label of 'needs-attention' was automatically added to this PR in order to raise the attention of the committers. Once this issue has been triaged, the `triage` label s

Re: [PR] Update EndToEndLatency.java [kafka]

2025-09-03 Thread via GitHub
github-actions[bot] commented on PR #19934: URL: https://github.com/apache/kafka/pull/19934#issuecomment-3251632825 A label of 'needs-attention' was automatically added to this PR in order to raise the attention of the committers. Once this issue has been triaged, the `triage` label s

Re: [PR] KAFKA-19174 Gradle version upgrade 8 -->> 9 [kafka]

2025-09-03 Thread via GitHub
github-actions[bot] commented on PR #19513: URL: https://github.com/apache/kafka/pull/19513#issuecomment-3251633067 A label of 'needs-attention' was automatically added to this PR in order to raise the attention of the committers. Once this issue has been triaged, the `triage` label s

[PR] Bump requests from 2.32.3 to 2.32.4 in /.github/scripts [kafka]

2025-09-03 Thread via GitHub
dependabot[bot] opened a new pull request, #20473: URL: https://github.com/apache/kafka/pull/20473 Bumps [requests](https://github.com/psf/requests) from 2.32.3 to 2.32.4. Release notes Sourced from https://github.com/psf/requests/releases";>requests's releases. v2.32.4 2

Re: [PR] KAFKA-19589: Reduce number of events generated in AsyncKafkaConsumer.updateFetchPositions() [kafka]

2025-09-03 Thread via GitHub
kirktrue commented on PR #20324: URL: https://github.com/apache/kafka/pull/20324#issuecomment-3251191351 > I definitely like the idea of having a consolidated `DoEverythingNeededForFetchEvent` that handles the logic that's currently split up across `PollEvent`, `CheckAndUpdatePositionsEvent

Re: [PR] KAFKA-19668: processValue() must be declared as value-changing operation [kafka]

2025-09-03 Thread via GitHub
mjsax commented on PR #20470: URL: https://github.com/apache/kafka/pull/20470#issuecomment-3251162350 Thanks both -- I am still wondering what changes we need to test this better? Eg, system tests? -- We also need more changes for the release noted / upgrade guide, and we might even want to

Re: [PR] KAFKA-19668: processValue() must be declared as value-changing operation [kafka]

2025-09-03 Thread via GitHub
mjsax commented on code in PR #20470: URL: https://github.com/apache/kafka/pull/20470#discussion_r2320350843 ## streams/src/main/java/org/apache/kafka/streams/kstream/internals/KStreamImpl.java: ## @@ -1350,7 +1355,11 @@ public KStream processValues( final ProcessorToS

Re: [PR] KAFKA-19589: Reduce number of events generated in AsyncKafkaConsumer.updateFetchPositions() [kafka]

2025-09-03 Thread via GitHub
kirktrue commented on code in PR #20324: URL: https://github.com/apache/kafka/pull/20324#discussion_r2320346572 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/ThreadSafeAsyncConsumerState.java: ## @@ -0,0 +1,160 @@ +/* + * Licensed to the Apache Software Fo

Re: [PR] KAFKA-19589: Reduce number of events generated in AsyncKafkaConsumer.updateFetchPositions() [kafka]

2025-09-03 Thread via GitHub
kirktrue commented on code in PR #20324: URL: https://github.com/apache/kafka/pull/20324#discussion_r2320346572 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/ThreadSafeAsyncConsumerState.java: ## @@ -0,0 +1,160 @@ +/* + * Licensed to the Apache Software Fo

Re: [PR] KAFKA-19589: Reduce number of events generated in AsyncKafkaConsumer.updateFetchPositions() [kafka]

2025-09-03 Thread via GitHub
kirktrue commented on PR #20324: URL: https://github.com/apache/kafka/pull/20324#issuecomment-3250946011 > Thanks for the updates! I'm afraid we are still introducing gaps (comment below) by splitting the logic of the existing `CheckAndUpdatePositionsEvent` event into the app thread and bac

Re: [PR] KAFKA-19259: Async consumer fetch intermittent delays on console consumer [kafka]

2025-09-03 Thread via GitHub
kirktrue commented on code in PR #19980: URL: https://github.com/apache/kafka/pull/19980#discussion_r2320189450 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/AbstractFetch.java: ## @@ -222,6 +222,10 @@ protected void handleFetchSuccess(final Node fetchTarg

Re: [PR] KAFKA-19432: Add an ERROR log message if broker.heartbeat.interval.ms is too large [kafka]

2025-09-03 Thread via GitHub
chia7712 merged PR #20046: URL: https://github.com/apache/kafka/pull/20046 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafka.apache

Re: [PR] KAFKA-19668: processValue() must be declared as value-changing operation [kafka]

2025-09-03 Thread via GitHub
lucasbru commented on code in PR #20470: URL: https://github.com/apache/kafka/pull/20470#discussion_r2320275918 ## streams/src/main/java/org/apache/kafka/streams/kstream/internals/KStreamImpl.java: ## @@ -1350,7 +1355,11 @@ public KStream processValues( final Processor

Re: [PR] KAFKA-19259: Async consumer fetch intermittent delays on console consumer [kafka]

2025-09-03 Thread via GitHub
kirktrue commented on code in PR #19980: URL: https://github.com/apache/kafka/pull/19980#discussion_r2320217963 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/FetchBuffer.java: ## @@ -98,7 +98,8 @@ void add(CompletedFetch completedFetch) { try {

Re: [PR] KAFKA-18220: Refactor AsyncConsumerMetrics to not extend KafkaConsumerMetrics [kafka]

2025-09-03 Thread via GitHub
chia7712 commented on code in PR #20283: URL: https://github.com/apache/kafka/pull/20283#discussion_r2319988221 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/ShareConsumerImpl.java: ## @@ -1116,19 +1116,23 @@ private boolean processBackgroundEvents() {

Re: [PR] KAFKA-19259: Async consumer fetch intermittent delays on console consumer [kafka]

2025-09-03 Thread via GitHub
kirktrue commented on code in PR #19980: URL: https://github.com/apache/kafka/pull/19980#discussion_r2320220634 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/AbstractFetch.java: ## @@ -222,6 +222,10 @@ protected void handleFetchSuccess(final Node fetchTarg

Re: [PR] KAFKA-19259: Async consumer fetch intermittent delays on console consumer [kafka]

2025-09-03 Thread via GitHub
kirktrue commented on code in PR #19980: URL: https://github.com/apache/kafka/pull/19980#discussion_r2320188205 ## clients/clients-integration-tests/src/test/java/org/apache/kafka/clients/consumer/PlaintextConsumerTest.java: ## @@ -1588,6 +1590,75 @@ private void sendCompressedM

[jira] [Assigned] (KAFKA-19668) processValues() must be declared as value-changing operation

2025-09-03 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-19668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax reassigned KAFKA-19668: --- Assignee: Matthias J. Sax > processValues() must be declared as value-changing oper

[jira] [Resolved] (KAFKA-19535) add integration tests for DescribeProducersOptions#brokerId

2025-09-03 Thread Chia-Ping Tsai (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-19535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-19535. Fix Version/s: 4.2.0 Resolution: Fixed > add integration tests for DescribeProducer

Re: [PR] MINOR: Refactor CLI tools to use CommandLineUtils#maybePrintHelpOrVersion [kafka]

2025-09-03 Thread via GitHub
Yunyung commented on PR #20469: URL: https://github.com/apache/kafka/pull/20469#issuecomment-3250577602 Great. LGTM, thanks. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

Re: [PR] MINOR: Fix failed e2e compatibility_test_new_broker_test and upgrade_test.py [kafka]

2025-09-03 Thread via GitHub
chia7712 commented on code in PR #20471: URL: https://github.com/apache/kafka/pull/20471#discussion_r2319940997 ## tests/kafkatest/services/verifiable_producer.py: ## @@ -249,7 +249,14 @@ def start_cmd(self, node, idx): if self.repeating_keys is not None: c

Re: [PR] KAFKA-19658: Tweak org.apache.kafka.clients.consumer.OffsetAndMetadata [kafka]

2025-09-03 Thread via GitHub
chia7712 commented on code in PR #20451: URL: https://github.com/apache/kafka/pull/20451#discussion_r2320005613 ## clients/clients-integration-tests/src/test/java/org/apache/kafka/clients/consumer/PlaintextConsumerTest.java: ## @@ -553,14 +553,18 @@ private void testInterceptors

Re: [PR] KAFKA-19467: Add a metric for controller thread idleness [kafka]

2025-09-03 Thread via GitHub
MahsaSeifikar commented on code in PR #20422: URL: https://github.com/apache/kafka/pull/20422#discussion_r2319986360 ## metadata/src/main/java/org/apache/kafka/controller/QuorumController.java: ## @@ -549,6 +550,7 @@ private Throwable handleEventException( } else {

Re: [PR] MINOR: extend consumer close java doc with error handling behaviour [kafka]

2025-09-03 Thread via GitHub
chia7712 commented on code in PR #20472: URL: https://github.com/apache/kafka/pull/20472#discussion_r2320011286 ## clients/src/main/java/org/apache/kafka/clients/consumer/KafkaConsumer.java: ## @@ -1833,6 +1838,9 @@ public void close(Duration timeout) { * {@link ConsumerCo

[jira] [Resolved] (KAFKA-19432) Add an ERROR log message if broker.heartbeat.interval.ms is too large

2025-09-03 Thread Chia-Ping Tsai (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-19432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-19432. Fix Version/s: 4.2.0 Resolution: Fixed > Add an ERROR log message if broker.heartbe

Re: [PR] KAFKA-19668: processValue() must be declared as value-changing operation [kafka]

2025-09-03 Thread via GitHub
bbejeck commented on code in PR #20470: URL: https://github.com/apache/kafka/pull/20470#discussion_r2319992952 ## streams/src/test/java/org/apache/kafka/streams/kstream/internals/graph/StreamsGraphTest.java: ## @@ -386,20 +392,20 @@ private int getCountOfRepartitionTopicsFound(f

Re: [PR] KAFKA-19668: processValue() must be declared as value-changing operation [kafka]

2025-09-03 Thread via GitHub
mjsax commented on code in PR #20470: URL: https://github.com/apache/kafka/pull/20470#discussion_r2319983417 ## streams/src/main/java/org/apache/kafka/streams/TopologyConfig.java: ## @@ -86,6 +87,28 @@ */ @SuppressWarnings("deprecation") public final class TopologyConfig ext

Re: [PR] KAFKA-19668: processValue() must be declared as value-changing operation [kafka]

2025-09-03 Thread via GitHub
mjsax commented on code in PR #20470: URL: https://github.com/apache/kafka/pull/20470#discussion_r2319982525 ## streams/src/main/java/org/apache/kafka/streams/TopologyConfig.java: ## @@ -86,6 +87,28 @@ */ @SuppressWarnings("deprecation") public final class TopologyConfig ext

[PR] MINOR: extend consumer close java doc with error handling behaviour [kafka]

2025-09-03 Thread via GitHub
lianetm opened a new pull request, #20472: URL: https://github.com/apache/kafka/pull/20472 Add to the consumer.close java doc to describe the error handling behaviour. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use th

Re: [PR] KAFKA-19668: processValue() must be declared as value-changing operation [kafka]

2025-09-03 Thread via GitHub
bbejeck commented on code in PR #20470: URL: https://github.com/apache/kafka/pull/20470#discussion_r2319932841 ## streams/src/main/java/org/apache/kafka/streams/TopologyConfig.java: ## @@ -86,6 +87,28 @@ */ @SuppressWarnings("deprecation") public final class TopologyConfig e

Re: [PR] KAFKA-19668: processValue() must be declared as value-chaning operation [kafka]

2025-09-03 Thread via GitHub
mjsax commented on code in PR #20470: URL: https://github.com/apache/kafka/pull/20470#discussion_r2319958062 ## streams/src/test/java/org/apache/kafka/streams/kstream/internals/graph/StreamsGraphTest.java: ## @@ -386,20 +392,20 @@ private int getCountOfRepartitionTopicsFound(fin

Re: [PR] KAFKA-19535: add integration tests for DescribeProducersOptions#brokerId [kafka]

2025-09-03 Thread via GitHub
chia7712 merged PR #20420: URL: https://github.com/apache/kafka/pull/20420 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafka.apache

[PR] MINOR: Fix failed e2e compatibility_test_new_broker_test and upgrade_test.py [kafka]

2025-09-03 Thread via GitHub
JimmyWang6 opened a new pull request, #20471: URL: https://github.com/apache/kafka/pull/20471 #20390 Replace the -`-producer.config` for the verifiable producer and `--consumer.config` option by `--command-config` for the verifiable consumer. However, for e2e tests targeting older broker v

[PR] KAFKA-19668: processValue() must be declared as value-chaning operation [kafka]

2025-09-03 Thread via GitHub
mjsax opened a new pull request, #20470: URL: https://github.com/apache/kafka/pull/20470 With "merge.repartition.topic" optimization enabled, Kafka Streams tries to push repartition topics upstream, to be able to merge multiple repartition topics from different downstream branches together.

Re: [PR] MINOR: Refactor JmxTool and StreamsResetter to use CommandLineUtils#maybePrintHelpOrVersion [kafka]

2025-09-03 Thread via GitHub
Yunyung commented on PR #20469: URL: https://github.com/apache/kafka/pull/20469#issuecomment-3250370171 Thanks for the PR. I see the same pattern in ReplicaVerificationTool.java; could you update it as well? Also, it would be great if you could provide the before and after output results

Re: [PR] KAFKA-19467: Add a metric for controller thread idleness [kafka]

2025-09-03 Thread via GitHub
ahuang98 commented on code in PR #20422: URL: https://github.com/apache/kafka/pull/20422#discussion_r2319808559 ## metadata/src/main/java/org/apache/kafka/controller/QuorumController.java: ## @@ -549,6 +550,7 @@ private Throwable handleEventException( } else {

[jira] [Resolved] (KAFKA-19011) Improve EndToEndLatency Tool with argument parser and message key/header support

2025-09-03 Thread Chia-Ping Tsai (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-19011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-19011. Fix Version/s: 4.2.0 Resolution: Fixed > Improve EndToEndLatency Tool with argument

Re: [PR] KAFKA-19011: Improve EndToEndLatency Tool with argument parser and message key/header support [kafka]

2025-09-03 Thread via GitHub
chia7712 merged PR #20301: URL: https://github.com/apache/kafka/pull/20301 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafka.apache

[jira] [Created] (KAFKA-19669) Improve repartition optimization

2025-09-03 Thread Matthias J. Sax (Jira)
Matthias J. Sax created KAFKA-19669: --- Summary: Improve repartition optimization Key: KAFKA-19669 URL: https://issues.apache.org/jira/browse/KAFKA-19669 Project: Kafka Issue Type: Bug

[PR] MINOR: Refactor JmxTool and StreamsResetter to use CommandLineUtils#maybePrintHelpOrVersion [kafka]

2025-09-03 Thread via GitHub
apalan60 opened a new pull request, #20469: URL: https://github.com/apache/kafka/pull/20469 Refactor help and version handling in command-line tools by replacing duplicate code with `CommandLineUtils#maybePrintHelpOrVersion`. -- This is an automated message from the Apache Git Service. To

[jira] [Updated] (KAFKA-19669) Improve repartition optimization

2025-09-03 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-19669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-19669: Issue Type: Improvement (was: Bug) > Improve repartition optimization > -

Re: [PR] KAFKA-19653: Improve metavariable names in usage messages [kafka]

2025-09-03 Thread via GitHub
Yunyung commented on code in PR #20438: URL: https://github.com/apache/kafka/pull/20438#discussion_r2319771084 ## tools/src/main/java/org/apache/kafka/tools/VerifiableShareConsumer.java: ## @@ -547,14 +548,15 @@ private static ArgumentParser argParser() { .setDefaul

Re: [PR] KAFKA-19653: Improve metavariable names in usage messages [kafka]

2025-09-03 Thread via GitHub
Yunyung commented on code in PR #20438: URL: https://github.com/apache/kafka/pull/20438#discussion_r2319771084 ## tools/src/main/java/org/apache/kafka/tools/VerifiableShareConsumer.java: ## @@ -547,14 +548,15 @@ private static ArgumentParser argParser() { .setDefaul

Re: [PR] KAFKA-19653: Improve metavariable names in usage messages [kafka]

2025-09-03 Thread via GitHub
Yunyung commented on code in PR #20438: URL: https://github.com/apache/kafka/pull/20438#discussion_r2319771084 ## tools/src/main/java/org/apache/kafka/tools/VerifiableShareConsumer.java: ## @@ -547,14 +548,15 @@ private static ArgumentParser argParser() { .setDefaul

Re: [PR] KAFKA-19112 Unifying LIST-Type Configuration Validation and Default Values [kafka]

2025-09-03 Thread via GitHub
chia7712 commented on code in PR #20334: URL: https://github.com/apache/kafka/pull/20334#discussion_r2319744748 ## connect/runtime/src/main/java/org/apache/kafka/connect/runtime/rest/RestServerConfig.java: ## @@ -139,12 +139,12 @@ public abstract class RestServerConfig extends

Re: [PR] MINOR: fix docs references to missing features that are no longer missing [kafka]

2025-09-03 Thread via GitHub
chia7712 merged PR #20435: URL: https://github.com/apache/kafka/pull/20435 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafka.apache

Re: [PR] MINOR: fix docs references to missing features that are no longer missing [kafka]

2025-09-03 Thread via GitHub
chia7712 commented on PR #19498: URL: https://github.com/apache/kafka/pull/19498#issuecomment-3250160433 the successor is #20435 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comme

Re: [PR] MINOR: Cleanup Connect Module (5/n) [kafka]

2025-09-03 Thread via GitHub
chia7712 commented on code in PR #20393: URL: https://github.com/apache/kafka/pull/20393#discussion_r2319705983 ## connect/runtime/src/main/java/org/apache/kafka/connect/runtime/rest/entities/PluginInfo.java: ## @@ -19,85 +19,30 @@ import org.apache.kafka.connect.runtime.isolat

Re: [PR] KAFKA-19653: Improve metavariable names in usage messages [kafka]

2025-09-03 Thread via GitHub
chia7712 commented on code in PR #20438: URL: https://github.com/apache/kafka/pull/20438#discussion_r2319682177 ## tools/src/main/java/org/apache/kafka/tools/VerifiableShareConsumer.java: ## @@ -547,14 +548,15 @@ private static ArgumentParser argParser() { .setDefau

[jira] [Updated] (KAFKA-19666) Clean up integration tests related to state-updater

2025-09-03 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-19666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-19666: Component/s: unit tests > Clean up integration tests related to state-updater > --

Re: [PR] KAFKA-19625: Consistency of command-line arguments for verifiable producer/consumer [kafka]

2025-09-03 Thread via GitHub
AndrewJSchofield commented on code in PR #20390: URL: https://github.com/apache/kafka/pull/20390#discussion_r2319525684 ## tests/kafkatest/services/verifiable_producer.py: ## @@ -249,7 +249,7 @@ def start_cmd(self, node, idx): if self.repeating_keys is not None:

Re: [PR] KAFKA-15038: Replace topicIdByPartitionMap with MetadataCache instance in RemoteLogManager [kafka]

2025-09-03 Thread via GitHub
aheev commented on code in PR #20256: URL: https://github.com/apache/kafka/pull/20256#discussion_r2319418482 ## storage/src/main/java/org/apache/kafka/server/log/remote/storage/RemoteLogManager.java: ## @@ -490,8 +479,8 @@ public void onLeadershipChange(Set partitionsBecomeLead

Re: [PR] KAFKA-19625: Consistency of command-line arguments for verifiable producer/consumer [kafka]

2025-09-03 Thread via GitHub
omkreddy commented on code in PR #20390: URL: https://github.com/apache/kafka/pull/20390#discussion_r2319391162 ## tests/kafkatest/services/verifiable_producer.py: ## @@ -249,7 +249,7 @@ def start_cmd(self, node, idx): if self.repeating_keys is not None: cm

[jira] [Created] (KAFKA-19668) processValues() must be declared as value-changing operation

2025-09-03 Thread Matthias J. Sax (Jira)
Matthias J. Sax created KAFKA-19668: --- Summary: processValues() must be declared as value-changing operation Key: KAFKA-19668 URL: https://issues.apache.org/jira/browse/KAFKA-19668 Project: Kafka

Re: [PR] KAFKA-19478 [3/N]: Use heaps to discover the least loaded process [kafka]

2025-09-03 Thread via GitHub
lucasbru merged PR #20172: URL: https://github.com/apache/kafka/pull/20172 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafka.apache

Re: [PR] KAFKA-19620: Move AutoTopicCreationManager to server module [kafka]

2025-09-03 Thread via GitHub
frankvicky commented on code in PR #20383: URL: https://github.com/apache/kafka/pull/20383#discussion_r2319276289 ## server/src/main/java/org/apache/kafka/server/DefaultAutoTopicCreationManager.java: ## @@ -0,0 +1,255 @@ +/* + * Licensed to the Apache Software Foundation (ASF) u

[jira] [Commented] (KAFKA-19381) Add a ConfigDef.ConfigKey builder

2025-09-03 Thread Claude Warren (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-19381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18017921#comment-18017921 ] Claude Warren commented on KAFKA-19381: --- Mailing list discussion: https://lists.a

Re: [PR] MINOR: Cleanup 'share' from group.coordinator.rebalance.protocols [kafka]

2025-09-03 Thread via GitHub
AndrewJSchofield commented on PR #20466: URL: https://github.com/apache/kafka/pull/20466#issuecomment-3249561868 @elmoctarebnou There are some build failures. Please check the logs and resolve. For example: ``` Error: /home/runner/work/kafka/kafka/core/src/test/scala/unit/kafka/s

Re: [PR] KAFKA-19624: Improving consistency of command-line arguments for consumer performance tests [kafka]

2025-09-03 Thread via GitHub
AndrewJSchofield commented on PR #20385: URL: https://github.com/apache/kafka/pull/20385#issuecomment-3249552935 > > Thanks for the PR. Once we have a green build, I'm ready to merge this. > > Shouldn't we wait for this? I am trying to run the tests, but running into some issues >

[jira] [Resolved] (KAFKA-19653) Improve metavariable names for verifiable producer/consumer

2025-09-03 Thread Andrew Schofield (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-19653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Schofield resolved KAFKA-19653. -- Resolution: Fixed > Improve metavariable names for verifiable producer/consumer >

Re: [PR] KAFKA-19653: Improve metavariable names in usage messages [kafka]

2025-09-03 Thread via GitHub
AndrewJSchofield merged PR #20438: URL: https://github.com/apache/kafka/pull/20438 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafk

Re: [PR] KAFKA-19661 [4/N]: Use below-quota as a condition for standby task assignment [kafka]

2025-09-03 Thread via GitHub
lucasbru commented on code in PR #20458: URL: https://github.com/apache/kafka/pull/20458#discussion_r2315959967 ## group-coordinator/src/main/java/org/apache/kafka/coordinator/group/streams/assignor/StickyTaskAssignor.java: ## @@ -185,11 +195,13 @@ private void assignActive(fina

Re: [PR] MINOR: Cleanup 'share' from group.coordinator.rebalance.protocols [kafka]

2025-09-03 Thread via GitHub
elmoctarebnou commented on code in PR #20466: URL: https://github.com/apache/kafka/pull/20466#discussion_r2319107607 ## .gitignore: ## @@ -31,6 +31,8 @@ TAGS Vagrantfile.local /logs .DS_Store +.bloop/ Review Comment: Thanks for the review, @AndrewJSchofield. I’ve reverted

[PR] KAFKA-18704: Move ScramPublisher to metadata module [kafka]

2025-09-03 Thread via GitHub
see-quick opened a new pull request, #20468: URL: https://github.com/apache/kafka/pull/20468 This PR moves the ScramPublisher class from the server metadata package to the dedicated metadata module. During refactoring, I found out that I also need to move the CredentialProvider interface to

Re: [PR] KAFKA-19467: Add a metric for controller thread idleness [kafka]

2025-09-03 Thread via GitHub
MahsaSeifikar commented on PR #20422: URL: https://github.com/apache/kafka/pull/20422#issuecomment-3249255423 @chia7712 Could you please review this metric KIP when you get a chance? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to Gi

Re: [PR] KAFKA-19259: Async consumer fetch intermittent delays on console consumer [kafka]

2025-09-03 Thread via GitHub
lianetm commented on code in PR #19980: URL: https://github.com/apache/kafka/pull/19980#discussion_r2318963044 ## clients/clients-integration-tests/src/test/java/org/apache/kafka/clients/consumer/PlaintextConsumerTest.java: ## @@ -1588,6 +1590,75 @@ private void sendCompressedMe

Re: [PR] KAFKA-19661 [4/N]: Use below-quota as a condition for standby task assignment [kafka]

2025-09-03 Thread via GitHub
Copilot commented on code in PR #20458: URL: https://github.com/apache/kafka/pull/20458#discussion_r2318899271 ## group-coordinator/src/main/java/org/apache/kafka/coordinator/group/streams/assignor/StickyTaskAssignor.java: ## @@ -103,19 +113,19 @@ private void initialize(final G

Re: [PR] KAFKA-19431: Ensure consumer and share assignment consistency with subscriptions [kafka]

2025-09-03 Thread via GitHub
dajac commented on code in PR #20055: URL: https://github.com/apache/kafka/pull/20055#discussion_r2318877931 ## group-coordinator/src/main/java/org/apache/kafka/coordinator/group/GroupMetadataManager.java: ## @@ -3089,9 +3111,9 @@ private static boolean isNotEmpty(String value)

Re: [PR] KAFKA-19666: Clean up integration tests related to state-updater [kafka]

2025-09-03 Thread via GitHub
shashankhs11 commented on code in PR #20462: URL: https://github.com/apache/kafka/pull/20462#discussion_r2318872382 ## streams/integration-tests/src/test/java/org/apache/kafka/streams/integration/KafkaStreamsTelemetryIntegrationTest.java: ## @@ -303,16 +304,15 @@ public void sho

Re: [PR] KAFKA-19666: Clean up integration tests related to state-updater [kafka]

2025-09-03 Thread via GitHub
lucasbru commented on code in PR #20462: URL: https://github.com/apache/kafka/pull/20462#discussion_r2318823100 ## streams/integration-tests/src/test/java/org/apache/kafka/streams/integration/KafkaStreamsTelemetryIntegrationTest.java: ## @@ -303,16 +304,15 @@ public void shouldP

Re: [PR] KAFKA-19259: Async consumer fetch intermittent delays on console consumer [kafka]

2025-09-03 Thread via GitHub
AndrewJSchofield commented on code in PR #19980: URL: https://github.com/apache/kafka/pull/19980#discussion_r2318806420 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/AbstractFetch.java: ## @@ -222,6 +222,10 @@ protected void handleFetchSuccess(final Node f

Re: [PR] MINOR: Add metrics corresponding to consumer rebalance listener metrics [kafka]

2025-09-03 Thread via GitHub
Copilot commented on code in PR #20464: URL: https://github.com/apache/kafka/pull/20464#discussion_r2318793769 ## streams/src/main/java/org/apache/kafka/streams/processor/internals/DefaultStreamsRebalanceListener.java: ## @@ -91,16 +107,21 @@ public Optional onTasksAssigned(fina

[jira] [Resolved] (KAFKA-19417) Clear static member assignment on join with different subscription

2025-09-03 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-19417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot resolved KAFKA-19417. - Resolution: Duplicate > Clear static member assignment on join with different subscription > ---

Re: [PR] KAFKA-19624: Improving consistency of command-line arguments for consumer performance tests [kafka]

2025-09-03 Thread via GitHub
aheev commented on PR #20385: URL: https://github.com/apache/kafka/pull/20385#issuecomment-3248992064 > Thanks for the PR. Once we have a green build, I'm ready to merge this. Shouldn't we wait for this? I am trying to run the tests, but running into some issues > Since you hav

Re: [PR] KAFKA-19259: Async consumer fetch intermittent delays on console consumer [kafka]

2025-09-03 Thread via GitHub
AndrewJSchofield commented on code in PR #19980: URL: https://github.com/apache/kafka/pull/19980#discussion_r2318715441 ## clients/clients-integration-tests/src/test/java/org/apache/kafka/clients/consumer/PlaintextConsumerTest.java: ## @@ -1588,6 +1590,75 @@ private void sendCom

[jira] [Assigned] (KAFKA-19417) Clear static member assignment on join with different subscription

2025-09-03 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-19417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot reassigned KAFKA-19417: --- Assignee: David Jacot (was: Sean Quah) > Clear static member assignment on join with diffe

[jira] [Resolved] (KAFKA-18220) Refactor AsyncConsumerMetrics so they are appropriate for share consumers

2025-09-03 Thread Andrew Schofield (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-18220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Schofield resolved KAFKA-18220. -- Fix Version/s: 4.2.0 Resolution: Fixed > Refactor AsyncConsumerMetrics so they

Re: [PR] KAFKA-18220: Refactor AsyncConsumerMetrics to not extend KafkaConsumerMetrics [kafka]

2025-09-03 Thread via GitHub
AndrewJSchofield merged PR #20283: URL: https://github.com/apache/kafka/pull/20283 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafk

Re: [PR] KAFKA-18220: Refactor AsyncConsumerMetrics to not extend KafkaConsumerMetrics [kafka]

2025-09-03 Thread via GitHub
ShivsundarR commented on PR #20283: URL: https://github.com/apache/kafka/pull/20283#issuecomment-3248851776 Thanks @AndrewJSchofield, I used the `consumer-perf-test.sh` and `share-consumer-perf-test.sh` tools to print the metrics before and after the changes. - For `ClassicKafkaConsu

Re: [PR] KAFKA-19518: Remove the usage of KafkaMetricsGroup(Class klass) [kafka]

2025-09-03 Thread via GitHub
Yunyung commented on code in PR #20399: URL: https://github.com/apache/kafka/pull/20399#discussion_r2318573502 ## core/src/main/scala/kafka/server/AbstractFetcherManager.scala: ## @@ -30,7 +30,9 @@ import scala.jdk.OptionConverters._ abstract class AbstractFetcherManager[T <:

Re: [PR] KAFKA-19490: Remove usages of distutils in docker scripts [kafka]

2025-09-03 Thread via GitHub
mimaison commented on PR #20178: URL: https://github.com/apache/kafka/pull/20178#issuecomment-3248674398 Can you also resolve the conflict? Thanks -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

Re: [PR] Bump requests from 2.31.0 to 2.32.4 in /tests [kafka]

2025-09-03 Thread via GitHub
mimaison merged PR #19940: URL: https://github.com/apache/kafka/pull/19940 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafka.apache

Re: [PR] KAFKA-19518: Remove the usage of KafkaMetricsGroup(Class klass) [kafka]

2025-09-03 Thread via GitHub
kuoche1712003 commented on code in PR #20399: URL: https://github.com/apache/kafka/pull/20399#discussion_r2318536120 ## core/src/main/scala/kafka/server/AbstractFetcherManager.scala: ## @@ -30,7 +30,9 @@ import scala.jdk.OptionConverters._ abstract class AbstractFetcherManage

Re: [PR] KAFKA-19086: Add support for microsecond precision for Connect [kafka]

2025-09-03 Thread via GitHub
mimaison commented on PR #19845: URL: https://github.com/apache/kafka/pull/19845#issuecomment-3248596607 Thanks for the PR! This modifies the Kafka Connect public API, so in order to accept this change we need to have a Kafka Improvement Proposal (KIP). See the process on https://cwi

Re: [PR] MINOR: Cleanup Connect Module (5/n) [kafka]

2025-09-03 Thread via GitHub
sjhajharia commented on code in PR #20393: URL: https://github.com/apache/kafka/pull/20393#discussion_r2318467236 ## connect/runtime/src/main/java/org/apache/kafka/connect/runtime/rest/entities/PluginInfo.java: ## @@ -45,59 +46,23 @@ public PluginInfo(PluginDesc plugin) {

Re: [PR] KAFKA-19624: Improving consistency of command-line arguments for consumer performance tests [kafka]

2025-09-03 Thread via GitHub
AndrewJSchofield commented on PR #20385: URL: https://github.com/apache/kafka/pull/20385#issuecomment-3248580711 @aheev Please resolve conflicts -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to th

Re: [PR] KAFKA-17834 Improvement the Dockerfile [kafka]

2025-09-03 Thread via GitHub
mimaison commented on PR #17554: URL: https://github.com/apache/kafka/pull/17554#issuecomment-3248561958 @chia7712 Did you have other comments? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

Re: [PR] KAFKA-15307: Kafka Streams configuration docs outdated [kafka]

2025-09-03 Thread via GitHub
mimaison commented on PR #20408: URL: https://github.com/apache/kafka/pull/20408#issuecomment-3248423413 > Will hold of merging until 4.1 went out, and I can cherry-pick to AK 4.1 branch Feel free to merge and backport to 4.1. I've bumped 4.1 to 4.1.1-SNAPSHOT, it's open to commits

Re: [PR] KAFKA-19654 [WIP] test issues with GitHub actions builds <<--->> Develocity instance (for both trunk/Gradle 8 and attempted upgrade to Gradle 9) [kafka]

2025-09-03 Thread via GitHub
dejan2609 commented on PR #20450: URL: https://github.com/apache/kafka/pull/20450#issuecomment-3248401370 Much obliged Ken @m1a2st :ok_hand: ! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[PR] KAFKA-19667: Close ShareConsumer in ShareConsumerPerformance after metrics displayed [kafka]

2025-09-03 Thread via GitHub
AndrewJSchofield opened a new pull request, #20467: URL: https://github.com/apache/kafka/pull/20467 Ensure that metrics are retrieved and displayed (when requested) before ShareConsumer.close() is called. This is important because metrics are technically supposed to be removed on ShareC

Re: [PR] MINOR: Cleanups in Connect [kafka]

2025-09-03 Thread via GitHub
mimaison merged PR #20077: URL: https://github.com/apache/kafka/pull/20077 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafka.apache

[jira] [Commented] (KAFKA-19613) Expose consumer CorruptRecordException as case of KafkaException

2025-09-03 Thread Uladzislau Blok (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-19613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18017511#comment-18017511 ] Uladzislau Blok commented on KAFKA-19613: - About CRC checksum validation, that's

[jira] [Created] (KAFKA-19665) Reduce waiting on event completion in AsyncKafkaConsumer.pollForRecords()

2025-09-03 Thread Kirk True (Jira)
Kirk True created KAFKA-19665: - Summary: Reduce waiting on event completion in AsyncKafkaConsumer.pollForRecords() Key: KAFKA-19665 URL: https://issues.apache.org/jira/browse/KAFKA-19665 Project: Kafka

[jira] [Commented] (KAFKA-19601) always disallow min.insync.replicas at the broker level

2025-09-03 Thread Jhen-Yung Hsu (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-19601?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18017729#comment-18017729 ] Jhen-Yung Hsu commented on KAFKA-19601: --- I've started the discussion thread: [htt

Re: [PR] KAFKA-19564: Close Consumer in ConsumerPerformance only after metrics displayed [kafka]

2025-09-03 Thread via GitHub
chia7712 commented on code in PR #20267: URL: https://github.com/apache/kafka/pull/20267#discussion_r2318289086 ## tools/src/main/java/org/apache/kafka/tools/ConsumerPerformance.java: ## @@ -66,45 +69,42 @@ public static void main(String[] args) { if (!options.hideH

  1   2   >