[GitHub] [kafka] showuon commented on pull request #12167: KAFKA-13716 Added the DeleteRecordsCommandTest to test the CLI front end of the D…

2022-05-19 Thread GitBox
showuon commented on PR #12167: URL: https://github.com/apache/kafka/pull/12167#issuecomment-1132408449 > So I'd like to keep the scope of this PR to unit tests. If you think that makes sense, I'll go ahead and open up an issue for it to make sure we track that outstanding item.

[GitHub] [kafka] jsancio merged pull request #12160: KAFKA-13889: Fix AclsDelta to handle ACCESS_CONTROL_ENTRY_RECORD quickly followed by REMOVE_ACCESS_CONTROL_ENTRY_RECORD for same ACL

2022-05-19 Thread GitBox
jsancio merged PR #12160: URL: https://github.com/apache/kafka/pull/12160 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [kafka] junrao commented on a diff in pull request #12005: KAFKA-13803: Refactor Leader API Access

2022-05-19 Thread GitBox
junrao commented on code in PR #12005: URL: https://github.com/apache/kafka/pull/12005#discussion_r877600481 ## core/src/test/scala/unit/kafka/server/epoch/util/ReplicaFetcherMockBlockingSend.scala: ## @@ -40,9 +42,15 @@ import scala.collection.Map *

[jira] [Created] (KAFKA-13918) Schedule or cancel nooprecord write on metadata version change

2022-05-19 Thread Jose Armando Garcia Sancio (Jira)
Jose Armando Garcia Sancio created KAFKA-13918: -- Summary: Schedule or cancel nooprecord write on metadata version change Key: KAFKA-13918 URL: https://issues.apache.org/jira/browse/KAFKA-13918

[jira] [Assigned] (KAFKA-1930) Move server over to new metrics library

2022-05-19 Thread Jose Armando Garcia Sancio (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-1930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jose Armando Garcia Sancio reassigned KAFKA-1930: - Assignee: (was: Aditya Auradkar) > Move server over to new

[GitHub] [kafka] vvcephei commented on a diff in pull request #12186: MINOR: Deflake OptimizedKTableIntegrationTest

2022-05-19 Thread GitBox
vvcephei commented on code in PR #12186: URL: https://github.com/apache/kafka/pull/12186#discussion_r877582344 ## streams/src/test/java/org/apache/kafka/streams/integration/OptimizedKTableIntegrationTest.java: ## @@ -125,31 +131,37 @@ public void

[GitHub] [kafka] vvcephei opened a new pull request, #12186: MINOR: Deflake OptimizedKTableIntegrationTest

2022-05-19 Thread GitBox
vvcephei opened a new pull request, #12186: URL: https://github.com/apache/kafka/pull/12186 This test has been flaky due to unexpected rebalances during the test. This change fixes it by detecting an unexpected rebalance and retrying the test logic (within a timeout). ###

[GitHub] [kafka] rittikaadhikari commented on a diff in pull request #12005: KAFKA-13803: Refactor Leader API Access

2022-05-19 Thread GitBox
rittikaadhikari commented on code in PR #12005: URL: https://github.com/apache/kafka/pull/12005#discussion_r877577941 ## core/src/test/scala/unit/kafka/server/epoch/util/ReplicaFetcherMockBlockingSend.scala: ## @@ -40,9 +42,15 @@ import scala.collection.Map *

[GitHub] [kafka] junrao commented on a diff in pull request #12005: KAFKA-13803: Refactor Leader API Access

2022-05-19 Thread GitBox
junrao commented on code in PR #12005: URL: https://github.com/apache/kafka/pull/12005#discussion_r877559859 ## core/src/main/scala/kafka/server/LocalLeaderEndPoint.scala: ## @@ -0,0 +1,237 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one or more + *

[jira] [Commented] (KAFKA-13913) Provide builders for KafkaProducer/KafkaConsumer and KafkaStreams

2022-05-19 Thread Jira
[ https://issues.apache.org/jira/browse/KAFKA-13913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17539801#comment-17539801 ] François Rosière commented on KAFKA-13913: -- [~mjsax] , thanks for your comment. The two

[GitHub] [kafka] hachikuji opened a new pull request, #12185: MINOR: Fix buildResponseSend test cases for envelope responses

2022-05-19 Thread GitBox
hachikuji opened a new pull request, #12185: URL: https://github.com/apache/kafka/pull/12185 The test cases we have in `RequestChannelTest` for `buildResponseSend` construct the envelope request incorrectly. Basically they confuse the envelope context and the reference to the wrapped

[GitHub] [kafka] cmccabe commented on pull request #12182: MINOR: Use dynamic metadata.version check for KIP-704

2022-05-19 Thread GitBox
cmccabe commented on PR #12182: URL: https://github.com/apache/kafka/pull/12182#issuecomment-1132189652 Thanks for the PR, @mumrah . 1. I agree that tagged fields definitely count as new metadata. `MetadataVersion.IBP_3_2_IV0` is currently marked with `didMetadataChange = false`.

[jira] [Commented] (KAFKA-13595) Allow producing records with null values in Kafka Console Producer

2022-05-19 Thread Ryan (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13595?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17539764#comment-17539764 ] Ryan commented on KAFKA-13595: -- Duplicates https://issues.apache.org/jira/browse/KAFKA-10238 > Allow

[GitHub] [kafka] vamossagar12 commented on pull request #12121: KAFKA-13846: Adding overloaded metricOrElseCreate method

2022-05-19 Thread GitBox
vamossagar12 commented on PR #12121: URL: https://github.com/apache/kafka/pull/12121#issuecomment-1132048815 > > From a public API point of view, Metrics is in a gray area. It is not officially part of our public API however we have a few interfaces leaking it. That being said, we should

[GitHub] [kafka] vamossagar12 commented on a diff in pull request #12121: KAFKA-13846: Adding overloaded metricOrElseCreate method

2022-05-19 Thread GitBox
vamossagar12 commented on code in PR #12121: URL: https://github.com/apache/kafka/pull/12121#discussion_r877394625 ## clients/src/main/java/org/apache/kafka/common/metrics/Metrics.java: ## @@ -563,10 +615,15 @@ public synchronized void removeReporter(MetricsReporter reporter)

[jira] [Commented] (KAFKA-13913) Provide builders for KafkaProducer/KafkaConsumer and KafkaStreams

2022-05-19 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17539718#comment-17539718 ] Matthias J. Sax commented on KAFKA-13913: - There was some discussion about this in the past (cf

[jira] [Updated] (KAFKA-13913) Provide builders for KafkaProducer/KafkaConsumer and KafkaStreams

2022-05-19 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-13913: Labels: kip (was: ) > Provide builders for KafkaProducer/KafkaConsumer and KafkaStreams

[jira] [Updated] (KAFKA-13913) Provide builders for KafkaProducer/KafkaConsumer and KafkaStreams

2022-05-19 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-13913: Component/s: streams > Provide builders for KafkaProducer/KafkaConsumer and KafkaStreams

[GitHub] [kafka] divijvaidya opened a new pull request, #12184: KAFKA-13911: Fix the rate window size calculation for edge cases

2022-05-19 Thread GitBox
divijvaidya opened a new pull request, #12184: URL: https://github.com/apache/kafka/pull/12184 ## Problem Implementation of connection creation rate quotas in Kafka is dependent on two configurations:

[GitHub] [kafka] jsancio opened a new pull request, #12183: KAFKA-13883: Implement NoOpRecord and metadata metrics

2022-05-19 Thread GitBox
jsancio opened a new pull request, #12183: URL: https://github.com/apache/kafka/pull/12183 ### Committer Checklist (excluded from commit message) - [ ] Verify design and implementation - [ ] Verify test coverage and CI build status - [ ] Verify documentation (including

[jira] [Resolved] (KAFKA-13863) Prevent null config value when create topic in KRaft mode

2022-05-19 Thread Jason Gustafson (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson resolved KAFKA-13863. - Fix Version/s: 3.3.0 Resolution: Fixed > Prevent null config value when create

[GitHub] [kafka] hachikuji merged pull request #12109: KAFKA-13863: Prevent null config value when create topic in KRaft mode

2022-05-19 Thread GitBox
hachikuji merged PR #12109: URL: https://github.com/apache/kafka/pull/12109 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [kafka] fvaleri commented on pull request #12159: [WIP] Fix stuck SSL tests in case of authentication failure

2022-05-19 Thread GitBox
fvaleri commented on PR #12159: URL: https://github.com/apache/kafka/pull/12159#issuecomment-1131936314 @divijvaidya I fixed the test you were referring to. I also fixed the help method `sendNoReceive` which was directly using `channel.mute()` instead of

[GitHub] [kafka] mumrah commented on pull request #12182: MINOR: Use dynamic metadata.version check for KIP-704

2022-05-19 Thread GitBox
mumrah commented on PR #12182: URL: https://github.com/apache/kafka/pull/12182#issuecomment-1131934558 FeaturesImage has `metadataVersion()` method which we can make accessible through a supplier for the Image/Delta classes. For broker components like ReplicaManager, we can add an argument

[GitHub] [kafka] mumrah commented on a diff in pull request #12182: MINOR: Use dynamic metadata.version check for KIP-704

2022-05-19 Thread GitBox
mumrah commented on code in PR #12182: URL: https://github.com/apache/kafka/pull/12182#discussion_r877220561 ## metadata/src/main/java/org/apache/kafka/controller/QuorumController.java: ## @@ -1010,6 +1004,11 @@ private void maybeCompleteAuthorizerInitialLoad() { }

[GitHub] [kafka] jsancio commented on a diff in pull request #12182: MINOR: Use dynamic metadata.version check for KIP-704

2022-05-19 Thread GitBox
jsancio commented on code in PR #12182: URL: https://github.com/apache/kafka/pull/12182#discussion_r877200466 ## metadata/src/main/java/org/apache/kafka/controller/QuorumController.java: ## @@ -1010,6 +1004,11 @@ private void maybeCompleteAuthorizerInitialLoad() { }

[GitHub] [kafka] mumrah opened a new pull request, #12182: MINOR: Use dynamic metadata.version check for KIP-704

2022-05-19 Thread GitBox
mumrah opened a new pull request, #12182: URL: https://github.com/apache/kafka/pull/12182 Now that `metadata.version` has been integrated with the controller #12050, we need to make use of the dynamic nature of the feature flag. This patch adds a supplier that is passed down to

[jira] [Resolved] (KAFKA-13807) Ensure that we can set log.flush.interval.ms with IncrementalAlterConfigs

2022-05-19 Thread Colin McCabe (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin McCabe resolved KAFKA-13807. -- Resolution: Fixed > Ensure that we can set log.flush.interval.ms with IncrementalAlterConfigs

[jira] [Assigned] (KAFKA-13807) Ensure that we can set log.flush.interval.ms with IncrementalAlterConfigs

2022-05-19 Thread Colin McCabe (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin McCabe reassigned KAFKA-13807: Assignee: Colin McCabe > Ensure that we can set log.flush.interval.ms with

[GitHub] [kafka] Moovlin commented on pull request #12167: KAFKA-13716 Added the DeleteRecordsCommandTest to test the CLI front end of the D…

2022-05-19 Thread GitBox
Moovlin commented on PR #12167: URL: https://github.com/apache/kafka/pull/12167#issuecomment-1131755255 Thanks for the quick responses. To your first answer, I'm happy to do that and will take a look at the TopciCommandTest for guidance. To your second answer. Integration tests for

[GitHub] [kafka] dajac opened a new pull request, #12181: KAFKA-13916; Fenced replicas should not be allowed to join the ISR in KRaft (KIP-841)

2022-05-19 Thread GitBox
dajac opened a new pull request, #12181: URL: https://github.com/apache/kafka/pull/12181 WIP ### Committer Checklist (excluded from commit message) - [ ] Verify design and implementation - [ ] Verify test coverage and CI build status - [ ] Verify documentation (including

[GitHub] [kafka] viktorsomogyi opened a new pull request, #12180: KAFKA-13917: Avoid calling lookupCoordinator() in tight loop

2022-05-19 Thread GitBox
viktorsomogyi opened a new pull request, #12180: URL: https://github.com/apache/kafka/pull/12180 ### Committer Checklist (excluded from commit message) - [ ] Verify design and implementation - [ ] Verify test coverage and CI build status - [ ] Verify documentation (including

[jira] [Updated] (KAFKA-13917) Avoid calling lookupCoordinator() in tight loop

2022-05-19 Thread Viktor Somogyi-Vass (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Viktor Somogyi-Vass updated KAFKA-13917: Description: Currently the heartbeat thread's lookupCoordinator() is called in a

[jira] [Created] (KAFKA-13917) Avoid calling lookupCoordinator() in tight loop

2022-05-19 Thread Viktor Somogyi-Vass (Jira)
Viktor Somogyi-Vass created KAFKA-13917: --- Summary: Avoid calling lookupCoordinator() in tight loop Key: KAFKA-13917 URL: https://issues.apache.org/jira/browse/KAFKA-13917 Project: Kafka

[jira] [Updated] (KAFKA-13916) Fenced replicas should not be allowed to join the ISR in KRaft (KIP-841)

2022-05-19 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot updated KAFKA-13916: Description: KIP:

[jira] [Created] (KAFKA-13916) Fenced replicas should not be allowed to join the ISR in KRaft (KIP-841)

2022-05-19 Thread David Jacot (Jira)
David Jacot created KAFKA-13916: --- Summary: Fenced replicas should not be allowed to join the ISR in KRaft (KIP-841) Key: KAFKA-13916 URL: https://issues.apache.org/jira/browse/KAFKA-13916 Project:

[GitHub] [kafka] dajac commented on a diff in pull request #12065: KAFKA-13788: Use AdminClient.incrementalAlterConfigs in ConfigCommand

2022-05-19 Thread GitBox
dajac commented on code in PR #12065: URL: https://github.com/apache/kafka/pull/12065#discussion_r876706874 ## core/src/main/scala/kafka/admin/ConfigCommand.scala: ## @@ -367,15 +366,12 @@ object ConfigCommand extends Logging { if (invalidConfigs.nonEmpty)

[jira] [Commented] (KAFKA-13888) KIP-836: Addition of Information in DescribeQuorumResponse about Voter Lag

2022-05-19 Thread lqjacklee (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17539465#comment-17539465 ] lqjacklee commented on KAFKA-13888: --- [~Niket Goel] for the field ‘LastCaughtUpTimestamp’ , how can i

[GitHub] [kafka] mimaison commented on pull request #11780: KAFKA-10000: Exactly-once source tasks (KIP-618)

2022-05-19 Thread GitBox
mimaison commented on PR #11780: URL: https://github.com/apache/kafka/pull/11780#issuecomment-1131508676 Thanks for the updates @C0urante ! I've on PTO next week, I'll take a look at the tests when I'm back. -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [kafka] mimaison commented on a diff in pull request #11780: KAFKA-10000: Exactly-once source tasks (KIP-618)

2022-05-19 Thread GitBox
mimaison commented on code in PR #11780: URL: https://github.com/apache/kafka/pull/11780#discussion_r876878064 ## connect/runtime/src/main/java/org/apache/kafka/connect/runtime/Worker.java: ## @@ -1000,6 +1090,266 @@ WorkerMetricsGroup workerMetricsGroup() { return

[GitHub] [kafka] mimaison commented on a diff in pull request #11780: KAFKA-10000: Exactly-once source tasks (KIP-618)

2022-05-19 Thread GitBox
mimaison commented on code in PR #11780: URL: https://github.com/apache/kafka/pull/11780#discussion_r876877095 ## connect/runtime/src/main/java/org/apache/kafka/connect/runtime/Worker.java: ## @@ -576,88 +672,42 @@ public boolean startTask(

[jira] [Commented] (KAFKA-13882) Dockerfile for previewing website

2022-05-19 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17539447#comment-17539447 ] ASF GitHub Bot commented on KAFKA-13882: mimaison commented on code in PR #410: URL:

[jira] [Updated] (KAFKA-13915) Kafka streams should validate that the repartition topics are not created with cleanup.policy compact

2022-05-19 Thread Peter James Pringle (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter James Pringle updated KAFKA-13915: Description: Add sanity validation on streams start up that *repartition* topics

[jira] [Updated] (KAFKA-13915) Kafka streams should validate that the repartition topics are not created with cleanup.policy compact

2022-05-19 Thread Peter James Pringle (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter James Pringle updated KAFKA-13915: Description: Add sanity validation on streams start up that *repartition* topics

[jira] [Created] (KAFKA-13915) Kafka streams should validate that the repartition topics are not created with cleanup.policy compact

2022-05-19 Thread Peter James Pringle (Jira)
Peter James Pringle created KAFKA-13915: --- Summary: Kafka streams should validate that the repartition topics are not created with cleanup.policy compact Key: KAFKA-13915 URL:

[GitHub] [kafka] showuon commented on a diff in pull request #12136: KAFKA-13773: catch kafkaStorageException to avoid broker shutdown directly

2022-05-19 Thread GitBox
showuon commented on code in PR #12136: URL: https://github.com/apache/kafka/pull/12136#discussion_r876740554 ## core/src/main/scala/kafka/server/KafkaServer.scala: ## @@ -830,7 +830,13 @@ class KafkaServer( private def checkpointBrokerMetadata(brokerMetadata:

[GitHub] [kafka] showuon commented on pull request #12136: KAFKA-13773: catch kafkaStorageException to avoid broker shutdown directly

2022-05-19 Thread GitBox
showuon commented on PR #12136: URL: https://github.com/apache/kafka/pull/12136#issuecomment-1131379581 @junrao , thanks for your review. I've addressed your comments. Also, I found we should handle `IOException` during writing `meta.properties` in server.startup. Thanks. -- This is an

[GitHub] [kafka] showuon commented on a diff in pull request #12136: KAFKA-13773: catch kafkaStorageException to avoid broker shutdown directly

2022-05-19 Thread GitBox
showuon commented on code in PR #12136: URL: https://github.com/apache/kafka/pull/12136#discussion_r876740835 ## core/src/main/scala/kafka/log/LogManager.scala: ## @@ -376,8 +381,10 @@ class LogManager(logDirs: Seq[File],

[GitHub] [kafka] showuon commented on a diff in pull request #12136: KAFKA-13773: catch kafkaStorageException to avoid broker shutdown directly

2022-05-19 Thread GitBox
showuon commented on code in PR #12136: URL: https://github.com/apache/kafka/pull/12136#discussion_r876740554 ## core/src/main/scala/kafka/server/KafkaServer.scala: ## @@ -830,7 +830,13 @@ class KafkaServer( private def checkpointBrokerMetadata(brokerMetadata:

[GitHub] [kafka] dajac commented on a diff in pull request #12065: KAFKA-13788: Use AdminClient.incrementalAlterConfigs in ConfigCommand

2022-05-19 Thread GitBox
dajac commented on code in PR #12065: URL: https://github.com/apache/kafka/pull/12065#discussion_r876706874 ## core/src/main/scala/kafka/admin/ConfigCommand.scala: ## @@ -367,15 +366,12 @@ object ConfigCommand extends Logging { if (invalidConfigs.nonEmpty)

[GitHub] [kafka] acsaki opened a new pull request, #12179: [KAFKA-13848] Clients remain connected after SASL re-authentication f…

2022-05-19 Thread GitBox
acsaki opened a new pull request, #12179: URL: https://github.com/apache/kafka/pull/12179 Clients remain connected and able to produce or consume despite an expired OAUTHBEARER token. The problem can be reproduced using the https://github.com/acsaki/kafka-sasl-reauth project