[jira] [Commented] (KAFKA-16076) RestClient Interrupting the thread in case of InterruptedException

2024-06-05 Thread Ksolves (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16076?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17852659#comment-17852659 ] Ksolves commented on KAFKA-16076: - Hi! I am interested in working on this ticket. Seems

[jira] [Assigned] (KAFKA-16076) RestClient Interrupting the thread in case of InterruptedException

2024-06-05 Thread Ksolves (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ksolves reassigned KAFKA-16076: --- Assignee: Ksolves > RestClient Interrupting the thread in case of InterruptedException > --

[PR] KAFKA-16661: Added a lower `log.initial.task.delay.ms` value [kafka]

2024-06-05 Thread via GitHub
vinay272001 opened a new pull request, #16221: URL: https://github.com/apache/kafka/pull/16221 related to [KAFKA-16661](https://issues.apache.org/jira/browse/KAFKA-16661), added a lower `log.initial.task.delay.ms` value to integration test framework to 500ms Committer Checklist

Re: [PR] KAFKA-15265: Integrate RLMQuotaManager for throttling copies to remote storage [kafka]

2024-06-05 Thread via GitHub
abhijeetk88 commented on code in PR #15820: URL: https://github.com/apache/kafka/pull/15820#discussion_r1628876545 ## core/src/main/java/kafka/log/remote/RemoteLogManager.java: ## @@ -750,6 +762,23 @@ public void copyLogSegmentsToRemote(UnifiedLog log) throws InterruptedExcepti

Re: [PR] MINOR: Change KStreamKstreamOuterJoinTest to use distinct left and right types [kafka]

2024-06-05 Thread via GitHub
cadonna commented on PR #15513: URL: https://github.com/apache/kafka/pull/15513#issuecomment-2151536065 Yes, why not? It is a good change to the test, no? I just did not have time to review it since my last review. -- This is an automated message from the Apache Git Service. To respond

Re: [PR] KAFKA-15776: Support added to update remote.fetch.max.wait.ms dynamically [kafka]

2024-06-05 Thread via GitHub
showuon commented on code in PR #16203: URL: https://github.com/apache/kafka/pull/16203#discussion_r1628868196 ## core/src/test/scala/unit/kafka/server/DynamicBrokerConfigTest.scala: ## @@ -792,6 +792,36 @@ class DynamicBrokerConfigTest { verifyIncorrectLogLocalRetentionPro

[jira] [Commented] (KAFKA-16661) add a lower `log.initial.task.delay.ms` value to integration test framework

2024-06-05 Thread Vinay Agarwal (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17852651#comment-17852651 ] Vinay Agarwal commented on KAFKA-16661: --- Sure, on it > add a lower `log.initial.t

Re: [PR] KAFKA-14701; Move `PartitionAssignor` to new `group-coordinator-api` module [kafka]

2024-06-05 Thread via GitHub
dajac commented on PR #16198: URL: https://github.com/apache/kafka/pull/16198#issuecomment-2151513652 @chia7712 @jeffkbkim @rreddy-22 Thanks for your comments. I have addressed them. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to G

Re: [PR] KAFKA-14701; Move `PartitionAssignor` to new `group-coordinator-api` module [kafka]

2024-06-05 Thread via GitHub
dajac commented on code in PR #16198: URL: https://github.com/apache/kafka/pull/16198#discussion_r1628845364 ## group-coordinator/src/main/java/org/apache/kafka/coordinator/group/consumer/Assignment.java: ## @@ -29,7 +30,7 @@ /** * An immutable assignment for a member. */ -

Re: [PR] KAFKA-16530: Fix high-watermark calculation to not assume the leader is in the voter set [kafka]

2024-06-05 Thread via GitHub
showuon merged PR #16079: URL: https://github.com/apache/kafka/pull/16079 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafka.apache.

Re: [PR] KAFKA-16530: Fix high-watermark calculation to not assume the leader is in the voter set [kafka]

2024-06-05 Thread via GitHub
showuon commented on PR #16079: URL: https://github.com/apache/kafka/pull/16079#issuecomment-2151505048 Failed tests are unrelated. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific co

Re: [PR] KAFKA-14701; Move `PartitionAssignor` to new `group-coordinator-api` module [kafka]

2024-06-05 Thread via GitHub
dajac commented on code in PR #16198: URL: https://github.com/apache/kafka/pull/16198#discussion_r1628842567 ## group-coordinator/group-coordinator-api/src/main/java/org/apache/kafka/coordinator/group/api/assignor/MemberAssignment.java: ## @@ -0,0 +1,34 @@ +/* + * Licensed to th

Re: [PR] KAFKA-14701; Move `PartitionAssignor` to new `group-coordinator-api` module [kafka]

2024-06-05 Thread via GitHub
dajac commented on code in PR #16198: URL: https://github.com/apache/kafka/pull/16198#discussion_r1628840910 ## group-coordinator/group-coordinator-api/src/main/java/org/apache/kafka/coordinator/group/api/assignor/GroupSpec.java: ## @@ -45,18 +45,18 @@ public interface GroupSpec

[jira] [Resolved] (KAFKA-16541) Potential leader epoch checkpoint file corruption on OS crash

2024-06-05 Thread Jun Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao resolved KAFKA-16541. - Fix Version/s: 4.0.0 Resolution: Fixed Merged the PR to trunk. > Potential leader epoch checkpoi

Re: [PR] KAFKA-16541 Fix potential leader-epoch checkpoint file corruption [kafka]

2024-06-05 Thread via GitHub
junrao merged PR #15993: URL: https://github.com/apache/kafka/pull/15993 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafka.apache.o

Re: [PR] KAFKA-15265: Integrate RLMQuotaManager for throttling copies to remote storage [kafka]

2024-06-05 Thread via GitHub
abhijeetk88 commented on code in PR #15820: URL: https://github.com/apache/kafka/pull/15820#discussion_r1628819130 ## core/src/main/java/kafka/log/remote/RemoteLogManager.java: ## @@ -738,6 +750,23 @@ public void copyLogSegmentsToRemote(UnifiedLog log) throws InterruptedExcepti

Re: [PR] MINOR: Cleanup storage module [kafka]

2024-06-05 Thread via GitHub
sjhajharia commented on PR #16207: URL: https://github.com/apache/kafka/pull/16207#issuecomment-2151470915 Thanks @chia7712 for the review. Addressed the comments in the new commit. Thanks! -- This is an automated message from the Apache Git Service. To respond to the message, please

Re: [PR] KAFKA-16764: New consumer should throw InvalidTopicException on poll when invalid topic in metadata [kafka]

2024-06-05 Thread via GitHub
appchemist commented on PR #16043: URL: https://github.com/apache/kafka/pull/16043#issuecomment-2151383230 Reopen this pr for KAFKA-16764 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the speci

Re: [PR] KAFKA-16764: New consumer should throw InvalidTopicException on poll when invalid topic in metadata. [kafka]

2024-06-05 Thread via GitHub
appchemist closed pull request #15961: KAFKA-16764: New consumer should throw InvalidTopicException on poll when invalid topic in metadata. URL: https://github.com/apache/kafka/pull/15961 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

Re: [PR] KAFKA-16884 : Refactor RemoteLogManagerConfig with AbstractConfig [kafka]

2024-06-05 Thread via GitHub
kamalcph commented on PR #16199: URL: https://github.com/apache/kafka/pull/16199#issuecomment-2151378272 We want to update the below configs dynamically: 1. remote.log.manager.copier.thread.pool.size 2. remote.log.manager.expiration.thread.pool.size 3. remote.log.manager.thread.

Re: [PR] KAFKA-16884 : Refactor RemoteLogManagerConfig with AbstractConfig [kafka]

2024-06-05 Thread via GitHub
kamalcph commented on code in PR #16199: URL: https://github.com/apache/kafka/pull/16199#discussion_r1628745306 ## storage/src/test/java/org/apache/kafka/server/log/remote/storage/RemoteLogManagerConfigTest.java: ## @@ -16,184 +16,105 @@ */ package org.apache.kafka.server.log

Re: [PR] ignore [kafka]

2024-06-05 Thread via GitHub
dajac closed pull request #15355: ignore URL: https://github.com/apache/kafka/pull/15355 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr..

Re: [PR] KAFKA-16541 Fix potential leader-epoch checkpoint file corruption [kafka]

2024-06-05 Thread via GitHub
ocadaruma commented on PR #15993: URL: https://github.com/apache/kafka/pull/15993#issuecomment-2151361051 @junrao I don't think they relate. - Confirmed that most of them are succeeded at least either one on JDK8 or JDK21 - The one which failed both on JDK8/21 is `testFormatEmptyDirect

Re: [PR] KAFKA-15776: Emit RemoteLogReaderFetchRateAndTimeMs timer metrics [kafka]

2024-06-05 Thread via GitHub
kamalcph commented on PR #16209: URL: https://github.com/apache/kafka/pull/16209#issuecomment-2151355843 > Thanks @kamalcph for the PR. Overall LGTM. > > How is [KAFKA-15776](https://issues.apache.org/jira/browse/KAFKA-15776) related to`RemoteLogReaderFetchRateAndTimeMs` metric?

Re: [PR] KAFKA-16335: Remove deprecated method of StreamPartitioner [kafka]

2024-06-05 Thread via GitHub
github-actions[bot] commented on PR #15482: URL: https://github.com/apache/kafka/pull/15482#issuecomment-2151348449 This PR is being marked as stale since it has not had any activity in 90 days. If you would like to keep this PR alive, please ask a committer for review. If the PR has merge

Re: [PR] KAFKA-15265: Integrate RLMQuotaManager for throttling copies to remote storage [kafka]

2024-06-05 Thread via GitHub
showuon commented on PR #15820: URL: https://github.com/apache/kafka/pull/15820#issuecomment-2151343142 @abhijeetk88 , any update to this PR? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the s

Re: [PR] KAFKA-16001 Migrated ConsumerNetworkThreadTest away from ConsumerTestBuilder [kafka]

2024-06-05 Thread via GitHub
philipnee commented on code in PR #16140: URL: https://github.com/apache/kafka/pull/16140#discussion_r1628618091 ## clients/src/test/java/org/apache/kafka/clients/consumer/internals/ConsumerNetworkThreadTest.java: ## @@ -74,68 +79,113 @@ import static org.junit.jupiter.api.Asse

Re: [PR] KAFKA-16001 Migrated ConsumerNetworkThreadTest away from ConsumerTestBuilder [kafka]

2024-06-05 Thread via GitHub
philipnee commented on code in PR #16140: URL: https://github.com/apache/kafka/pull/16140#discussion_r1628611058 ## clients/src/test/java/org/apache/kafka/clients/consumer/internals/ConsumerNetworkThreadTest.java: ## @@ -74,68 +79,113 @@ import static org.junit.jupiter.api.Asse

Re: [PR] KAFKA-16001 Migrated ConsumerNetworkThreadTest away from ConsumerTestBuilder [kafka]

2024-06-05 Thread via GitHub
philipnee commented on code in PR #16140: URL: https://github.com/apache/kafka/pull/16140#discussion_r1628610328 ## clients/src/test/java/org/apache/kafka/clients/consumer/internals/ConsumerNetworkThreadTest.java: ## @@ -341,6 +356,17 @@ void testRunOnceInvokesReaper() {

[jira] [Commented] (KAFKA-16898) move TimeIndexTest and TransactionIndexTest to storage module

2024-06-05 Thread PoAn Yang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17852609#comment-17852609 ] PoAn Yang commented on KAFKA-16898: --- Hi [~chia7712], I'm interested in this ticket. Ma

Re: [PR] KAFKA-16001 Migrated ConsumerNetworkThreadTest away from ConsumerTestBuilder [kafka]

2024-06-05 Thread via GitHub
philipnee commented on code in PR #16140: URL: https://github.com/apache/kafka/pull/16140#discussion_r1628598367 ## clients/src/test/java/org/apache/kafka/clients/consumer/internals/ConsumerNetworkThreadTest.java: ## @@ -341,6 +356,17 @@ void testRunOnceInvokesReaper() {

Re: [PR] KAFKA-16001 Migrated ConsumerNetworkThreadTest away from ConsumerTestBuilder [kafka]

2024-06-05 Thread via GitHub
philipnee commented on code in PR #16140: URL: https://github.com/apache/kafka/pull/16140#discussion_r1628596559 ## clients/src/test/java/org/apache/kafka/clients/consumer/internals/ConsumerNetworkThreadTest.java: ## @@ -150,35 +200,44 @@ public void testStartupAndTearDown() thr

Re: [PR] KAFKA-16001 Migrated ConsumerNetworkThreadTest away from ConsumerTestBuilder [kafka]

2024-06-05 Thread via GitHub
philipnee commented on code in PR #16140: URL: https://github.com/apache/kafka/pull/16140#discussion_r1628596024 ## clients/src/test/java/org/apache/kafka/clients/consumer/internals/ConsumerNetworkThreadTest.java: ## @@ -150,35 +200,44 @@ public void testStartupAndTearDown() thr

Re: [PR] KAFKA-16001 Migrated ConsumerNetworkThreadTest away from ConsumerTestBuilder [kafka]

2024-06-05 Thread via GitHub
philipnee commented on code in PR #16140: URL: https://github.com/apache/kafka/pull/16140#discussion_r1628596024 ## clients/src/test/java/org/apache/kafka/clients/consumer/internals/ConsumerNetworkThreadTest.java: ## @@ -150,35 +200,44 @@ public void testStartupAndTearDown() thr

Re: [PR] KAFKA-16001 Migrated ConsumerNetworkThreadTest away from ConsumerTestBuilder [kafka]

2024-06-05 Thread via GitHub
philipnee commented on code in PR #16140: URL: https://github.com/apache/kafka/pull/16140#discussion_r1628595462 ## clients/src/test/java/org/apache/kafka/clients/consumer/internals/ConsumerNetworkThreadTest.java: ## @@ -150,35 +200,44 @@ public void testStartupAndTearDown() thr

Re: [PR] KAFKA-16001 Migrated ConsumerNetworkThreadTest away from ConsumerTestBuilder [kafka]

2024-06-05 Thread via GitHub
philipnee commented on code in PR #16140: URL: https://github.com/apache/kafka/pull/16140#discussion_r1628593481 ## clients/src/test/java/org/apache/kafka/clients/consumer/internals/ConsumerNetworkThreadTest.java: ## @@ -150,35 +200,44 @@ public void testStartupAndTearDown() thr

Re: [PR] KAFKA-16001 Migrated ConsumerNetworkThreadTest away from ConsumerTestBuilder [kafka]

2024-06-05 Thread via GitHub
philipnee commented on code in PR #16140: URL: https://github.com/apache/kafka/pull/16140#discussion_r1628593481 ## clients/src/test/java/org/apache/kafka/clients/consumer/internals/ConsumerNetworkThreadTest.java: ## @@ -150,35 +200,44 @@ public void testStartupAndTearDown() thr

Re: [PR] KAFKA-16001 Migrated ConsumerNetworkThreadTest away from ConsumerTestBuilder [kafka]

2024-06-05 Thread via GitHub
philipnee commented on code in PR #16140: URL: https://github.com/apache/kafka/pull/16140#discussion_r1628593280 ## clients/src/test/java/org/apache/kafka/clients/consumer/internals/ConsumerNetworkThreadTest.java: ## @@ -74,68 +79,113 @@ import static org.junit.jupiter.api.Asse

[jira] [Commented] (KAFKA-16901) add unit tests for ConsumerRecords#records(String)

2024-06-05 Thread TengYao Chi (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17852606#comment-17852606 ] TengYao Chi commented on KAFKA-16901: - I will handle this issue 😀 > add unit tests

Re: [PR] KAFKA-16001 Migrated ConsumerNetworkThreadTest away from ConsumerTestBuilder [kafka]

2024-06-05 Thread via GitHub
philipnee commented on code in PR #16140: URL: https://github.com/apache/kafka/pull/16140#discussion_r1628589378 ## clients/src/test/java/org/apache/kafka/clients/consumer/internals/ConsumerNetworkThreadTest.java: ## @@ -150,35 +200,44 @@ public void testStartupAndTearDown() thr

Re: [PR] KAFKA-16192: Introduce transaction.version and usage of flexible records to coordinators [kafka]

2024-06-05 Thread via GitHub
artemlivshits commented on code in PR #16183: URL: https://github.com/apache/kafka/pull/16183#discussion_r1628482592 ## core/src/main/scala/kafka/coordinator/transaction/TransactionLog.scala: ## @@ -75,9 +76,9 @@ object TransactionLog { .setPartitionIds(partitions.m

Re: [PR] KAFKA-14701; Move `PartitionAssignor` to new `group-coordinator-api` module [kafka]

2024-06-05 Thread via GitHub
jeffkbkim commented on code in PR #16198: URL: https://github.com/apache/kafka/pull/16198#discussion_r1628571546 ## group-coordinator/src/main/java/org/apache/kafka/coordinator/group/consumer/MemberSubscriptionAndAssignmentImpl.java: ## @@ -83,9 +85,10 @@ public int hashCode() {

[jira] [Commented] (KAFKA-16897) Move OffsetIndexTest and OffsetMapTest to storage module

2024-06-05 Thread Jira
[ https://issues.apache.org/jira/browse/KAFKA-16897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17852603#comment-17852603 ] 黃竣陽 commented on KAFKA-16897: - I'm interesting in this issue, I can handle it > Move Offset

Re: [PR] KAFKA-16811 Sliding window approach to calculate non-zero punctuate-ratio metric [kafka]

2024-06-05 Thread via GitHub
ganesh-sadanala commented on PR #16162: URL: https://github.com/apache/kafka/pull/16162#issuecomment-2151117769 > With 3 input topic partitions, there should be 3 tasks, one for each partition. But the application must first join the consumer group and the rebalancing must finish, before ta

Re: [PR] KAFKA-16764: New consumer should throw InvalidTopicException on poll when invalid topic in metadata. [kafka]

2024-06-05 Thread via GitHub
appchemist commented on code in PR #15961: URL: https://github.com/apache/kafka/pull/15961#discussion_r1628553681 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/MetadataErrorManager.java: ## @@ -0,0 +1,50 @@ +/* + * Licensed to the Apache Software Foundatio

Re: [PR] KAFKA-16764: New consumer should throw InvalidTopicException on poll when invalid topic in metadata. [kafka]

2024-06-05 Thread via GitHub
appchemist commented on code in PR #15961: URL: https://github.com/apache/kafka/pull/15961#discussion_r1628553681 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/MetadataErrorManager.java: ## @@ -0,0 +1,50 @@ +/* + * Licensed to the Apache Software Foundatio

Re: [PR] KAFKA-15045: (KIP-924 pt. 17) State store computation fixed [kafka]

2024-06-05 Thread via GitHub
ableegoldman commented on PR #16194: URL: https://github.com/apache/kafka/pull/16194#issuecomment-2151098903 Merged to trunk and cherrypicked to 3.8 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go t

Re: [PR] KAFKA-15045: (KIP-924 pt. 16) TaskAssignor.onAssignmentComputed handling [kafka]

2024-06-05 Thread via GitHub
ableegoldman commented on PR #16147: URL: https://github.com/apache/kafka/pull/16147#issuecomment-2151097972 Cherrypicked to 3.8 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comme

Re: [PR] KAFKA-14701; Move `PartitionAssignor` to new `group-coordinator-api` module [kafka]

2024-06-05 Thread via GitHub
rreddy-22 commented on PR #16198: URL: https://github.com/apache/kafka/pull/16198#issuecomment-2151090811 Thanks for the PR! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

Re: [PR] KAFKA-15045: (KIP-924 pt. 18) Better assignment testing [kafka]

2024-06-05 Thread via GitHub
apourchet commented on code in PR #16201: URL: https://github.com/apache/kafka/pull/16201#discussion_r1628532637 ## streams/src/main/java/org/apache/kafka/streams/processor/assignment/TaskAssignmentUtils.java: ## @@ -53,6 +55,76 @@ public final class TaskAssignmentUtils {

Re: [PR] KAFKA-14701; Move `PartitionAssignor` to new `group-coordinator-api` module [kafka]

2024-06-05 Thread via GitHub
rreddy-22 commented on code in PR #16198: URL: https://github.com/apache/kafka/pull/16198#discussion_r1628532023 ## group-coordinator/src/main/java/org/apache/kafka/coordinator/group/consumer/SubscribedTopicDescriberImpl.java: ## @@ -29,14 +29,14 @@ * The subscribed topic meta

Re: [PR] KAFKA-14701; Move `PartitionAssignor` to new `group-coordinator-api` module [kafka]

2024-06-05 Thread via GitHub
rreddy-22 commented on code in PR #16198: URL: https://github.com/apache/kafka/pull/16198#discussion_r1628529666 ## group-coordinator/src/main/java/org/apache/kafka/coordinator/group/consumer/MemberAssignmentImpl.java: ## @@ -25,39 +26,39 @@ /** * The partition assignment for

Re: [PR] KAFKA-14701; Move `PartitionAssignor` to new `group-coordinator-api` module [kafka]

2024-06-05 Thread via GitHub
rreddy-22 commented on code in PR #16198: URL: https://github.com/apache/kafka/pull/16198#discussion_r1628528056 ## group-coordinator/group-coordinator-api/src/main/java/org/apache/kafka/coordinator/group/api/assignor/MemberAssignment.java: ## @@ -0,0 +1,34 @@ +/* + * Licensed t

Re: [PR] KAFKA-15045: (KIP-924 pt. 18) Better assignment testing [kafka]

2024-06-05 Thread via GitHub
ableegoldman commented on code in PR #16201: URL: https://github.com/apache/kafka/pull/16201#discussion_r1628527914 ## streams/src/main/java/org/apache/kafka/streams/processor/assignment/TaskAssignmentUtils.java: ## @@ -53,6 +55,76 @@ public final class TaskAssignmentUtils {

Re: [PR] KAFKA-14701; Move `PartitionAssignor` to new `group-coordinator-api` module [kafka]

2024-06-05 Thread via GitHub
rreddy-22 commented on code in PR #16198: URL: https://github.com/apache/kafka/pull/16198#discussion_r1628526764 ## group-coordinator/group-coordinator-api/src/main/java/org/apache/kafka/coordinator/group/api/assignor/MemberAssignment.java: ## @@ -0,0 +1,34 @@ +/* + * Licensed t

Re: [PR] KAFKA-15045: (KIP-924 pt. 18) Better assignment testing [kafka]

2024-06-05 Thread via GitHub
ableegoldman commented on code in PR #16201: URL: https://github.com/apache/kafka/pull/16201#discussion_r1628526527 ## streams/src/main/java/org/apache/kafka/streams/processor/assignment/TaskAssignmentUtils.java: ## @@ -53,6 +55,76 @@ public final class TaskAssignmentUtils {

[jira] [Commented] (KAFKA-16899) Rename MembershipManagerImpl's rebalanceTimeoutMs for clarity

2024-06-05 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17852599#comment-17852599 ] Kirk True commented on KAFKA-16899: --- [~linu]—you're welcome to take it. Thanks! > Ren

Re: [PR] KAFKA-16541 Fix potential leader-epoch checkpoint file corruption [kafka]

2024-06-05 Thread via GitHub
ocadaruma commented on PR #15993: URL: https://github.com/apache/kafka/pull/15993#issuecomment-2151075570 @junrao Thank you for your feedbacks. Addressed the comments. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use th

Re: [PR] KAFKA-16770; [2/2] Coalesce records into bigger batches [kafka]

2024-06-05 Thread via GitHub
jeffkbkim commented on code in PR #16215: URL: https://github.com/apache/kafka/pull/16215#discussion_r1628486465 ## group-coordinator/src/main/java/org/apache/kafka/coordinator/group/runtime/CoordinatorRuntime.java: ## @@ -443,6 +445,81 @@ public int size() { } }

Re: [PR] KAFKA-14701; Move `PartitionAssignor` to new `group-coordinator-api` module [kafka]

2024-06-05 Thread via GitHub
rreddy-22 commented on code in PR #16198: URL: https://github.com/apache/kafka/pull/16198#discussion_r1628521138 ## group-coordinator/group-coordinator-api/src/main/java/org/apache/kafka/coordinator/group/api/assignor/GroupSpec.java: ## @@ -45,18 +45,18 @@ public interface Group

Re: [PR] KAFKA-16764: New consumer should throw InvalidTopicException on poll when invalid topic in metadata. [kafka]

2024-06-05 Thread via GitHub
kirktrue commented on PR #15961: URL: https://github.com/apache/kafka/pull/15961#issuecomment-2151071098 I think that the approach from #16043 is more in line with the approach I imagined. -- This is an automated message from the Apache Git Service. To respond to the message, please log o

Re: [PR] MINOR: Change KStreamKstreamOuterJoinTest to use distinct left and right types [kafka]

2024-06-05 Thread via GitHub
mjsax commented on PR #15513: URL: https://github.com/apache/kafka/pull/15513#issuecomment-2151060001 @gharris1727 @cadonna -- do we still want to merge this PR? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

Re: [PR] KAFKA-12317: fix documentation [kafka]

2024-06-05 Thread via GitHub
mjsax commented on PR #15689: URL: https://github.com/apache/kafka/pull/15689#issuecomment-2151057059 Thanks for the PR @florin-akermann. Merged to `trunk` and cherry-picked to `3.8` and `3.7` branches. -- This is an automated message from the Apache Git Service. To respond to the message

Re: [PR] KAFKA-12317: fix documentation [kafka]

2024-06-05 Thread via GitHub
mjsax merged PR #15689: URL: https://github.com/apache/kafka/pull/15689 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafka.apache.or

Re: [PR] KAFKA-16001 Migrated ConsumerNetworkThreadTest away from ConsumerTestBuilder [kafka]

2024-06-05 Thread via GitHub
philipnee commented on code in PR #16140: URL: https://github.com/apache/kafka/pull/16140#discussion_r1628502331 ## clients/src/test/java/org/apache/kafka/clients/consumer/internals/ConsumerNetworkThreadTest.java: ## @@ -78,64 +81,120 @@ import static org.mockito.Mockito.doAnsw

Re: [PR] KAFKA-16573: Specify node and store where serdes are needed [kafka]

2024-06-05 Thread via GitHub
mjsax commented on PR #15790: URL: https://github.com/apache/kafka/pull/15790#issuecomment-2151048809 Thanks for the PR @AyoubOm. Merged to `trunk` and cherry-picked to `3.8` branch. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to G

Re: [PR] MINOR: Fix error in testRestartBrokerNoErrorIfMissingPartitionMetadata [kafka]

2024-06-05 Thread via GitHub
soarez merged PR #16216: URL: https://github.com/apache/kafka/pull/16216 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafka.apache.o

Re: [PR] MINOR: Fix error in testRestartBrokerNoErrorIfMissingPartitionMetadata [kafka]

2024-06-05 Thread via GitHub
soarez commented on PR #16216: URL: https://github.com/apache/kafka/pull/16216#issuecomment-2151043075 Failed tests are unrelated. Merging -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the spec

Re: [PR] KAFKA-16764: New consumer should throw InvalidTopicException on poll when invalid topic in metadata. [kafka]

2024-06-05 Thread via GitHub
appchemist commented on code in PR #15961: URL: https://github.com/apache/kafka/pull/15961#discussion_r1628496087 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/MetadataErrorManager.java: ## @@ -0,0 +1,50 @@ +/* + * Licensed to the Apache Software Foundatio

Re: [PR] KAFKA-16764: New consumer should throw InvalidTopicException on poll when invalid topic in metadata. [kafka]

2024-06-05 Thread via GitHub
philipnee commented on PR #15961: URL: https://github.com/apache/kafka/pull/15961#issuecomment-2151036734 @appchemist - was away for a few days so sorry for not responding. there are two points to address before moving the pr forward 1. we definitely don't need to implement the request m

Re: [PR] KAFKA-16573: Specify node and store where serdes are needed [kafka]

2024-06-05 Thread via GitHub
mjsax merged PR #15790: URL: https://github.com/apache/kafka/pull/15790 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafka.apache.or

Re: [PR] KAFKA-16764: New consumer should throw InvalidTopicException on poll when invalid topic in metadata. [kafka]

2024-06-05 Thread via GitHub
appchemist commented on PR #15961: URL: https://github.com/apache/kafka/pull/15961#issuecomment-2151024735 @lianetm No problem, I enjoyed the discussion. @kirktrue Thanks for review. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

Re: [PR] KAFKA-16764: New consumer should throw InvalidTopicException on poll when invalid topic in metadata. [kafka]

2024-06-05 Thread via GitHub
philipnee commented on code in PR #15961: URL: https://github.com/apache/kafka/pull/15961#discussion_r1628483904 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/MetadataErrorManager.java: ## @@ -0,0 +1,50 @@ +/* + * Licensed to the Apache Software Foundation

[jira] [Commented] (KAFKA-16899) Rename MembershipManagerImpl's rebalanceTimeoutMs for clarity

2024-06-05 Thread Linu Shibu (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17852591#comment-17852591 ] Linu Shibu commented on KAFKA-16899: Could I pick this up [~kirktrue] if you are not

Re: [PR] KAFKA-16520 KIP-853 Changes to DescribeQuorum request/response [kafka]

2024-06-05 Thread via GitHub
cmccabe commented on code in PR #16106: URL: https://github.com/apache/kafka/pull/16106#discussion_r1628478358 ## clients/src/main/java/org/apache/kafka/clients/admin/QuorumInfo.java: ## @@ -174,4 +194,22 @@ public String toString() { ')'; } } + +

Re: [PR] KAFKA-16520 KIP-853 Changes to DescribeQuorum request/response [kafka]

2024-06-05 Thread via GitHub
cmccabe commented on code in PR #16106: URL: https://github.com/apache/kafka/pull/16106#discussion_r1628475975 ## clients/src/main/resources/common/message/DescribeQuorumResponse.json: ## @@ -40,10 +45,27 @@ { "name": "CurrentVoters", "type": "[]ReplicaState", "versions

Re: [PR] KAFKA-16520 KIP-853 Changes to DescribeQuorum request/response [kafka]

2024-06-05 Thread via GitHub
cmccabe commented on code in PR #16106: URL: https://github.com/apache/kafka/pull/16106#discussion_r1628475710 ## clients/src/main/resources/common/message/DescribeQuorumResponse.json: ## @@ -40,10 +45,27 @@ { "name": "CurrentVoters", "type": "[]ReplicaState", "versions

[jira] [Assigned] (KAFKA-16834) add the reason for the failure of PartitionRegistration#toRecord

2024-06-05 Thread Linu Shibu (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Linu Shibu reassigned KAFKA-16834: -- Assignee: Linu Shibu > add the reason for the failure of PartitionRegistration#toRecord > ---

Re: [PR] KAFKA-16520 KIP-853 Changes to DescribeQuorum request/response [kafka]

2024-06-05 Thread via GitHub
cmccabe commented on code in PR #16106: URL: https://github.com/apache/kafka/pull/16106#discussion_r1628473676 ## clients/src/main/java/org/apache/kafka/clients/admin/KafkaAdminClient.java: ## @@ -4424,12 +4427,21 @@ private QuorumInfo createQuorumResult(final DescribeQuorumRes

Re: [PR] KAFKA-16200: Enforce that RequestManager implementations respect user-provided timeout [kafka]

2024-06-05 Thread via GitHub
kirktrue commented on code in PR #16031: URL: https://github.com/apache/kafka/pull/16031#discussion_r1628473245 ## clients/src/test/java/org/apache/kafka/clients/consumer/internals/CommitRequestManagerTest.java: ## @@ -613,15 +613,46 @@ public void testOffsetFetchRequestErroredR

Re: [PR] KAFKA-16520 KIP-853 Changes to DescribeQuorum request/response [kafka]

2024-06-05 Thread via GitHub
cmccabe commented on code in PR #16106: URL: https://github.com/apache/kafka/pull/16106#discussion_r1628472921 ## clients/src/main/java/org/apache/kafka/clients/admin/QuorumInfo.java: ## @@ -29,19 +32,22 @@ public class QuorumInfo { private final long highWatermark; pr

Re: [PR] KAFKA-16520 KIP-853 Changes to DescribeQuorum request/response [kafka]

2024-06-05 Thread via GitHub
cmccabe commented on code in PR #16106: URL: https://github.com/apache/kafka/pull/16106#discussion_r1628472263 ## clients/src/main/java/org/apache/kafka/clients/admin/QuorumInfo.java: ## @@ -94,21 +104,24 @@ public String toString() { public static class ReplicaState {

Re: [PR] KAFKA-16520 KIP-853 Changes to DescribeQuorum request/response [kafka]

2024-06-05 Thread via GitHub
cmccabe commented on code in PR #16106: URL: https://github.com/apache/kafka/pull/16106#discussion_r1628471528 ## clients/src/main/java/org/apache/kafka/clients/admin/QuorumInfo.java: ## @@ -174,4 +194,22 @@ public String toString() { ')'; } } + +

[jira] [Resolved] (KAFKA-16522) Admin client changes for adding and removing voters

2024-06-05 Thread Colin McCabe (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin McCabe resolved KAFKA-16522. -- Resolution: Fixed Implemented by {{KAFKA-16535: Implement AddVoter, RemoveVoter, UpdateVoter

Re: [PR] KAFKA-16902: Consider socket timeout in blocking Sender waits [kafka]

2024-06-05 Thread via GitHub
parafiend commented on PR #16220: URL: https://github.com/apache/kafka/pull/16220#issuecomment-2150998614 I wasn't able to find existing tests covering the specific awaitNodeReady connection logic, advice for how to test this is welcome. I think the logging change would help to identi

[jira] [Assigned] (KAFKA-16522) Admin client changes for adding and removing voters

2024-06-05 Thread Colin McCabe (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin McCabe reassigned KAFKA-16522: Assignee: Colin McCabe (was: Quoc Phong Dang) > Admin client changes for adding and remo

[PR] KAFKA-16902: Consider socket timeout in blocking Sender waits [kafka]

2024-06-05 Thread via GitHub
parafiend opened a new pull request, #16220: URL: https://github.com/apache/kafka/pull/16220 Use the lesser of request.timeout.ms and socket.connection.setup.timeout.ms when Sender is performing blocking waits for node readiness. This ensures faster processing of connection setup

Re: [PR] KAFKA-16200: Enforce that RequestManager implementations respect user-provided timeout [kafka]

2024-06-05 Thread via GitHub
lianetm commented on code in PR #16031: URL: https://github.com/apache/kafka/pull/16031#discussion_r1628462153 ## clients/src/test/java/org/apache/kafka/clients/consumer/internals/CommitRequestManagerTest.java: ## @@ -613,15 +613,46 @@ public void testOffsetFetchRequestErroredRe

Re: [PR] KAFKA-16200: Enforce that RequestManager implementations respect user-provided timeout [kafka]

2024-06-05 Thread via GitHub
lianetm commented on code in PR #16031: URL: https://github.com/apache/kafka/pull/16031#discussion_r1628462153 ## clients/src/test/java/org/apache/kafka/clients/consumer/internals/CommitRequestManagerTest.java: ## @@ -613,15 +613,46 @@ public void testOffsetFetchRequestErroredRe

[jira] [Created] (KAFKA-16901) add unit tests for ConsumerRecords#records(String)

2024-06-05 Thread Chia-Ping Tsai (Jira)
Chia-Ping Tsai created KAFKA-16901: -- Summary: add unit tests for ConsumerRecords#records(String) Key: KAFKA-16901 URL: https://issues.apache.org/jira/browse/KAFKA-16901 Project: Kafka Issue

[jira] [Created] (KAFKA-16902) Sender ignores socket connection timeout when reconnecting to transaction coordinator

2024-06-05 Thread Graham Campbell (Jira)
Graham Campbell created KAFKA-16902: --- Summary: Sender ignores socket connection timeout when reconnecting to transaction coordinator Key: KAFKA-16902 URL: https://issues.apache.org/jira/browse/KAFKA-16902

Re: [PR] KAFKA-16480: Bump ListOffsets version, IBP version and mark last version of ListOffsets as unstable [kafka]

2024-06-05 Thread via GitHub
junrao commented on code in PR #15673: URL: https://github.com/apache/kafka/pull/15673#discussion_r1628455890 ## server-common/src/main/java/org/apache/kafka/server/common/TestFeatureVersion.java: ## @@ -24,7 +24,7 @@ public enum TestFeatureVersion implements FeatureVersion {

Re: [PR] KAFKA-16200: Enforce that RequestManager implementations respect user-provided timeout [kafka]

2024-06-05 Thread via GitHub
kirktrue commented on code in PR #16031: URL: https://github.com/apache/kafka/pull/16031#discussion_r1628457770 ## clients/src/test/java/org/apache/kafka/clients/consumer/internals/CommitRequestManagerTest.java: ## @@ -613,15 +613,46 @@ public void testOffsetFetchRequestErroredR

Re: [PR] KAFKA-9228: Restart tasks on runtime-only connector config changes [kafka]

2024-06-05 Thread via GitHub
C0urante commented on code in PR #16053: URL: https://github.com/apache/kafka/pull/16053#discussion_r1628456824 ## connect/runtime/src/main/java/org/apache/kafka/connect/storage/KafkaConfigBackingStore.java: ## @@ -1123,6 +1125,24 @@ private void processTasksCommitRecord(String

Re: [PR] KAFKA-16001 Migrated ConsumerNetworkThreadTest away from ConsumerTestBuilder [kafka]

2024-06-05 Thread via GitHub
lianetm commented on PR #16140: URL: https://github.com/apache/kafka/pull/16140#issuecomment-2150972168 Hey @brenden20 , thanks for the updates! Left some minor comments. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

Re: [PR] KAFKA-16200: Enforce that RequestManager implementations respect user-provided timeout [kafka]

2024-06-05 Thread via GitHub
kirktrue commented on PR #16031: URL: https://github.com/apache/kafka/pull/16031#issuecomment-2150969566 Fixed `TieredStorageTestContext` breakage. Sorry about that 🤦‍♂️ -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

Re: [PR] KAFKA-16001 Migrated ConsumerNetworkThreadTest away from ConsumerTestBuilder [kafka]

2024-06-05 Thread via GitHub
lianetm commented on code in PR #16140: URL: https://github.com/apache/kafka/pull/16140#discussion_r1628443660 ## clients/src/test/java/org/apache/kafka/clients/consumer/internals/ConsumerNetworkThreadTest.java: ## @@ -353,13 +379,22 @@ void testSendUnsentRequest() { as

Re: [PR] KAFKA-16200: Enforce that RequestManager implementations respect user-provided timeout [kafka]

2024-06-05 Thread via GitHub
kirktrue commented on code in PR #16031: URL: https://github.com/apache/kafka/pull/16031#discussion_r1628442774 ## clients/src/test/java/org/apache/kafka/clients/consumer/internals/CommitRequestManagerTest.java: ## @@ -613,15 +613,46 @@ public void testOffsetFetchRequestErroredR

Re: [PR] MINOR: Various cleanups in clients [kafka]

2024-06-05 Thread via GitHub
chia7712 commented on code in PR #16193: URL: https://github.com/apache/kafka/pull/16193#discussion_r1628424360 ## clients/src/test/java/org/apache/kafka/clients/admin/MockAdminClient.java: ## @@ -1335,10 +1335,6 @@ public synchronized void updateConsumerGroupOffsets(final Map

Re: [PR] KAFKA-16001 Migrated ConsumerNetworkThreadTest away from ConsumerTestBuilder [kafka]

2024-06-05 Thread via GitHub
lianetm commented on code in PR #16140: URL: https://github.com/apache/kafka/pull/16140#discussion_r1628434821 ## clients/src/test/java/org/apache/kafka/clients/consumer/internals/ConsumerNetworkThreadTest.java: ## @@ -74,68 +52,105 @@ import static org.junit.jupiter.api.Assert

  1   2   3   4   >