Re: [PR] KAFKA-15932: Wait for responses in consumer operations [kafka]

2023-12-06 Thread via GitHub
cadonna commented on PR #14912: URL: https://github.com/apache/kafka/pull/14912#issuecomment-1843369990 Failures are unrelated -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment

Re: [PR] KAFKA-15527: Support ResultOrder to reverseRange and reverseAll query over kv-store in IQv2 [kafka]

2023-12-06 Thread via GitHub
hanyuzheng7 commented on code in PR #14906: URL: https://github.com/apache/kafka/pull/14906#discussion_r1417716664 ## streams/src/main/java/org/apache/kafka/streams/state/internals/MeteredKeyValueStore.java: ## @@ -254,12 +255,12 @@ private QueryResult runRangeQuery(final Query

Re: [PR] KAFKA-15527: Support ResultOrder to reverseRange and reverseAll query over kv-store in IQv2 [kafka]

2023-12-06 Thread via GitHub
hanyuzheng7 commented on code in PR #14906: URL: https://github.com/apache/kafka/pull/14906#discussion_r1417713307 ## streams/src/main/java/org/apache/kafka/streams/query/RangeQuery.java: ## @@ -59,25 +58,25 @@ private RangeQuery(final Optional lower, final Optional upper, fina

Re: [PR] KAFKA-15527: Support ResultOrder to reverseRange and reverseAll query over kv-store in IQv2 [kafka]

2023-12-06 Thread via GitHub
hanyuzheng7 commented on code in PR #14906: URL: https://github.com/apache/kafka/pull/14906#discussion_r1417710159 ## streams/src/main/java/org/apache/kafka/streams/query/RangeQuery.java: ## @@ -59,25 +58,25 @@ private RangeQuery(final Optional lower, final Optional upper, fina

Re: [PR] KAFKA-15978: Update member information on HB response [kafka]

2023-12-06 Thread via GitHub
dajac commented on code in PR #14945: URL: https://github.com/apache/kafka/pull/14945#discussion_r1417699258 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/CommitRequestManager.java: ## @@ -224,6 +224,13 @@ boolean canAutoCommit() { return autoComm

Re: [PR] KAFKA-15527: Support ResultOrder to reverseRange and reverseAll query over kv-store in IQv2 [kafka]

2023-12-06 Thread via GitHub
hanyuzheng7 commented on code in PR #14906: URL: https://github.com/apache/kafka/pull/14906#discussion_r1417693358 ## docs/streams/upgrade-guide.html: ## @@ -136,7 +136,7 @@ < Streams API changes in 3.7.0 IQv2 supports RangeQuery that allows to specify unbou

Re: [PR] KAFKA-13788: Use AdminClient.incrementalAlterConfigs in ConfigCommand [kafka]

2023-12-06 Thread via GitHub
dajac commented on PR #12065: URL: https://github.com/apache/kafka/pull/12065#issuecomment-1843299429 @dengziming Are you still interested in doing this? It would be great to fix this. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

Re: [PR] KAFKA-15818: ensure leave group on max poll interval [kafka]

2023-12-06 Thread via GitHub
lianetm commented on PR #14873: URL: https://github.com/apache/kafka/pull/14873#issuecomment-1843296141 @philipnee agree on leaving the membership manager determine the epoch to use to leave group. That's already in the [state machine](https://github.com/apache/kafka/blob/adcbdaca72a3484d72

[PR] KAFKA-15978: Update member information on HB response [kafka]

2023-12-06 Thread via GitHub
AndrewJSchofield opened a new pull request, #14945: URL: https://github.com/apache/kafka/pull/14945 In the new consumer, the commit request manager and the membership manager are separate components. The commit request manager is initialised with group information that it uses to construct

Re: [PR] KAFKA-14505; [2/N] Implement TxnOffsetCommit API [kafka]

2023-12-06 Thread via GitHub
dajac commented on code in PR #14845: URL: https://github.com/apache/kafka/pull/14845#discussion_r1417658955 ## group-coordinator/src/main/java/org/apache/kafka/coordinator/group/consumer/ConsumerGroup.java: ## @@ -653,12 +653,15 @@ public DeadlineAndEpoch metadataRefreshDeadlin

Re: [PR] KAFKA-15684: Support to describe all client metrics resources (KIP-714) [kafka]

2023-12-06 Thread via GitHub
apoorvmittal10 commented on PR #14933: URL: https://github.com/apache/kafka/pull/14933#issuecomment-1843269344 @junrao Build passed with unrelated flaky tests failure. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use th

Re: [PR] Refactor closing consumer [kafka]

2023-12-06 Thread via GitHub
philipnee commented on code in PR #14937: URL: https://github.com/apache/kafka/pull/14937#discussion_r1417650715 ## clients/src/test/java/org/apache/kafka/clients/consumer/internals/AsyncKafkaConsumerTest.java: ## @@ -778,18 +783,23 @@ public void testGroupIdNull() { @Tes

Re: [PR] MINOR: Add junit properties to display parameterized test names [kafka]

2023-12-06 Thread via GitHub
dajac merged PR #14687: URL: https://github.com/apache/kafka/pull/14687 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafka.apache.or

Re: [PR] KAFKA-15696: Refactor AsyncConsumer close procedure [kafka]

2023-12-06 Thread via GitHub
philipnee commented on code in PR #14920: URL: https://github.com/apache/kafka/pull/14920#discussion_r1417647914 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/AsyncKafkaConsumer.java: ## @@ -957,6 +966,57 @@ private void close(Duration timeout, boolean sw

Re: [PR] KAFKA-15696: Refactor AsyncConsumer close procedure [kafka]

2023-12-06 Thread via GitHub
philipnee commented on code in PR #14920: URL: https://github.com/apache/kafka/pull/14920#discussion_r1417647206 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/AsyncKafkaConsumer.java: ## @@ -957,6 +966,57 @@ private void close(Duration timeout, boolean sw

[jira] [Resolved] (KAFKA-15910) New group coordinator needs to generate snapshots while loading

2023-12-06 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot resolved KAFKA-15910. - Fix Version/s: 3.7.0 Resolution: Fixed > New group coordinator needs to generate snapshot

Re: [PR] KAFKA-15910: New group coordinator needs to generate snapshots while loading [kafka]

2023-12-06 Thread via GitHub
dajac merged PR #14849: URL: https://github.com/apache/kafka/pull/14849 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafka.apache.or

Re: [PR] KAFKA-15361: Process and persist dir info with broker registration [kafka]

2023-12-06 Thread via GitHub
soarez commented on PR #14838: URL: https://github.com/apache/kafka/pull/14838#issuecomment-1843250009 @rondagostino I'm trying to figure the test failures out, I've not yet been able to reproduce any failures locally. -- This is an automated message from the Apache Git Service. To respon

Re: [PR] KAFKA-14589 ConsumerGroupCommand rewritten in java [kafka]

2023-12-06 Thread via GitHub
tledkov commented on code in PR #14471: URL: https://github.com/apache/kafka/pull/14471#discussion_r1417629458 ## tools/src/main/java/org/apache/kafka/tools/consumergroup/CsvUtils.java: ## @@ -0,0 +1,154 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one or mo

Re: [PR] KAFKA-15971: Re-enable consumer integration tests for new consumer [kafka]

2023-12-06 Thread via GitHub
dajac commented on PR #14925: URL: https://github.com/apache/kafka/pull/14925#issuecomment-1843245379 > The latest build failed for disk full 😆 I discussed this with the INFRA team. Here is what I got: > Due to a whole heap of builds by mainly Kafka and KIE hogging executors -

Re: [PR] MINOR: ConsumerRebalanceListenerInvoker class and method visibility [kafka]

2023-12-06 Thread via GitHub
dajac merged PR #14931: URL: https://github.com/apache/kafka/pull/14931 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafka.apache.or

Re: [PR] MINOR: ConsumerRebalanceListenerInvoker class and method visibility [kafka]

2023-12-06 Thread via GitHub
kirktrue commented on PR #14931: URL: https://github.com/apache/kafka/pull/14931#issuecomment-1843227108 @dajac—failing tests appear unrelated. Do we need four green builds before merging? -- This is an automated message from the Apache Git Service. To respond to the message, please log o

[jira] [Updated] (KAFKA-15027) Implement rack aware assignment for standby tasks

2023-12-06 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-15027: Labels: kip (was: ) > Implement rack aware assignment for standby tasks > ---

[jira] [Updated] (KAFKA-15024) Add cost function for task/client

2023-12-06 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-15024: Labels: kip (was: ) > Add cost function for task/client > ---

[jira] [Updated] (KAFKA-15054) Add configs and logic to decide if rack aware assignment should be enabled

2023-12-06 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-15054: Labels: kip (was: ) > Add configs and logic to decide if rack aware assignment should be

[jira] [Updated] (KAFKA-15025) Implement min-cost flow without balancing tasks for same subtopology

2023-12-06 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-15025: Labels: kip (was: ) > Implement min-cost flow without balancing tasks for same subtopolog

[jira] [Closed] (KAFKA-15026) Implement min-cost flow balancing tasks for same subtopology

2023-12-06 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax closed KAFKA-15026. --- > Implement min-cost flow balancing tasks for same subtopology > ---

[jira] [Updated] (KAFKA-15023) Get rack information for source topic partitions for a task

2023-12-06 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-15023: Labels: kip (was: ) > Get rack information for source topic partitions for a task > -

[jira] [Updated] (KAFKA-15026) Implement min-cost flow balancing tasks for same subtopology

2023-12-06 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-15026: Labels: kip (was: ) > Implement min-cost flow balancing tasks for same subtopology >

[jira] [Resolved] (KAFKA-15026) Implement min-cost flow balancing tasks for same subtopology

2023-12-06 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-15026. - Fix Version/s: 3.7.0 Resolution: Fixed > Implement min-cost flow balancing tasks

[jira] [Resolved] (KAFKA-15022) Support rack aware task assignment in Kafka streams

2023-12-06 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-15022. - Fix Version/s: 3.7.0 3.6.0 Resolution: Fixed > Support rack aw

Re: [PR] KAFKA-15022: tests for HA assignor and StickyTaskAssignor [kafka]

2023-12-06 Thread via GitHub
mjsax merged PR #14921: URL: https://github.com/apache/kafka/pull/14921 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafka.apache.or

[jira] [Updated] (KAFKA-15348) Range IQs with versioned state stores

2023-12-06 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-15348: Labels: kip (was: ) > Range IQs with versioned state stores > ---

[jira] [Resolved] (KAFKA-15347) Single-Key_multi-timestamp IQs with versioned state stores

2023-12-06 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-15347. - Fix Version/s: 3.7.0 Resolution: Fixed > Single-Key_multi-timestamp IQs with vers

[jira] [Updated] (KAFKA-15346) Single-Key_single-timestamp IQs with versioned state stores

2023-12-06 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-15346: Labels: kip (was: ) > Single-Key_single-timestamp IQs with versioned state stores > -

[jira] [Updated] (KAFKA-15347) Single-Key_multi-timestamp IQs with versioned state stores

2023-12-06 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-15347: Labels: kip (was: ) > Single-Key_multi-timestamp IQs with versioned state stores > --

Re: [PR] KAFKA-15347: add support for 'single key multi timestamp' IQs with versioned state stores (KIP-968) [kafka]

2023-12-06 Thread via GitHub
mjsax merged PR #14626: URL: https://github.com/apache/kafka/pull/14626 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafka.apache.or

[PR] MINOR: Fix flaky test testInvalidGroupId [kafka]

2023-12-06 Thread via GitHub
cadonna opened a new pull request, #14944: URL: https://github.com/apache/kafka/pull/14944 *More detailed description of your change, if necessary. The PR title and PR message become the squashed commit message, so use a separate comment to ping reviewers.* *Summary of testing

Re: [PR] Refactor closing consumer [kafka]

2023-12-06 Thread via GitHub
lucasbru commented on PR #14937: URL: https://github.com/apache/kafka/pull/14937#issuecomment-1843148936 Yes, I think using events is much clearer. @kirktrue do you agree with this approach? Then I'd suggest we close the other PR and continue with this one. -- This is an automated message

Re: [PR] KAFKA-14589 ConsumerGroupCommand options and case classes rewritten [kafka]

2023-12-06 Thread via GitHub
tledkov commented on code in PR #14856: URL: https://github.com/apache/kafka/pull/14856#discussion_r1417541595 ## clients/src/main/java/org/apache/kafka/common/utils/Utils.java: ## @@ -593,6 +593,16 @@ public static String join(T[] strs, String separator) { return join

Re: [PR] Refactor closing consumer [kafka]

2023-12-06 Thread via GitHub
lucasbru commented on code in PR #14937: URL: https://github.com/apache/kafka/pull/14937#discussion_r1417532026 ## clients/src/test/java/org/apache/kafka/clients/consumer/internals/AsyncKafkaConsumerTest.java: ## @@ -778,18 +783,23 @@ public void testGroupIdNull() { @Test

Re: [PR] MINOR: start/stop channelManager properly in AssignmentsManager [kafka]

2023-12-06 Thread via GitHub
soarez commented on PR #14943: URL: https://github.com/apache/kafka/pull/14943#issuecomment-1843136280 @cmccabe @rondagostino PTAL -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific com

[PR] MINOR: start/stop channelManager properly in AssignmentsManager [kafka]

2023-12-06 Thread via GitHub
soarez opened a new pull request, #14943: URL: https://github.com/apache/kafka/pull/14943 ### Committer Checklist (excluded from commit message) - [ ] Verify design and implementation - [ ] Verify test coverage and CI build status - [ ] Verify documentation (including upgrade no

Re: [PR] KAFKA-15696: Refactor AsyncConsumer close procedure [kafka]

2023-12-06 Thread via GitHub
lucasbru commented on code in PR #14920: URL: https://github.com/apache/kafka/pull/14920#discussion_r1417523313 ## clients/src/test/java/org/apache/kafka/clients/consumer/internals/ConsumerTestBuilder.java: ## @@ -331,34 +331,35 @@ public AsyncKafkaConsumerTestBuilder(Optional

Re: [PR] KAFKA-15361: Process and persist dir info with broker registration [kafka]

2023-12-06 Thread via GitHub
rondagostino commented on PR #14838: URL: https://github.com/apache/kafka/pull/14838#issuecomment-1843104348 [Still 110 failing tests](https://ci-builds.apache.org/blue/organizations/jenkins/Kafka%2Fkafka-pr/detail/PR-14838/14/tests), which seems like a lot, especially since https://github

Re: [PR] KAFKA-15358: Added QueuedReplicaToDirAssignments metric [kafka]

2023-12-06 Thread via GitHub
soarez commented on PR #14942: URL: https://github.com/apache/kafka/pull/14942#issuecomment-1843100363 @rondagostino @cmccabe @pprovenzano please have a look -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abov

[PR] KAFKA-15358: Added QueuedReplicaToDirAssignments metric [kafka]

2023-12-06 Thread via GitHub
mwesterby opened a new pull request, #14942: URL: https://github.com/apache/kafka/pull/14942 Adds a new metric, QueuedReplicaToDirAssignments, which, when queried, will return the total number of replica to directory assignments that are currently queued in the AssignmentsManager. ##

Re: [PR] KAFKA-15696: Refactor AsyncConsumer close procedure [kafka]

2023-12-06 Thread via GitHub
lucasbru commented on code in PR #14920: URL: https://github.com/apache/kafka/pull/14920#discussion_r1417484146 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/AsyncKafkaConsumer.java: ## @@ -957,6 +966,57 @@ private void close(Duration timeout, boolean swa

[jira] [Created] (KAFKA-15978) New consumer sends OffsetCommit with empty member ID

2023-12-06 Thread Andrew Schofield (Jira)
Andrew Schofield created KAFKA-15978: Summary: New consumer sends OffsetCommit with empty member ID Key: KAFKA-15978 URL: https://issues.apache.org/jira/browse/KAFKA-15978 Project: Kafka

Re: [PR] KAFKA-15883: Implement RemoteCopyLagBytes [kafka]

2023-12-06 Thread via GitHub
clolov commented on PR #14832: URL: https://github.com/apache/kafka/pull/14832#issuecomment-1843067050 Heya @satishd and @showuon! I hope I have addressed your comments with the latest commits 😊 -- This is an automated message from the Apache Git Service. To respond to the message, pleas

Re: [PR] KAFKA-15971: Re-enable consumer integration tests for new consumer [kafka]

2023-12-06 Thread via GitHub
AndrewJSchofield commented on PR #14925: URL: https://github.com/apache/kafka/pull/14925#issuecomment-1843058587 The latest build failed for disk full 😆 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

Re: [PR] KAFKA-15972: Add support to exclude labels for telemetry metrics (KIP-714) [kafka]

2023-12-06 Thread via GitHub
wcarlson5 merged PR #14924: URL: https://github.com/apache/kafka/pull/14924 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafka.apach

Re: [PR] KAFKA-15871: kafka-client-metrics.sh [kafka]

2023-12-06 Thread via GitHub
AndrewJSchofield commented on code in PR #14926: URL: https://github.com/apache/kafka/pull/14926#discussion_r1417454887 ## tools/src/main/java/org/apache/kafka/tools/ClientMetricsCommand.java: ## @@ -0,0 +1,377 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under on

Re: [PR] KAFKA-15970: Copy over KIP-951 tests in FetcherTest.java to FetchRequestManagerTest.java [kafka]

2023-12-06 Thread via GitHub
wcarlson5 merged PR #14916: URL: https://github.com/apache/kafka/pull/14916 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafka.apach

Re: [PR] KAFKA-15871: kafka-client-metrics.sh [kafka]

2023-12-06 Thread via GitHub
AndrewJSchofield commented on code in PR #14926: URL: https://github.com/apache/kafka/pull/14926#discussion_r1417454119 ## tools/src/main/java/org/apache/kafka/tools/ClientMetricsCommand.java: ## @@ -0,0 +1,377 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under on

Re: [PR] KAFKA-15355: Message schema changes [kafka]

2023-12-06 Thread via GitHub
aiven-anton commented on code in PR #14290: URL: https://github.com/apache/kafka/pull/14290#discussion_r1417450738 ## clients/src/main/resources/common/message/BrokerRegistrationRequest.json: ## @@ -14,14 +14,16 @@ // limitations under the License. // Version 1 adds Zk broke

[PR] KAFKA-15880: Add Github Actions Workflow for promoting docker image [kafka]

2023-12-06 Thread via GitHub
VedarthConfluent opened a new pull request, #14941: URL: https://github.com/apache/kafka/pull/14941 This PR adds Github Actions Workflow for promoting an RC docker image to final release. It makes the process of releasing docker image more streamlined, as discussed in [KIP-975](https://cwi

[PR] KAFKA-15903: Add Github Actions Workflow for RC Docker Image [kafka]

2023-12-06 Thread via GitHub
VedarthConfluent opened a new pull request, #14940: URL: https://github.com/apache/kafka/pull/14940 This PR will add a Github Actions Workflow, that will help in publishing RC docker image that can be reviewed and voted on by the community, as mentioned in [KIP-975](https://cwiki.apache.or

[PR] KAFKA-15977: Fix leak in DelegationTokenEndToEndAuthorizationWithOwnerTest [kafka]

2023-12-06 Thread via GitHub
lucasbru opened a new pull request, #14939: URL: https://github.com/apache/kafka/pull/14939 `DelegationTokenEndToEndAuthorizationWithOwnerTest` can leak a thread, causing problems with many tests. This is due to an admin client that isn't being closed when a (flaky) test fails. Using

[jira] [Assigned] (KAFKA-15977) DelegationTokenEndToEndAuthorizationWithOwnerTest leaks threads

2023-12-06 Thread Lucas Brutschy (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lucas Brutschy reassigned KAFKA-15977: -- Assignee: Lucas Brutschy > DelegationTokenEndToEndAuthorizationWithOwnerTest leaks th

Re: [PR] KAFKA-15280: Implement client support for KIP-848 server-side assignors [kafka]

2023-12-06 Thread via GitHub
lucasbru merged PR #14878: URL: https://github.com/apache/kafka/pull/14878 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafka.apache

Re: [PR] KAFKA-15280: Implement client support for KIP-848 server-side assignors [kafka]

2023-12-06 Thread via GitHub
lucasbru commented on PR #14878: URL: https://github.com/apache/kafka/pull/14878#issuecomment-1842982496 Test failures are unrelated. There are a lot of tests caused by an unrelated test leaking an admin client thread in one build due to a flaky test. I created https://issues.apache.

[jira] [Updated] (KAFKA-15977) DelegationTokenEndToEndAuthorizationWithOwnerTest leaks threads

2023-12-06 Thread Lucas Brutschy (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lucas Brutschy updated KAFKA-15977: --- Description: [https://ci-builds.apache.org/blue/rest/organizations/jenkins/pipelines/Kafka/p

[jira] [Created] (KAFKA-15977) DelegationTokenEndToEndAuthorizationWithOwnerTest leaks threads

2023-12-06 Thread Lucas Brutschy (Jira)
Lucas Brutschy created KAFKA-15977: -- Summary: DelegationTokenEndToEndAuthorizationWithOwnerTest leaks threads Key: KAFKA-15977 URL: https://issues.apache.org/jira/browse/KAFKA-15977 Project: Kafka

Re: [PR] KAFKA-15355: Message schema changes [kafka]

2023-12-06 Thread via GitHub
soarez commented on code in PR #14290: URL: https://github.com/apache/kafka/pull/14290#discussion_r1417380722 ## clients/src/main/resources/common/message/BrokerRegistrationRequest.json: ## @@ -14,14 +14,16 @@ // limitations under the License. // Version 1 adds Zk broker epo

Re: [PR] KAFKA-15871: kafka-client-metrics.sh [kafka]

2023-12-06 Thread via GitHub
soarez commented on code in PR #14926: URL: https://github.com/apache/kafka/pull/14926#discussion_r1417345140 ## tools/src/main/java/org/apache/kafka/tools/ClientMetricsCommand.java: ## @@ -0,0 +1,377 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one or more

[PR] KAFKA-15879: Add documentation and examples for docker image [kafka]

2023-12-06 Thread via GitHub
VedarthConfluent opened a new pull request, #14938: URL: https://github.com/apache/kafka/pull/14938 This PR will add user documentation and examples for the docker image as described in [KIP-975](https://cwiki.apache.org/confluence/display/KAFKA/KIP-975%3A+Docker+Image+for+Apache+Kafka)

[jira] [Updated] (KAFKA-15879) Add documentation and examples for the Docker image

2023-12-06 Thread Vedarth Sharma (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vedarth Sharma updated KAFKA-15879: --- Summary: Add documentation and examples for the Docker image (was: Add documentation for th

[jira] [Updated] (KAFKA-15879) Add documentation for the Docker image

2023-12-06 Thread Vedarth Sharma (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vedarth Sharma updated KAFKA-15879: --- Description: AC:- * Update quickstart with docker image details and docker section in getti

Re: [PR] KAFKA-15883: Implement RemoteCopyLagBytes [kafka]

2023-12-06 Thread via GitHub
clolov commented on code in PR #14832: URL: https://github.com/apache/kafka/pull/14832#discussion_r1417285321 ## core/src/test/scala/integration/kafka/api/MetricsTest.scala: ## @@ -320,16 +320,28 @@ class MetricsTest extends IntegrationTestHarness with SaslSetup { assertTr

Re: [PR] KAFKA-15970: Copy over KIP-951 tests in FetcherTest.java to FetchRequestManagerTest.java [kafka]

2023-12-06 Thread via GitHub
msn-tldr commented on PR #14916: URL: https://github.com/apache/kafka/pull/14916#issuecomment-1842857934 @wcarlson5 The failures are unrelated check here https://ge.apache.org/s/ul2ost2737xbg/tests/overview?outcome=FAILED -- This is an automated message from the Apache Git Service. To r

Re: [PR] KAFKA-15883: Implement RemoteCopyLagBytes [kafka]

2023-12-06 Thread via GitHub
clolov commented on code in PR #14832: URL: https://github.com/apache/kafka/pull/14832#discussion_r1417191376 ## core/src/main/scala/kafka/server/KafkaRequestHandler.scala: ## @@ -386,7 +431,26 @@ class BrokerTopicMetrics(name: Option[String], configOpt: java.util.Optional[Kaf

Re: [PR] KAFKA-15883: Implement RemoteCopyLagBytes [kafka]

2023-12-06 Thread via GitHub
clolov commented on code in PR #14832: URL: https://github.com/apache/kafka/pull/14832#discussion_r1417188902 ## core/src/main/scala/kafka/server/KafkaRequestHandler.scala: ## @@ -299,7 +329,7 @@ class BrokerTopicMetrics(name: Option[String], configOpt: java.util.Optional[Kaf

Re: [PR] KAFKA-15950: Serialize broker heartbeat requests [kafka]

2023-12-06 Thread via GitHub
soarez commented on code in PR #14903: URL: https://github.com/apache/kafka/pull/14903#discussion_r1417143188 ## server-common/src/main/java/org/apache/kafka/queue/KafkaEventQueue.java: ## @@ -513,4 +513,28 @@ public void close() throws InterruptedException { eventHandl

Re: [PR] MINOR: Allow local-log segment deletion when log-start-offset incremented [kafka]

2023-12-06 Thread via GitHub
satishd merged PR #14905: URL: https://github.com/apache/kafka/pull/14905 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafka.apache.

Re: [PR] MINOR: Allow local-log segment deletion when log-start-offset incremented [kafka]

2023-12-06 Thread via GitHub
satishd commented on PR #14905: URL: https://github.com/apache/kafka/pull/14905#issuecomment-1842685829 Jenkins test failures are unrelated to this PR, merging it to trunk. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and u

Re: [PR] MINOR: Allow local-log segment deletion when log-start-offset incremented [kafka]

2023-12-06 Thread via GitHub
satishd commented on code in PR #14905: URL: https://github.com/apache/kafka/pull/14905#discussion_r1417134578 ## core/src/main/scala/kafka/log/UnifiedLog.scala: ## @@ -1443,11 +1443,14 @@ class UnifiedLog(@volatile var logStartOffset: Long, * @return the segments ready to b

Re: [PR] KAFKA-15950: Serialize broker heartbeat requests [kafka]

2023-12-06 Thread via GitHub
soarez commented on code in PR #14903: URL: https://github.com/apache/kafka/pull/14903#discussion_r1417129195 ## server-common/src/main/java/org/apache/kafka/queue/KafkaEventQueue.java: ## @@ -513,4 +513,28 @@ public void close() throws InterruptedException { eventHandl

Re: [PR] KAFKA-15950: Serialize broker heartbeat requests [kafka]

2023-12-06 Thread via GitHub
soarez commented on code in PR #14903: URL: https://github.com/apache/kafka/pull/14903#discussion_r1417124246 ## server-common/src/main/java/org/apache/kafka/queue/KafkaEventQueue.java: ## @@ -513,4 +513,28 @@ public void close() throws InterruptedException { eventHandl

[jira] [Commented] (KAFKA-15853) Move KafkaConfig to server module

2023-12-06 Thread Omnia Ibrahim (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17793645#comment-17793645 ] Omnia Ibrahim commented on KAFKA-15853: --- [~fvaleri] Am still working on it it's ne

Re: [PR] KAFKA-15950: Serialize broker heartbeat requests [kafka]

2023-12-06 Thread via GitHub
soarez commented on code in PR #14903: URL: https://github.com/apache/kafka/pull/14903#discussion_r1417121867 ## core/src/test/scala/unit/kafka/server/BrokerLifecycleManagerTest.scala: ## @@ -197,11 +197,14 @@ class BrokerLifecycleManagerTest { result } - def poll[T](

Re: [PR] KAFKA-15950: Serialize broker heartbeat requests [kafka]

2023-12-06 Thread via GitHub
soarez commented on code in PR #14903: URL: https://github.com/apache/kafka/pull/14903#discussion_r1417116727 ## core/src/main/scala/kafka/server/BrokerLifecycleManager.scala: ## @@ -166,6 +166,19 @@ class BrokerLifecycleManager( */ private var registered = false + /**

Re: [PR] KAFKA-15662: Add support for clientInstanceIds in Kafka Stream [kafka]

2023-12-06 Thread via GitHub
lucasbru commented on code in PR #14936: URL: https://github.com/apache/kafka/pull/14936#discussion_r1417082199 ## streams/src/main/java/org/apache/kafka/streams/processor/internals/DefaultStateUpdater.java: ## @@ -79,6 +84,10 @@ private class StateUpdaterThread extends Thread {

Re: [PR] KAFKA-15662: Add support for clientInstanceIds in Kafka Stream [kafka]

2023-12-06 Thread via GitHub
lucasbru commented on PR #14922: URL: https://github.com/apache/kafka/pull/14922#issuecomment-1842617271 Ah, I think you are using fetch deadlines to avoid calling the RPC forever. That makes sense. But then, we can probably still just keep a single deadline (the max of all calls) and a sin

Re: [PR] KAFKA-15662: Add support for clientInstanceIds in Kafka Stream [kafka]

2023-12-06 Thread via GitHub
lucasbru commented on code in PR #14922: URL: https://github.com/apache/kafka/pull/14922#discussion_r1417077988 ## streams/src/main/java/org/apache/kafka/streams/processor/internals/StreamThread.java: ## @@ -713,6 +727,48 @@ boolean runLoop() { return true; } +

Re: [PR] KAFKA-15208: Upgrade Jackson dependencies to version 2.15.3 [kafka]

2023-12-06 Thread via GitHub
bmscomp commented on PR #13662: URL: https://github.com/apache/kafka/pull/13662#issuecomment-1842612531 @mimaison Thanks for the review I'll to this asap by the end of day -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

Re: [PR] KAFKA-15871: kafka-client-metrics.sh [kafka]

2023-12-06 Thread via GitHub
AndrewJSchofield commented on code in PR #14926: URL: https://github.com/apache/kafka/pull/14926#discussion_r1417070856 ## tools/src/test/java/org/apache/kafka/tools/ClientMetricsCommandTest.java: ## @@ -0,0 +1,273 @@ +/* + * Licensed to the Apache Software Foundation (ASF) unde

Re: [PR] KAFKA-15445: Add JVM Docker image [kafka]

2023-12-06 Thread via GitHub
omkreddy merged PR #14552: URL: https://github.com/apache/kafka/pull/14552 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafka.apache

Re: [PR] KAFKA-15662: Add support for clientInstanceIds in Kafka Stream [kafka]

2023-12-06 Thread via GitHub
lucasbru commented on code in PR #14935: URL: https://github.com/apache/kafka/pull/14935#discussion_r1417064532 ## streams/src/main/java/org/apache/kafka/streams/processor/internals/GlobalStreamThread.java: ## @@ -65,6 +69,9 @@ public class GlobalStreamThread extends Thread {

Re: [PR] KAFKA-15871: kafka-client-metrics.sh [kafka]

2023-12-06 Thread via GitHub
AndrewJSchofield commented on code in PR #14926: URL: https://github.com/apache/kafka/pull/14926#discussion_r1417065760 ## tools/src/main/java/org/apache/kafka/tools/ClientMetricsCommand.java: ## @@ -0,0 +1,377 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under on

Re: [PR] KAFKA-15662: Add support for clientInstanceIds in Kafka Stream [kafka]

2023-12-06 Thread via GitHub
lucasbru commented on code in PR #14922: URL: https://github.com/apache/kafka/pull/14922#discussion_r1417036886 ## streams/src/main/java/org/apache/kafka/streams/processor/internals/StreamThread.java: ## @@ -1477,6 +1533,29 @@ public Object getStateLock() { return state

Re: [PR] KAFKA-15875 Make Snapshot public [kafka]

2023-12-06 Thread via GitHub
jlprat commented on PR #14816: URL: https://github.com/apache/kafka/pull/14816#issuecomment-1842584596 @cmccabe https://github.com/apache/kafka/blob/83110e2d425b49fed8ad5fdc6e93579423c73289/metadata/src/main/java/org/apache/kafka/controller/OffsetControlManager.java#L158 is where you can fi

[jira] [Created] (KAFKA-15976) KIP-995: Allow users to specify initial offsets while creating connectors

2023-12-06 Thread Ashwin Pankaj (Jira)
Ashwin Pankaj created KAFKA-15976: - Summary: KIP-995: Allow users to specify initial offsets while creating connectors Key: KAFKA-15976 URL: https://issues.apache.org/jira/browse/KAFKA-15976 Project:

[jira] [Comment Edited] (KAFKA-15853) Move KafkaConfig to server module

2023-12-06 Thread Federico Valeri (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17793602#comment-17793602 ] Federico Valeri edited comment on KAFKA-15853 at 12/6/23 9:57 AM:

[jira] [Comment Edited] (KAFKA-15853) Move KafkaConfig to server module

2023-12-06 Thread Federico Valeri (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17793602#comment-17793602 ] Federico Valeri edited comment on KAFKA-15853 at 12/6/23 9:55 AM:

[jira] [Commented] (KAFKA-15853) Move KafkaConfig to server module

2023-12-06 Thread Federico Valeri (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17793602#comment-17793602 ] Federico Valeri commented on KAFKA-15853: - [~omnia_h_ibrahim] I have a tools PR

Re: [PR] KAFKA-14585: Move StorageTool to tools [kafka]

2023-12-06 Thread via GitHub
fvaleri commented on PR #14847: URL: https://github.com/apache/kafka/pull/14847#issuecomment-1842545770 @showuon it is called when you instantiate the KafkaConfig object, so it's the constructor: https://github.com/apache/kafka/blob/trunk/core/src/main/scala/kafka/server/KafkaConfig.scala#L

Re: [PR] KAFKA-15932: Wait for responses in consumer operations [kafka]

2023-12-06 Thread via GitHub
AndrewJSchofield commented on code in PR #14912: URL: https://github.com/apache/kafka/pull/14912#discussion_r1417011418 ## clients/src/test/java/org/apache/kafka/clients/consumer/internals/AsyncKafkaConsumerTest.java: ## @@ -966,22 +967,25 @@ private void testUpdateFetchPositio

Re: [PR] KAFKA-15818: ensure leave group on max poll interval [kafka]

2023-12-06 Thread via GitHub
lucasbru commented on code in PR #14873: URL: https://github.com/apache/kafka/pull/14873#discussion_r1416992430 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/HeartbeatRequestManager.java: ## @@ -198,6 +219,17 @@ public long maximumTimeToWait(long currentTi

Re: [PR] KAFKA-15818: ensure leave group on max poll interval [kafka]

2023-12-06 Thread via GitHub
cadonna commented on code in PR #14873: URL: https://github.com/apache/kafka/pull/14873#discussion_r1416983368 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/HeartbeatRequestManager.java: ## @@ -103,6 +103,12 @@ public class HeartbeatRequestManager implemen

<    1   2   3   >