Re: [PR] KAFKA-17367: Share coordinator impl. Added additional tests. [3/N] [kafka]

2024-09-23 Thread via GitHub
smjn commented on code in PR #17149: URL: https://github.com/apache/kafka/pull/17149#discussion_r1771835934 ## share-coordinator/src/main/java/org/apache/kafka/coordinator/share/ShareCoordinatorShard.java: ## @@ -537,38 +539,322 @@ private static ShareGroupOffset merge(ShareGrou

Re: [PR] KAFKA-17367: Share coordinator impl. Added additional tests. [3/N] [kafka]

2024-09-23 Thread via GitHub
AndrewJSchofield commented on code in PR #17149: URL: https://github.com/apache/kafka/pull/17149#discussion_r1771822574 ## share-coordinator/src/main/java/org/apache/kafka/coordinator/share/ShareCoordinatorShard.java: ## @@ -537,38 +539,322 @@ private static ShareGroupOffset mer

Re: [PR] Updating consumer subscription object with the latest subscription before "invokePartitionRevoked". [kafka]

2024-09-23 Thread via GitHub
kumarpritam863 commented on PR #17255: URL: https://github.com/apache/kafka/pull/17255#issuecomment-2368913632 @C0urante Can you please review? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[PR] Updating consumer subscription object with the latest subscription before "invokePartitionRevoked". [kafka]

2024-09-23 Thread via GitHub
kumarpritam863 opened a new pull request, #17255: URL: https://github.com/apache/kafka/pull/17255 Summary: Ensure that the Kafka consumer subscription object is updated with the current partition assignment before partition revocation, so that close() method of the sink connector's has t

Re: [PR] MINOR; Replace gt and lt char with html encoding [kafka]

2024-09-23 Thread via GitHub
jsancio commented on PR #17235: URL: https://github.com/apache/kafka/pull/17235#issuecomment-2368903179 Thanks @chia7712 . I fixed those encoding issues. > https://github.com/apache/kafka/blob/trunk/docs/ops.html#L4249 I couldn't find anything wrong with that line. Did you mean to l

Re: [PR] KAFKA-17581: AsyncKafkaConsumer can't unsubscribe invalid topics [kafka]

2024-09-23 Thread via GitHub
lianetm commented on code in PR #17244: URL: https://github.com/apache/kafka/pull/17244#discussion_r1771804938 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/AsyncKafkaConsumer.java: ## @@ -1471,6 +1487,7 @@ public void unsubscribe() { fetchBuf

Re: [PR] KAFKA-17581: AsyncKafkaConsumer can't unsubscribe invalid topics [kafka]

2024-09-23 Thread via GitHub
lianetm commented on code in PR #17244: URL: https://github.com/apache/kafka/pull/17244#discussion_r1771804938 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/AsyncKafkaConsumer.java: ## @@ -1471,6 +1487,7 @@ public void unsubscribe() { fetchBuf

Re: [PR] KAFKA-16959: ConfigCommand should allow to define both `entity-default` and `entity-name` [kafka]

2024-09-23 Thread via GitHub
m1a2st commented on PR #16381: URL: https://github.com/apache/kafka/pull/16381#issuecomment-2368834415 rebase on the trunk, and fix the conflict -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to th

Re: [PR] MINOR: Fix a race and add JMH bench for HdrHistogram [kafka]

2024-09-23 Thread via GitHub
dimitarndimitrov commented on code in PR #17221: URL: https://github.com/apache/kafka/pull/17221#discussion_r1771776869 ## coordinator-common/src/test/java/org/apache/kafka/coordinator/common/runtime/HdrHistogramTest.java: ## @@ -172,4 +177,39 @@ public void testHistogramDataRes

Re: [PR] KAFKA-17540: Create floating tag on trunk for CI cache [kafka]

2024-09-23 Thread via GitHub
fonsdant commented on PR #17204: URL: https://github.com/apache/kafka/pull/17204#issuecomment-2368771036 @mumrah, thanks for the explanation. I really appreciate it! :) I will proceed modifying the script to use ref. -- This is an automated message from the Apache Git Service. To re

Re: [PR] KAFKA-17277: [2/2] Add feature dependency command to the storage and the feature command tool [kafka]

2024-09-23 Thread via GitHub
rreddy-22 commented on code in PR #17093: URL: https://github.com/apache/kafka/pull/17093#discussion_r1771746899 ## core/src/main/scala/kafka/tools/StorageTool.scala: ## @@ -260,6 +325,21 @@ object StorageTool extends Logging { s"${MetadataVersion.IBP_3_0_IV0}; the defa

Re: [PR] KAFKA-16339: [1/4 KStream#transform] Remove Deprecated "transformer" methods and classes [kafka]

2024-09-23 Thread via GitHub
fonsdant commented on PR #17198: URL: https://github.com/apache/kafka/pull/17198#issuecomment-2368758343 I have removed the references to `transform` from docs. I am wondering if it would be better to replace `transform` with `process`, instead of removing it. I have started to think about

Re: [PR] KAFKA-17578: Remove partitionRacks from TopicMetadata [kafka]

2024-09-23 Thread via GitHub
dajac commented on PR #17233: URL: https://github.com/apache/kafka/pull/17233#issuecomment-2368724037 @FrankYang0529 There are a few conflicts. Could you please address them? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

Re: [PR] KAFKA-17459: Stablize reassign_partitions_test.py [kafka]

2024-09-23 Thread via GitHub
frankvicky commented on code in PR #17250: URL: https://github.com/apache/kafka/pull/17250#discussion_r1771647091 ## tests/kafkatest/tests/core/reassign_partitions_test.py: ## @@ -176,7 +176,10 @@ def test_reassign_partitions(self, bounce_brokers, reassign_from_offset_zero, me

Re: [PR] KAFKA-17459: Stablize reassign_partitions_test.py [kafka]

2024-09-23 Thread via GitHub
chia7712 commented on code in PR #17250: URL: https://github.com/apache/kafka/pull/17250#discussion_r1771641828 ## tests/kafkatest/tests/core/reassign_partitions_test.py: ## @@ -176,7 +176,10 @@ def test_reassign_partitions(self, bounce_brokers, reassign_from_offset_zero, me

[PR] KAFKA-16495 Fix flaky TransactionsWithTieredStoreTest#testCommitTransactionTimeout [kafka]

2024-09-23 Thread via GitHub
m1a2st opened a new pull request, #17254: URL: https://github.com/apache/kafka/pull/17254 In this test, I think is the [max.block.ms](https://kafka.apache.org/documentation/#producerconfigs_max.block.ms) is so short for `initTransactions()`, however this test should test that commit fail,

Re: [PR] KAFKA-17495: Factor out assignor benchmark code into utils class [kafka]

2024-09-23 Thread via GitHub
dajac merged PR #17133: URL: https://github.com/apache/kafka/pull/17133 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafka.apache.or

Re: [PR] KAFKA-17540: Create floating tag on trunk for CI cache [kafka]

2024-09-23 Thread via GitHub
mumrah commented on PR #17204: URL: https://github.com/apache/kafka/pull/17204#issuecomment-2368526553 @fonsdant, just updating the ref on the remote (GitHub) would indeed work. In Git, a ref is simply a text file with a SHA in it. Conventionally, tags are immutable since they are typ

Re: [PR] KAFKA-17574: Allow overriding TestKitNodes baseDirectory [kafka]

2024-09-23 Thread via GitHub
srdo commented on code in PR #17225: URL: https://github.com/apache/kafka/pull/17225#discussion_r1771535619 ## core/src/test/java/kafka/testkit/KafkaClusterTestKitTest.java: ## @@ -122,4 +126,25 @@ public void testCreateClusterAndCloseWithMultipleLogDirs(boolean combined) {

Re: [PR] KAFKA-17574: Allow overriding TestKitNodes baseDirectory [kafka]

2024-09-23 Thread via GitHub
chia7712 commented on code in PR #17225: URL: https://github.com/apache/kafka/pull/17225#discussion_r1771528836 ## core/src/test/java/kafka/testkit/KafkaClusterTestKitTest.java: ## @@ -122,4 +126,25 @@ public void testCreateClusterAndCloseWithMultipleLogDirs(boolean combined) {

Re: [PR] KAFKA-17574: Allow overriding TestKitNodes baseDirectory [kafka]

2024-09-23 Thread via GitHub
srdo commented on code in PR #17225: URL: https://github.com/apache/kafka/pull/17225#discussion_r1771522261 ## core/src/test/java/kafka/testkit/KafkaClusterTestKitTest.java: ## @@ -122,4 +126,25 @@ public void testCreateClusterAndCloseWithMultipleLogDirs(boolean combined) {

Re: [PR] MINOR: Bump zstd-jni from 1.5.6-5 to 1.5.6-6 [kafka]

2024-09-23 Thread via GitHub
olegbonar commented on PR #17253: URL: https://github.com/apache/kafka/pull/17253#issuecomment-2368206551 @jlprat done -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To un

Re: [PR] KAFKA-17581: AsyncKafkaConsumer can't unsubscribe invalid topics [kafka]

2024-09-23 Thread via GitHub
FrankYang0529 commented on code in PR #17244: URL: https://github.com/apache/kafka/pull/17244#discussion_r1771374443 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/AsyncKafkaConsumer.java: ## @@ -1471,6 +1487,7 @@ public void unsubscribe() { fe

Re: [PR] KAFKA-16908: Refactor `QuorumConfig` with `AbstractConfig` [kafka]

2024-09-23 Thread via GitHub
xijiu commented on PR #17231: URL: https://github.com/apache/kafka/pull/17231#issuecomment-2368132282 @chia7712I have modified the code and remove some getter methods from `KafkaConfig`,PTAL -- This is an automated message from the Apache Git Service. To respond to the message, p

Re: [PR] KAFKA-17520: Align ducktape version in tests/docker/Dockerfile and tests/setup.py [kafka]

2024-09-23 Thread via GitHub
chia7712 commented on code in PR #17240: URL: https://github.com/apache/kafka/pull/17240#discussion_r1771316645 ## tests/setup.py: ## @@ -51,7 +51,7 @@ def run_tests(self): license="apache2.0", packages=find_packages(), include_package_data=True, - inst

Re: [PR] KAFKA-17575: Remove unnecessary file.deleteOnExit call [kafka]

2024-09-23 Thread via GitHub
chia7712 merged PR #17226: URL: https://github.com/apache/kafka/pull/17226 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafka.apache

Re: [PR] KAFKA-17385: Remove authorizer, authorizer-properties, zk-tls-config-file in AclCommand [kafka]

2024-09-23 Thread via GitHub
FrankYang0529 commented on PR #17224: URL: https://github.com/apache/kafka/pull/17224#issuecomment-2368057658 > @FrankYang0529 please fix the conflicts Fixed it. Thank you. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

Re: [PR] KAFKA-15344: Streams task should cache consumer nextOffsets [kafka]

2024-09-23 Thread via GitHub
aliehsaeedii commented on PR #17091: URL: https://github.com/apache/kafka/pull/17091#issuecomment-2368049415 > Hi @aliehsaeedii . I left some comments Thanks. I think most of them must be applied in KIP's PR. -- This is an automated message from the Apache Git Service. To respond t

Re: [PR] KAFKA-15344: Streams task should cache consumer nextOffsets [kafka]

2024-09-23 Thread via GitHub
aliehsaeedii commented on code in PR #17091: URL: https://github.com/apache/kafka/pull/17091#discussion_r1771295666 ## streams/src/test/java/org/apache/kafka/streams/processor/internals/StreamTaskTest.java: ## @@ -1232,47 +1231,51 @@ public void shouldRespectPunctuateCancellati

Re: [PR] KAFKA-15344: Streams task should cache consumer nextOffsets [kafka]

2024-09-23 Thread via GitHub
aliehsaeedii commented on code in PR #17091: URL: https://github.com/apache/kafka/pull/17091#discussion_r1771294976 ## streams/src/main/java/org/apache/kafka/streams/processor/internals/TaskManager.java: ## @@ -1820,6 +1820,9 @@ void addRecordsToTasks(final ConsumerRecords recor

Re: [PR] KAFKA-15344: Streams task should cache consumer nextOffsets [kafka]

2024-09-23 Thread via GitHub
aliehsaeedii commented on code in PR #17091: URL: https://github.com/apache/kafka/pull/17091#discussion_r1771288861 ## streams/src/main/java/org/apache/kafka/streams/processor/internals/StreamTask.java: ## @@ -462,23 +463,29 @@ public Map prepareCommit() { } } -

Re: [PR] MINOR: Bump zstd-jni from 1.5.6-5 to 1.5.6-6 [kafka]

2024-09-23 Thread via GitHub
jlprat commented on PR #17253: URL: https://github.com/apache/kafka/pull/17253#issuecomment-2368003779 I think this is the best we can have for this project. https://github.com/luben/zstd-jni/compare/v1.5.6-4...v1.5.6-5 You can edit your PR description with this link. -- This is an

Re: [PR] MINOR: Bump zstd-jni from 1.5.6-5 to 1.5.6-6 [kafka]

2024-09-23 Thread via GitHub
olegbonar commented on PR #17253: URL: https://github.com/apache/kafka/pull/17253#issuecomment-2367995668 @jlprat, I would happily do it. Could you point me out to it? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use th

Re: [PR] KAFKA-17574: Allow overriding TestKitNodes baseDirectory [kafka]

2024-09-23 Thread via GitHub
chia7712 commented on code in PR #17225: URL: https://github.com/apache/kafka/pull/17225#discussion_r1771247357 ## core/src/test/java/kafka/testkit/KafkaClusterTestKitTest.java: ## @@ -122,4 +126,25 @@ public void testCreateClusterAndCloseWithMultipleLogDirs(boolean combined) {

Re: [PR] KAFKA-17154: New consumer subscribe may join group without a call to consumer.poll [kafka]

2024-09-23 Thread via GitHub
lianetm commented on PR #17165: URL: https://github.com/apache/kafka/pull/17165#issuecomment-2367970018 Hey @FrankYang0529 , sorry for the late reply, I was traveling last week but I'm back, so will be taking another look at this. You can mark it as ready, we can leave the fix for the flaky

Re: [PR] KAFKA-17087: Deprecate `delete-config` of TopicCommand [kafka]

2024-09-23 Thread via GitHub
chia7712 commented on PR #17222: URL: https://github.com/apache/kafka/pull/17222#issuecomment-2367957438 @frankvicky please fix the conflicts -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the s

Re: [PR] KAFKA-17385: Remove authorizer, authorizer-properties, zk-tls-config-file in AclCommand [kafka]

2024-09-23 Thread via GitHub
chia7712 commented on PR #17224: URL: https://github.com/apache/kafka/pull/17224#issuecomment-2367956458 @FrankYang0529 please fix the conflicts -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to th

Re: [PR] KAFKA-17581: AsyncKafkaConsumer can't unsubscribe invalid topics [kafka]

2024-09-23 Thread via GitHub
lianetm commented on code in PR #17244: URL: https://github.com/apache/kafka/pull/17244#discussion_r1771230669 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/events/ApplicationEventProcessor.java: ## @@ -246,6 +246,7 @@ private void process(final Subscripti

Re: [PR] KAFKA-17552: Handle LIST_OFFSETS request for max_timestamp when remote storage is enabled [kafka]

2024-09-23 Thread via GitHub
chia7712 commented on code in PR #17248: URL: https://github.com/apache/kafka/pull/17248#discussion_r1771227003 ## core/src/main/java/kafka/log/remote/RemoteLogManager.java: ## @@ -709,6 +709,29 @@ && isRemoteSegmentWithinLeaderEpochs(rlsMetadata, unifiedLog.logEndOffset(), epo

Re: [PR] KAFKA-17585: `offsetResetStrategyTimestamp` should return `long` instead of `Long` [kafka]

2024-09-23 Thread via GitHub
xijiu commented on PR #17252: URL: https://github.com/apache/kafka/pull/17252#issuecomment-2367923953 @chia7712 Sure, I have removed it, PTAL -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to th

Re: [PR] KAFKA-17585: `offsetResetStrategyTimestamp` should return `long` instead of `Long` [kafka]

2024-09-23 Thread via GitHub
chia7712 commented on code in PR #17252: URL: https://github.com/apache/kafka/pull/17252#discussion_r1771216149 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/OffsetFetcherUtils.java: ## @@ -234,9 +234,8 @@ Map getOffsetResetTimestamp() { Set parti

Re: [PR] MINOR: Bump zstd-jni from 1.5.6-5 to 1.5.6-6 [kafka]

2024-09-23 Thread via GitHub
jlprat commented on PR #17253: URL: https://github.com/apache/kafka/pull/17253#issuecomment-2367860893 hi @olegbonar, can you add the release notes for this version? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

Re: [PR] MINOR: Bump zstd-jni from 1.5.6-5 to 1.5.6-6 [kafka]

2024-09-23 Thread via GitHub
olegbonar commented on PR #17253: URL: https://github.com/apache/kafka/pull/17253#issuecomment-2367840044 @mimaison may I ask you to review this? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to t

[PR] MINOR: Bump zstd-jni from 1.5.6-5 to 1.5.6-6 [kafka]

2024-09-23 Thread via GitHub
olegbonar opened a new pull request, #17253: URL: https://github.com/apache/kafka/pull/17253 ### Committer Checklist (excluded from commit message) - [ ] Verify design and implementation - [ ] Verify test coverage and CI build status - [ ] Verify documentation (including upgrade

Re: [PR] KAFKA-15344: Streams task should cache consumer nextOffsets [kafka]

2024-09-23 Thread via GitHub
lucasbru commented on code in PR #17091: URL: https://github.com/apache/kafka/pull/17091#discussion_r1771051009 ## streams/src/main/java/org/apache/kafka/streams/processor/internals/StreamTask.java: ## @@ -462,23 +463,29 @@ public Map prepareCommit() { } } -

Re: [PR] KAFKA-15344: Streams task should cache consumer nextOffsets [kafka]

2024-09-23 Thread via GitHub
lucasbru commented on code in PR #17091: URL: https://github.com/apache/kafka/pull/17091#discussion_r1771058136 ## streams/src/main/java/org/apache/kafka/streams/processor/internals/TaskManager.java: ## @@ -1820,6 +1820,9 @@ void addRecordsToTasks(final ConsumerRecords records)

Re: [PR] KAFKA-15344: Streams task should cache consumer nextOffsets [kafka]

2024-09-23 Thread via GitHub
lucasbru commented on code in PR #17091: URL: https://github.com/apache/kafka/pull/17091#discussion_r1771058136 ## streams/src/main/java/org/apache/kafka/streams/processor/internals/TaskManager.java: ## @@ -1820,6 +1820,9 @@ void addRecordsToTasks(final ConsumerRecords records)

Re: [PR] KAFKA-15344: Streams task should cache consumer nextOffsets [kafka]

2024-09-23 Thread via GitHub
lucasbru commented on code in PR #17091: URL: https://github.com/apache/kafka/pull/17091#discussion_r1771053314 ## streams/src/main/java/org/apache/kafka/streams/processor/internals/StreamTask.java: ## @@ -462,23 +463,29 @@ public Map prepareCommit() { } } -

Re: [PR] KAFKA-15344: Streams task should cache consumer nextOffsets [kafka]

2024-09-23 Thread via GitHub
lucasbru commented on code in PR #17091: URL: https://github.com/apache/kafka/pull/17091#discussion_r1771051009 ## streams/src/main/java/org/apache/kafka/streams/processor/internals/StreamTask.java: ## @@ -462,23 +463,29 @@ public Map prepareCommit() { } } -

Re: [PR] KAFKA-15344: Streams task should cache consumer nextOffsets [kafka]

2024-09-23 Thread via GitHub
lucasbru commented on code in PR #17091: URL: https://github.com/apache/kafka/pull/17091#discussion_r1771041249 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/Fetch.java: ## @@ -57,6 +75,22 @@ private Fetch( this.records = records; this.po

[PR] KAFKA-17585: `offsetResetStrategyTimestamp` should return `long` instead of `Long` [kafka]

2024-09-23 Thread via GitHub
xijiu opened a new pull request, #17252: URL: https://github.com/apache/kafka/pull/17252 As title ### Committer Checklist (excluded from commit message) - [ ] Verify design and implementation - [ ] Verify test coverage and CI build status - [ ] Verify documentation (including

Re: [PR] KAFKA-17563: Move `RequestConvertToJson` to server module [kafka]

2024-09-23 Thread via GitHub
xijiu commented on PR #17223: URL: https://github.com/apache/kafka/pull/17223#issuecomment-2367394834 > > Maybe we can use ApiKeys instead? > > Yes that's also an option. I'd really prefer this or pattern matching over the current code. @mimaison @chia7712 Thanks very much fo

Re: [PR] KAFKA-17570: Rewrite StressTestLog by JMH [kafka]

2024-09-22 Thread via GitHub
chia7712 commented on code in PR #17249: URL: https://github.com/apache/kafka/pull/17249#discussion_r1770840515 ## jmh-benchmarks/src/main/java/org/apache/kafka/jmh/log/StressTestLog.java: ## @@ -0,0 +1,218 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one or

Re: [PR] KAFKA-17459: Stablize reassign_partitions_test.py [kafka]

2024-09-22 Thread via GitHub
frankvicky commented on code in PR #17250: URL: https://github.com/apache/kafka/pull/17250#discussion_r1770804334 ## tests/kafkatest/tests/core/reassign_partitions_test.py: ## @@ -176,7 +176,7 @@ def test_reassign_partitions(self, bounce_brokers, reassign_from_offset_zero, me

Re: [PR] KAFKA-17459: Stablize reassign_partitions_test.py [kafka]

2024-09-22 Thread via GitHub
frankvicky commented on PR #17250: URL: https://github.com/apache/kafka/pull/17250#issuecomment-2367291581 Hello @chia7712 Following is the test result on branch 3.8: ``` SESSION REPORT (ALL TESTS)

Re: [PR] KAFKA-17530: Remove blacklist/whitelist from ReplaceField [kafka]

2024-09-22 Thread via GitHub
TaiJuWu commented on PR #17237: URL: https://github.com/apache/kafka/pull/17237#issuecomment-2367247213 > @TaiJuWu Could you please fix conflicts? Done. Thanks for review. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

Re: [PR] KAFKA-17530: Remove blacklist/whitelist from ReplaceField [kafka]

2024-09-22 Thread via GitHub
chia7712 commented on PR #17237: URL: https://github.com/apache/kafka/pull/17237#issuecomment-2367182725 @TaiJuWu Could you please fix conflicts? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to t

Re: [PR] MINOR: fixing JavaDocs and other cleanup [kafka]

2024-09-22 Thread via GitHub
chia7712 merged PR #17207: URL: https://github.com/apache/kafka/pull/17207 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafka.apache

Re: [PR] KAFKA-16331: remove EOSv1 from StreamsProducer [kafka]

2024-09-22 Thread via GitHub
chia7712 merged PR #17212: URL: https://github.com/apache/kafka/pull/17212 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafka.apache

Re: [PR] KAFKA-17459: Stablize reassign_partitions_test.py [kafka]

2024-09-22 Thread via GitHub
chia7712 commented on code in PR #17250: URL: https://github.com/apache/kafka/pull/17250#discussion_r1770737046 ## tests/kafkatest/tests/core/reassign_partitions_test.py: ## @@ -176,7 +176,7 @@ def test_reassign_partitions(self, bounce_brokers, reassign_from_offset_zero, me

Re: [PR] KAFKA-17528: Remove whitelist/blacklist from JMXReporter [kafka]

2024-09-22 Thread via GitHub
chia7712 merged PR #17179: URL: https://github.com/apache/kafka/pull/17179 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafka.apache

Re: [PR] KAFKA-17529: Remove blacklist from MM2 [kafka]

2024-09-22 Thread via GitHub
chia7712 commented on code in PR #17202: URL: https://github.com/apache/kafka/pull/17202#discussion_r1770733451 ## docs/upgrade.html: ## @@ -51,6 +51,18 @@ Notable changes in 4 The --whitelist option was removed from the kafka-console-consumer command line tool

Re: [PR] KAFKA-17512: Move LogSegmentTest to storage module [kafka]

2024-09-22 Thread via GitHub
xijiu commented on PR #17174: URL: https://github.com/apache/kafka/pull/17174#issuecomment-2367091855 @chia7712 Inlining does make the code more cleaner. I have fixed it, PTAL -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

Re: [PR] KAFKA-17540: Create floating tag on trunk for CI cache [kafka]

2024-09-22 Thread via GitHub
fonsdant commented on PR #17204: URL: https://github.com/apache/kafka/pull/17204#issuecomment-2366967094 How about using only a ref to point to the cached commit instead? A tag isn't the best option, as described in the GitHub REST API documentation: _"A Git tag is similar to a Git re

Re: [PR] KAFKA-17524: Add timeout to StreamThreadTest.shouldReturnErrorIfProducerInstanceIdNotInitialized [kafka]

2024-09-22 Thread via GitHub
mjsax closed pull request #17167: KAFKA-17524: Add timeout to StreamThreadTest.shouldReturnErrorIfProducerInstanceIdNotInitialized URL: https://github.com/apache/kafka/pull/17167 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub an

Re: [PR] KAFKA-17459: Stablize reassign_partitions_test.py [kafka]

2024-09-22 Thread via GitHub
frankvicky commented on PR #17250: URL: https://github.com/apache/kafka/pull/17250#issuecomment-2366844405 Test result on my local machine ``` SESSION REPORT (ALL TESTS) ducktape version: 0.11.4 s

[PR] [WIP] KAFKA-16974 Support to create a quorum controller which is not in cluster [kafka]

2024-09-22 Thread via GitHub
brandboat opened a new pull request, #17251: URL: https://github.com/apache/kafka/pull/17251 related to https://issues.apache.org/jira/browse/KAFKA-16974?filter=12353520 ### Committer Checklist (excluded from commit message) - [ ] Verify design and implementation - [ ] Verify te

[PR] KAFKA-17459: Stablize reassign_partitions_test.py [kafka]

2024-09-22 Thread via GitHub
frankvicky opened a new pull request, #17250: URL: https://github.com/apache/kafka/pull/17250 JIRA: [KAFKA-17459](https://issues.apache.org/jira/browse/KAFKA-17459) ### Committer Checklist (excluded from commit message) - [ ] Verify design and implementation - [ ] Verify test co

[PR] KAFKA-17570: Rewrite StressTestLog by JMH [kafka]

2024-09-22 Thread via GitHub
frankvicky opened a new pull request, #17249: URL: https://github.com/apache/kafka/pull/17249 JIRA: [KAFKA-17570](https://issues.apache.org/jira/browse/KAFKA-17570) ### Committer Checklist (excluded from commit message) - [ ] Verify design and implementation - [ ] Verify test co

Re: [PR] MINOR: validate ReplaceField config [kafka]

2024-09-22 Thread via GitHub
TaiJuWu commented on code in PR #17247: URL: https://github.com/apache/kafka/pull/17247#discussion_r1770233963 ## connect/transforms/src/main/java/org/apache/kafka/connect/transforms/ReplaceField.java: ## @@ -78,6 +79,10 @@ interface ConfigName { .define(ConfigName.

Re: [PR] MINOR: validate ReplaceField config [kafka]

2024-09-22 Thread via GitHub
m1a2st commented on code in PR #17247: URL: https://github.com/apache/kafka/pull/17247#discussion_r1770153629 ## connect/transforms/src/main/java/org/apache/kafka/connect/transforms/ReplaceField.java: ## @@ -95,6 +100,9 @@ public String version() { @Override public v

[PR] KAFKA-17552: Handle LIST_OFFSETS request for max_timestamp when remote storage is enabled [kafka]

2024-09-22 Thread via GitHub
FrankYang0529 opened a new pull request, #17248: URL: https://github.com/apache/kafka/pull/17248 *More detailed description of your change, if necessary. The PR title and PR message become the squashed commit message, so use a separate comment to ping reviewers.* *Summ

[PR] MINOR: validate ReplaceField config [kafka]

2024-09-21 Thread via GitHub
TaiJuWu opened a new pull request, #17247: URL: https://github.com/apache/kafka/pull/17247 There is no validation of ReplaceField, we should add it. ### Committer Checklist (excluded from commit message) - [ ] Verify design and implementation - [ ] Verify test coverage and CI bu

Re: [PR] KAFKA-17525: Convert the UnknownServerException to InvalidRequestException when altering client-metrics config at runtime [kafka]

2024-09-21 Thread via GitHub
TaiJuWu commented on code in PR #17168: URL: https://github.com/apache/kafka/pull/17168#discussion_r1759638418 ## server/src/main/java/org/apache/kafka/server/metrics/ClientMetricsConfigs.java: ## @@ -131,9 +131,11 @@ private static void validateProperties(Properties properties

Re: [PR] KAFKA-17520: Align ducktape version in tests/docker/Dockerfile and tests/setup.py [kafka]

2024-09-21 Thread via GitHub
unknowntpo commented on code in PR #17240: URL: https://github.com/apache/kafka/pull/17240#discussion_r1769708462 ## tests/docker/Dockerfile: ## @@ -63,7 +63,7 @@ LABEL ducker.creator=$ducker_creator # we have to install git since it is included in openjdk:8 but not openjdk:11

Re: [PR] KAFKA-17520: Align ducktape version in tests/docker/Dockerfile and tests/setup.py [kafka]

2024-09-21 Thread via GitHub
unknowntpo commented on code in PR #17240: URL: https://github.com/apache/kafka/pull/17240#discussion_r1769708276 ## tests/setup.py: ## @@ -51,7 +51,7 @@ def run_tests(self): license="apache2.0", packages=find_packages(), include_package_data=True, - in

Re: [PR] KAFKA-16331: remove EOSv1 from StreamsProducer [kafka]

2024-09-21 Thread via GitHub
mjsax commented on code in PR #17212: URL: https://github.com/apache/kafka/pull/17212#discussion_r1769694361 ## streams/src/main/java/org/apache/kafka/streams/processor/internals/ActiveTaskCreator.java: ## @@ -318,14 +314,7 @@ Map producerMetrics() { } Set producerCl

Re: [PR] KAFKA-16331: remove EOSv1 from StreamsProducer [kafka]

2024-09-21 Thread via GitHub
mjsax commented on code in PR #17212: URL: https://github.com/apache/kafka/pull/17212#discussion_r1769694361 ## streams/src/main/java/org/apache/kafka/streams/processor/internals/ActiveTaskCreator.java: ## @@ -318,14 +314,7 @@ Map producerMetrics() { } Set producerCl

Re: [PR] KAFKA-17540: Create floating tag on trunk for CI cache [kafka]

2024-09-21 Thread via GitHub
fonsdant commented on PR #17204: URL: https://github.com/apache/kafka/pull/17204#issuecomment-2365398034 > Can we do: fetch, merge --ff-only, push instead? It seems this approach is not so out-of-the-box. In my tests, Git fails with fatal: refusing to merge unrelated histories: [here

Re: [PR] KAFKA-17505: New consumer seekToBeginning/End should run in background thread [kafka]

2024-09-21 Thread via GitHub
TaiJuWu commented on code in PR #17230: URL: https://github.com/apache/kafka/pull/17230#discussion_r1769625701 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/AsyncKafkaConsumer.java: ## @@ -863,9 +865,14 @@ public long position(TopicPartition partition, Dur

Re: [PR] KAFKA-17530: Remove blacklist/whitelist from ReplaceField [kafka]

2024-09-21 Thread via GitHub
TaiJuWu commented on PR #17237: URL: https://github.com/apache/kafka/pull/17237#issuecomment-2365263862 > @TaiJuWu could you please update `upgrade.html`? Done. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use th

[PR] KAFKA-17568 Rewrite TestPurgatoryPerformance by JMH [kafka]

2024-09-21 Thread via GitHub
m1a2st opened a new pull request, #17246: URL: https://github.com/apache/kafka/pull/17246 Jira: https://issues.apache.org/jira/browse/KAFKA-17568 Move TestPurgatoryPerformance from Scala to Java, and transfer to use benchmark. ### Committer Checklist (excluded from commit message)

Re: [PR] MINOR: fix generics in streams-test-utils package [kafka]

2024-09-21 Thread via GitHub
chia7712 merged PR #17206: URL: https://github.com/apache/kafka/pull/17206 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafka.apache

Re: [PR] KAFKA-17540: Create floating tag on trunk for CI cache [kafka]

2024-09-21 Thread via GitHub
fonsdant commented on code in PR #17204: URL: https://github.com/apache/kafka/pull/17204#discussion_r1769568062 ## .github/workflows/ci-complete.yml: ## @@ -118,3 +118,16 @@ jobs: description: 'The build scan was successfully published' context: 'Gradle Bui

Re: [PR] KAFKA-17578: Remove partitionRacks from TopicMetadata [kafka]

2024-09-21 Thread via GitHub
dajac commented on PR #17233: URL: https://github.com/apache/kafka/pull/17233#issuecomment-2365186575 @FrankYang0529 Thanks for the update. I am travelling today so I will review it on Monday. -- This is an automated message from the Apache Git Service. To respond to the message, please l

Re: [PR] KAFKA-17520: Align ducktape version in tests/docker/Dockerfile and tests/setup.py [kafka]

2024-09-21 Thread via GitHub
chia7712 commented on code in PR #17240: URL: https://github.com/apache/kafka/pull/17240#discussion_r1769554254 ## tests/docker/Dockerfile: ## @@ -63,7 +63,7 @@ LABEL ducker.creator=$ducker_creator # we have to install git since it is included in openjdk:8 but not openjdk:11 R

Re: [PR] MINOR: Code cleanup Kafka Streams [kafka]

2024-09-21 Thread via GitHub
sjhajharia commented on PR #16050: URL: https://github.com/apache/kafka/pull/16050#issuecomment-2365167257 Hey @mjsax Sorry, I was swamped a bit. Getting back to this, thanks for the review. I have updated the PR. Could you pls help review again. Thanks -- This is an automated

Re: [PR] KAFKA-17385: Remove authorizer, authorizer-properties, zk-tls-config-file in AclCommand [kafka]

2024-09-21 Thread via GitHub
FrankYang0529 commented on PR #17224: URL: https://github.com/apache/kafka/pull/17224#issuecomment-2365165916 > @FrankYang0529 Could you please update `upgrade.html`? Added it. Thanks for the reminder. -- This is an automated message from the Apache Git Service. To respond to the me

Re: [PR] KAFKA-17540: Create floating tag on trunk for CI cache [kafka]

2024-09-21 Thread via GitHub
mumrah commented on code in PR #17204: URL: https://github.com/apache/kafka/pull/17204#discussion_r1769545365 ## .github/workflows/ci-complete.yml: ## @@ -118,3 +118,16 @@ jobs: description: 'The build scan was successfully published' context: 'Gradle Build

Re: [PR] KAFKA-17540: Create floating tag on trunk for CI cache [kafka]

2024-09-21 Thread via GitHub
fonsdant commented on code in PR #17204: URL: https://github.com/apache/kafka/pull/17204#discussion_r1769544347 ## .github/workflows/ci-complete.yml: ## @@ -118,3 +118,16 @@ jobs: description: 'The build scan was successfully published' context: 'Gradle Bui

Re: [PR] KAFKA-17540: Create floating tag on trunk for CI cache [kafka]

2024-09-21 Thread via GitHub
fonsdant commented on code in PR #17204: URL: https://github.com/apache/kafka/pull/17204#discussion_r1769544347 ## .github/workflows/ci-complete.yml: ## @@ -118,3 +118,16 @@ jobs: description: 'The build scan was successfully published' context: 'Gradle Bui

Re: [PR] KAFKA-17540: Create floating tag on trunk for CI cache [kafka]

2024-09-21 Thread via GitHub
fonsdant commented on code in PR #17204: URL: https://github.com/apache/kafka/pull/17204#discussion_r1769544347 ## .github/workflows/ci-complete.yml: ## @@ -118,3 +118,16 @@ jobs: description: 'The build scan was successfully published' context: 'Gradle Bui

Re: [PR] KAFKA-16683: Extract security-related helpers from scala.TestUtils to java class [kafka]

2024-09-21 Thread via GitHub
FrankYang0529 commented on PR #16912: URL: https://github.com/apache/kafka/pull/16912#issuecomment-2365162969 Hi @chia7712, thanks for the suggestion. I addressed all comments. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub a

Re: [PR] KAFKA-17540: Create floating tag on trunk for CI cache [kafka]

2024-09-21 Thread via GitHub
fonsdant commented on code in PR #17204: URL: https://github.com/apache/kafka/pull/17204#discussion_r1769544347 ## .github/workflows/ci-complete.yml: ## @@ -118,3 +118,16 @@ jobs: description: 'The build scan was successfully published' context: 'Gradle Bui

Re: [PR] KAFKA-17540: Create floating tag on trunk for CI cache [kafka]

2024-09-21 Thread via GitHub
fonsdant commented on code in PR #17204: URL: https://github.com/apache/kafka/pull/17204#discussion_r1769544347 ## .github/workflows/ci-complete.yml: ## @@ -118,3 +118,16 @@ jobs: description: 'The build scan was successfully published' context: 'Gradle Bui

Re: [PR] KAFKA-17540: Create floating tag on trunk for CI cache [kafka]

2024-09-21 Thread via GitHub
fonsdant commented on code in PR #17204: URL: https://github.com/apache/kafka/pull/17204#discussion_r1769544347 ## .github/workflows/ci-complete.yml: ## @@ -118,3 +118,16 @@ jobs: description: 'The build scan was successfully published' context: 'Gradle Bui

Re: [PR] KAFKA-17505: New consumer seekToBeginning/End should run in background thread [kafka]

2024-09-21 Thread via GitHub
FrankYang0529 commented on code in PR #17230: URL: https://github.com/apache/kafka/pull/17230#discussion_r1769499444 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/AsyncKafkaConsumer.java: ## @@ -863,9 +865,14 @@ public long position(TopicPartition partitio

Re: [PR] KAFKA-17578: Remove partitionRacks from TopicMetadata [kafka]

2024-09-20 Thread via GitHub
FrankYang0529 commented on PR #17233: URL: https://github.com/apache/kafka/pull/17233#issuecomment-2365030214 Hi @dajac, I fixed both `testGroupEpochBumpWhenNewStaticMemberJoins` and `testNewJoiningMemberTriggersNewTargetAssignment`. Originally, different `partitionRacks` triggers subscript

Re: [PR] KAFKA-17465: Make getMembersFromGroup be non-blocking [kafka]

2024-09-20 Thread via GitHub
TaiJuWu commented on code in PR #17080: URL: https://github.com/apache/kafka/pull/17080#discussion_r1769485396 ## clients/src/main/java/org/apache/kafka/clients/admin/KafkaAdminClient.java: ## @@ -4143,19 +4140,27 @@ public RemoveMembersFromConsumerGroupResult removeMembersFrom

Re: [PR] KAFKA-17465: Make getMembersFromGroup be non-blocking [kafka]

2024-09-20 Thread via GitHub
frankvicky commented on code in PR #17080: URL: https://github.com/apache/kafka/pull/17080#discussion_r1769459881 ## clients/src/main/java/org/apache/kafka/clients/admin/KafkaAdminClient.java: ## @@ -4143,19 +4140,27 @@ public RemoveMembersFromConsumerGroupResult removeMembersF

  1   2   3   4   5   6   7   8   9   10   >