Re: [PR] KAFKA-12187: replace assertTrue(obj instanceof X) with assertInstanceOf [kafka]

2024-03-19 Thread via GitHub
chia7712 commented on PR #15512: URL: https://github.com/apache/kafka/pull/15512#issuecomment-2006002354 I have pushed a commit to rebase code and fix conflict. will merge it if there is no connected failure. -- This is an automated message from the Apache Git Service. To respond to the

Re: [PR] KAFKA-16341: fix the LogValidator for non-compressed type [kafka]

2024-03-19 Thread via GitHub
chia7712 commented on PR #15476: URL: https://github.com/apache/kafka/pull/15476#issuecomment-2005884703 I have rebase the PR to trigger QA again, and I will merge it if no related failed tests. -- This is an automated message from the Apache Git Service. To respond to the message,

Re: [PR] KAFKA-16314: Introducing the AbortableTransactionException [kafka]

2024-03-19 Thread via GitHub
sjhajharia commented on code in PR #15486: URL: https://github.com/apache/kafka/pull/15486#discussion_r1529793846 ## clients/src/test/java/org/apache/kafka/clients/producer/internals/TransactionManagerTest.java: ## @@ -3523,6 +3524,128 @@ public void

Re: [PR] KAFKA-16314: Introducing the AbortableTransactionException [kafka]

2024-03-19 Thread via GitHub
sjhajharia commented on code in PR #15486: URL: https://github.com/apache/kafka/pull/15486#discussion_r1529794514 ## core/src/test/scala/unit/kafka/server/ReplicaManagerTest.scala: ## @@ -3040,6 +3048,7 @@ class ReplicaManagerTest { transactionalId = transactionalId,

Re: [PR] KAFKA-15950: Serialize broker heartbeat requests [kafka]

2024-03-19 Thread via GitHub
soarez commented on code in PR #14903: URL: https://github.com/apache/kafka/pull/14903#discussion_r1529919190 ## core/src/test/scala/unit/kafka/server/BrokerLifecycleManagerTest.scala: ## @@ -219,15 +225,16 @@ class BrokerLifecycleManagerTest { Collections.emptyMap(),

[jira] [Assigned] (KAFKA-16385) Segment is rolled before segment.ms or segment.bytes breached

2024-03-19 Thread Kuan Po Tseng (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuan Po Tseng reassigned KAFKA-16385: - Assignee: Kuan Po Tseng > Segment is rolled before segment.ms or segment.bytes

[jira] [Commented] (KAFKA-16385) Segment is rolled before segment.ms or segment.bytes breached

2024-03-19 Thread Kuan Po Tseng (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17828227#comment-17828227 ] Kuan Po Tseng commented on KAFKA-16385: --- I'm willing to take over this ! Many thanks ! > Segment

Re: [PR] KAFKA-15950: Serialize broker heartbeat requests [kafka]

2024-03-19 Thread via GitHub
soarez commented on PR #14903: URL: https://github.com/apache/kafka/pull/14903#issuecomment-2006292277 Thanks for the review @junrao. Please take another look. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

Re: [PR] KAFKA-14589 ConsumerGroupCommand rewritten in java [kafka]

2024-03-19 Thread via GitHub
nizhikov commented on PR #14471: URL: https://github.com/apache/kafka/pull/14471#issuecomment-2006340058 @chia7712 PR merged with the latest trunk. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[jira] [Updated] (KAFKA-16385) Segment is rolled before segment.ms or segment.bytes breached

2024-03-19 Thread Luke Chen (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Chen updated KAFKA-16385: -- Description: Steps to reproduce: 0. Startup a broker with `log.retention.check.interval.ms=1000` to

[jira] [Commented] (KAFKA-16385) Segment is rolled before segment.ms or segment.bytes breached

2024-03-19 Thread Divij Vaidya (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17828247#comment-17828247 ] Divij Vaidya commented on KAFKA-16385: -- [~showuon] I must be missing something here but the current

[jira] [Created] (KAFKA-16385) Segment is rolled before segment.ms or segment.bytes breached

2024-03-19 Thread Luke Chen (Jira)
Luke Chen created KAFKA-16385: - Summary: Segment is rolled before segment.ms or segment.bytes breached Key: KAFKA-16385 URL: https://issues.apache.org/jira/browse/KAFKA-16385 Project: Kafka

Re: [PR] KAFKA-16313: Offline group protocol migration (reopened) [kafka]

2024-03-19 Thread via GitHub
dajac commented on code in PR #15546: URL: https://github.com/apache/kafka/pull/15546#discussion_r1529919197 ## group-coordinator/src/main/java/org/apache/kafka/coordinator/group/GroupMetadataManager.java: ## @@ -598,15 +600,16 @@ public List describeGroups( */

Re: [PR] KAFKA-15950: Serialize broker heartbeat requests [kafka]

2024-03-19 Thread via GitHub
soarez commented on code in PR #14903: URL: https://github.com/apache/kafka/pull/14903#discussion_r1529927411 ## core/src/test/scala/unit/kafka/server/BrokerLifecycleManagerTest.scala: ## @@ -197,11 +197,17 @@ class BrokerLifecycleManagerTest { result } - def

[jira] [Resolved] (KAFKA-16378) Under tiered storage, deleting local logs does not free disk space

2024-03-19 Thread Jianbin Chen (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jianbin Chen resolved KAFKA-16378. -- Resolution: Fixed > Under tiered storage, deleting local logs does not free disk space >

Re: [PR] KAFKA-14589 ConsumerGroupCommand rewritten in java [kafka]

2024-03-19 Thread via GitHub
chia7712 commented on PR #14471: URL: https://github.com/apache/kafka/pull/14471#issuecomment-2006320092 @nizhikov sorry for late review. could you rebase code and I will take a look later. -- This is an automated message from the Apache Git Service. To respond to the message, please log

[jira] [Updated] (KAFKA-16385) Segment is rolled before segment.ms or segment.bytes breached

2024-03-19 Thread Luke Chen (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Chen updated KAFKA-16385: -- Affects Version/s: 3.5.1 > Segment is rolled before segment.ms or segment.bytes breached >

[jira] [Updated] (KAFKA-16385) Segment is rolled before segment.ms or segment.bytes breached

2024-03-19 Thread Luke Chen (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Chen updated KAFKA-16385: -- Description: Steps to reproduce: 0. Startup a broker with `log.retention.check.interval.ms=1000` to

[jira] [Commented] (KAFKA-13361) Support fine-grained compression options

2024-03-19 Thread Mickael Maison (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17828245#comment-17828245 ] Mickael Maison commented on KAFKA-13361: Dongjin had written a KIP

Re: [PR] KAFKA-14752: Kafka examples improvements - processor changes [kafka]

2024-03-19 Thread via GitHub
fvaleri commented on code in PR #13516: URL: https://github.com/apache/kafka/pull/13516#discussion_r1530075375 ## examples/src/main/java/kafka/examples/ExactlyOnceMessageProcessor.java: ## @@ -81,111 +88,115 @@ public ExactlyOnceMessageProcessor(final String inputTopic,

[jira] [Commented] (KAFKA-10409) Refactor Kafka Streams RocksDb iterators

2024-03-19 Thread Jorge Esteban Quilcate Otoya (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17828250#comment-17828250 ] Jorge Esteban Quilcate Otoya commented on KAFKA-10409: -- [~dhawalkapil] thanks for

Re: [PR] KAFKA-14752: Kafka examples improvements - processor changes [kafka]

2024-03-19 Thread via GitHub
fvaleri commented on code in PR #13516: URL: https://github.com/apache/kafka/pull/13516#discussion_r1530075375 ## examples/src/main/java/kafka/examples/ExactlyOnceMessageProcessor.java: ## @@ -81,111 +88,115 @@ public ExactlyOnceMessageProcessor(final String inputTopic,

[jira] [Commented] (KAFKA-16385) Segment is rolled before segment.ms or segment.bytes breached

2024-03-19 Thread Luke Chen (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17828251#comment-17828251 ] Luke Chen commented on KAFKA-16385: --- [~divijvaidya], I agree with you in Kafka, we don't have clear

[jira] [Commented] (KAFKA-16385) Segment is rolled before segment.ms or segment.bytes breached

2024-03-19 Thread Chia-Ping Tsai (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17828281#comment-17828281 ] Chia-Ping Tsai commented on KAFKA-16385: It seems to me the scenario is about " should we roll

Re: [PR] KAFKA-16313: Offline group protocol migration (reopened) [kafka]

2024-03-19 Thread via GitHub
dajac commented on code in PR #15546: URL: https://github.com/apache/kafka/pull/15546#discussion_r1530443218 ## group-coordinator/src/main/java/org/apache/kafka/coordinator/group/GroupMetadataManager.java: ## @@ -619,6 +622,22 @@ ConsumerGroup getOrMaybeCreateConsumerGroup(

[jira] [Commented] (KAFKA-13906) Invalid replica state transition

2024-03-19 Thread Igor Soarez (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17828365#comment-17828365 ] Igor Soarez commented on KAFKA-13906: - That is correct [~showuon]  > Invalid replica state

Re: [PR] KAFKA-14589 ConsumerGroupCommand rewritten in java [kafka]

2024-03-19 Thread via GitHub
nizhikov commented on code in PR #14471: URL: https://github.com/apache/kafka/pull/14471#discussion_r1530718724 ## tools/src/main/java/org/apache/kafka/tools/consumer/group/ConsumerGroupCommand.java: ## @@ -0,0 +1,1240 @@ +/* + * Licensed to the Apache Software Foundation (ASF)

[jira] [Updated] (KAFKA-16385) Segment is rolled before segment.ms or segment.bytes breached

2024-03-19 Thread Luke Chen (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Chen updated KAFKA-16385: -- Description: Steps to reproduce: 0. Startup a broker with `log.retention.check.interval.ms=1000` to

Re: [PR] KAFKA-14589 ConsumerGroupCommand rewritten in java [kafka]

2024-03-19 Thread via GitHub
chia7712 commented on code in PR #14471: URL: https://github.com/apache/kafka/pull/14471#discussion_r1530643112 ## core/src/test/scala/unit/kafka/utils/TestUtils.scala: ## @@ -664,7 +664,7 @@ object TestUtils extends Logging { * until the leader is elected and metadata is

Re: [PR] KAFKA-14589 ConsumerGroupCommand rewritten in java [kafka]

2024-03-19 Thread via GitHub
nizhikov commented on code in PR #14471: URL: https://github.com/apache/kafka/pull/14471#discussion_r1530807872 ## tools/src/main/java/org/apache/kafka/tools/consumer/group/ConsumerGroupCommand.java: ## @@ -0,0 +1,1240 @@ +/* + * Licensed to the Apache Software Foundation (ASF)

[jira] [Updated] (KAFKA-16386) NETWORK_EXCEPTIONs from transaction verification are not translated

2024-03-19 Thread Sean Quah (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Quah updated KAFKA-16386: -- Description: KAFKA-14402

[jira] [Created] (KAFKA-16387) Allow kafka-metadata-shell to read a running server metadata

2024-03-19 Thread PoAn Yang (Jira)
PoAn Yang created KAFKA-16387: - Summary: Allow kafka-metadata-shell to read a running server metadata Key: KAFKA-16387 URL: https://issues.apache.org/jira/browse/KAFKA-16387 Project: Kafka

Re: [PR] KAFKA-15517: Improve MirrorMaker logging in case of authorization errors [kafka]

2024-03-19 Thread via GitHub
wernerdv commented on PR #15558: URL: https://github.com/apache/kafka/pull/15558#issuecomment-2007211486 Hello, @mimaison Please, take a look. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

Re: [PR] KAFKA-16313: Offline group protocol migration (reopened) [kafka]

2024-03-19 Thread via GitHub
dongnuo123 commented on code in PR #15546: URL: https://github.com/apache/kafka/pull/15546#discussion_r1530392822 ## group-coordinator/src/main/java/org/apache/kafka/coordinator/group/GroupMetadataManager.java: ## @@ -598,15 +600,16 @@ public List describeGroups( */

Re: [PR] MINOR : Removed the depreciated information about Zk to Kraft migration. [kafka]

2024-03-19 Thread via GitHub
chia7712 commented on code in PR #15552: URL: https://github.com/apache/kafka/pull/15552#discussion_r1530699013 ## docs/ops.html: ## @@ -3797,14 +3797,6 @@ Modifying certain dynamic configurations on the standalone KRaft controller - ZooKeeper to KRaft Migration

[jira] [Commented] (KAFKA-16153) kraft_upgrade_test system test is broken

2024-03-19 Thread Chia-Ping Tsai (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17828444#comment-17828444 ] Chia-Ping Tsai commented on KAFKA-16153: IIRC, only production-ready can be acceptable. we don't

[jira] [Created] (KAFKA-16386) NETWORK_EXCEPTIONs from transaction verification are not translated

2024-03-19 Thread Sean Quah (Jira)
Sean Quah created KAFKA-16386: - Summary: NETWORK_EXCEPTIONs from transaction verification are not translated Key: KAFKA-16386 URL: https://issues.apache.org/jira/browse/KAFKA-16386 Project: Kafka

[jira] [Comment Edited] (KAFKA-16385) Segment is rolled before segment.ms or segment.bytes breached

2024-03-19 Thread Luke Chen (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17828319#comment-17828319 ] Luke Chen edited comment on KAFKA-16385 at 3/19/24 12:58 PM: -

[jira] [Comment Edited] (KAFKA-16385) Segment is rolled before segment.ms or segment.bytes breached

2024-03-19 Thread Luke Chen (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17828319#comment-17828319 ] Luke Chen edited comment on KAFKA-16385 at 3/19/24 12:57 PM: -

Re: [PR] KAFKA-16341: fix the LogValidator for non-compressed type [kafka]

2024-03-19 Thread via GitHub
chia7712 merged PR #15476: URL: https://github.com/apache/kafka/pull/15476 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [PR] KAFKA-16341: fix the LogValidator for non-compressed type [kafka]

2024-03-19 Thread via GitHub
chia7712 commented on PR #15476: URL: https://github.com/apache/kafka/pull/15476#issuecomment-2007459578 @johnnychhsu thanks for this contribution! please complete the follow-up: 1. 3.6 branch has many conflicts so please file a PR for branch 3.6 2. update KIP-734 for the offset of

[jira] [Updated] (KAFKA-16341) Fix un-compressed records

2024-03-19 Thread Chia-Ping Tsai (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai updated KAFKA-16341: --- Fix Version/s: 3.8.0 3.7.1 > Fix un-compressed records >

[jira] [Commented] (KAFKA-16341) Fix un-compressed records

2024-03-19 Thread Chia-Ping Tsai (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17828407#comment-17828407 ] Chia-Ping Tsai commented on KAFKA-16341: pending for backporting to 3.6 > Fix un-compressed

[jira] [Created] (KAFKA-16388) add production-ready test of 3.3 - 3.6 release to MetadataVersionTest.testFromVersionString

2024-03-19 Thread Chia-Ping Tsai (Jira)
Chia-Ping Tsai created KAFKA-16388: -- Summary: add production-ready test of 3.3 - 3.6 release to MetadataVersionTest.testFromVersionString Key: KAFKA-16388 URL: https://issues.apache.org/jira/browse/KAFKA-16388

Re: [PR] KAFKA-16314: Introducing the AbortableTransactionException [kafka]

2024-03-19 Thread via GitHub
jolshan commented on code in PR #15486: URL: https://github.com/apache/kafka/pull/15486#discussion_r1530741929 ## core/src/test/scala/unit/kafka/server/ReplicaManagerTest.scala: ## @@ -3040,6 +3048,7 @@ class ReplicaManagerTest { transactionalId = transactionalId,

Re: [PR] KAFKA-16367; Full ConsumerGroupHeartbeat response must be sent when full request is received [kafka]

2024-03-19 Thread via GitHub
dajac commented on code in PR #15533: URL: https://github.com/apache/kafka/pull/15533#discussion_r1530481757 ## group-coordinator/src/main/java/org/apache/kafka/coordinator/group/GroupMetadataManager.java: ## @@ -1190,10 +1190,11 @@ private CoordinatorResult consumerGr

[PR] KAFKA-16386: Convert NETWORK_EXCEPTIONs from KIP-890 transaction verification [kafka]

2024-03-19 Thread via GitHub
squah-confluent opened a new pull request, #15559: URL: https://github.com/apache/kafka/pull/15559 KIP-890 Part 1 introduced verification of transactions with the transaction coordinator on the `Produce` and `TxnOffsetCommit` paths. This introduced the possibility of new errors when

[jira] [Commented] (KAFKA-16385) Segment is rolled before segment.ms or segment.bytes breached

2024-03-19 Thread Luke Chen (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17828319#comment-17828319 ] Luke Chen commented on KAFKA-16385: --- [~divijvaidya], I was thinking the use case you mentioned: _I

Re: [PR] KAFKA-16313: Offline group protocol migration (reopened) [kafka]

2024-03-19 Thread via GitHub
dongnuo123 commented on code in PR #15546: URL: https://github.com/apache/kafka/pull/15546#discussion_r1530392822 ## group-coordinator/src/main/java/org/apache/kafka/coordinator/group/GroupMetadataManager.java: ## @@ -598,15 +600,16 @@ public List describeGroups( */

Re: [PR] KAFKA-16367; Full ConsumerGroupHeartbeat response must be sent when full request is received [kafka]

2024-03-19 Thread via GitHub
dajac commented on code in PR #15533: URL: https://github.com/apache/kafka/pull/15533#discussion_r1530489017 ## group-coordinator/src/test/java/org/apache/kafka/coordinator/group/GroupMetadataManagerTest.java: ## @@ -1904,16 +2000,7 @@ public void testReconciliationProcess() {

Re: [PR] KAFKA-16367; Full ConsumerGroupHeartbeat response must be sent when full request is received [kafka]

2024-03-19 Thread via GitHub
dajac commented on PR #15533: URL: https://github.com/apache/kafka/pull/15533#issuecomment-200748 @jeffkbkim @jolshan @lianetm Thanks for your comments. I addressed them. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

Re: [PR] KAFKA-16367; Full ConsumerGroupHeartbeat response must be sent when full request is received [kafka]

2024-03-19 Thread via GitHub
dajac commented on PR #15533: URL: https://github.com/apache/kafka/pull/15533#issuecomment-2007332396 > They are the only three optional fields, right? There are actually mandatory in full requests. > Also, my understanding is that there are cases where we don't set

Re: [PR] KAFKA-16367; Full ConsumerGroupHeartbeat response must be sent when full request is received [kafka]

2024-03-19 Thread via GitHub
lianetm commented on PR #15533: URL: https://github.com/apache/kafka/pull/15533#issuecomment-2007369164 LGTM, thanks! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

Re: [PR] KAFKA-16341: fix the LogValidator for non-compressed type [kafka]

2024-03-19 Thread via GitHub
chia7712 commented on PR #15476: URL: https://github.com/apache/kafka/pull/15476#issuecomment-2007409274 JDK 11 gets cancel. It should be fine as it gets test in previous QA I run the failed tests on my local: ```sh ./gradlew cleanTest :tools:test --tests

Re: [PR] KAFKA-12187: replace assertTrue(obj instanceof X) with assertInstanceOf [kafka]

2024-03-19 Thread via GitHub
brandboat commented on code in PR #15512: URL: https://github.com/apache/kafka/pull/15512#discussion_r1530599572 ## clients/src/test/java/org/apache/kafka/clients/consumer/internals/AbstractCoordinatorTest.java: ## @@ -1037,7 +1038,7 @@ public void

Re: [PR] KAFKA-14589 ConsumerGroupCommand rewritten in java [kafka]

2024-03-19 Thread via GitHub
nizhikov commented on code in PR #14471: URL: https://github.com/apache/kafka/pull/14471#discussion_r1530708691 ## core/src/test/scala/unit/kafka/utils/TestUtils.scala: ## @@ -664,7 +664,7 @@ object TestUtils extends Logging { * until the leader is elected and metadata is

Re: [PR] KAFKA-14589 ConsumerGroupCommand rewritten in java [kafka]

2024-03-19 Thread via GitHub
nizhikov commented on code in PR #14471: URL: https://github.com/apache/kafka/pull/14471#discussion_r1530832758 ## checkstyle/import-control.xml: ## @@ -330,6 +330,7 @@ + Review Comment: This not required. Sorry for that, should

Re: [PR] KAFKA-14589 ConsumerGroupCommand rewritten in java [kafka]

2024-03-19 Thread via GitHub
nizhikov commented on PR #14471: URL: https://github.com/apache/kafka/pull/14471#issuecomment-2007792800 @chia7712 I addressed all your comments. Please, take a look one more time. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

[jira] [Updated] (KAFKA-16389) consumer_test.py’s test_valid_assignment fails with new consumer

2024-03-19 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True updated KAFKA-16389: -- Attachment: KAFKA-16389.patch > consumer_test.py’s test_valid_assignment fails with new consumer >

[jira] [Commented] (KAFKA-8154) Buffer Overflow exceptions between brokers and with clients

2024-03-19 Thread keith.paulson (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-8154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17828501#comment-17828501 ] keith.paulson commented on KAFKA-8154: -- [~tmancill] What is involved with getting this fix

Re: [PR] KAFKA-16367; Full ConsumerGroupHeartbeat response must be sent when full request is received [kafka]

2024-03-19 Thread via GitHub
dajac merged PR #15533: URL: https://github.com/apache/kafka/pull/15533 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[jira] [Resolved] (KAFKA-16367) Full ConsumerGroupHeartbeat response must be sent when full request is received

2024-03-19 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot resolved KAFKA-16367. - Fix Version/s: 3.8.0 Resolution: Fixed > Full ConsumerGroupHeartbeat response must be

[jira] [Updated] (KAFKA-16384) KRaft controller number recommendation

2024-03-19 Thread Peter (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter updated KAFKA-16384: -- Issue Type: Improvement (was: Bug) > KRaft controller number recommendation >

[jira] [Updated] (KAFKA-16384) KRaft controller number recommendation

2024-03-19 Thread Peter (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter updated KAFKA-16384: -- Affects Version/s: 3.7.0 > KRaft controller number recommendation > -- >

[jira] [Created] (KAFKA-16389) consumer_test.py’s test_valid_assignment fails with new consumer

2024-03-19 Thread Kirk True (Jira)
Kirk True created KAFKA-16389: - Summary: consumer_test.py’s test_valid_assignment fails with new consumer Key: KAFKA-16389 URL: https://issues.apache.org/jira/browse/KAFKA-16389 Project: Kafka

[jira] [Updated] (KAFKA-16389) consumer_test.py’s test_valid_assignment fails with new consumer

2024-03-19 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True updated KAFKA-16389: -- Description: The following error is reported when running the {{test_valid_assignment}} test from

[jira] [Updated] (KAFKA-16384) KRaft controller number recommendation

2024-03-19 Thread Peter (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter updated KAFKA-16384: -- Component/s: (was: controller) > KRaft controller number recommendation >

Re: [PR] KAFKA-14589 ConsumerGroupCommand rewritten in java [kafka]

2024-03-19 Thread via GitHub
nizhikov commented on code in PR #14471: URL: https://github.com/apache/kafka/pull/14471#discussion_r1530815007 ## tools/src/main/java/org/apache/kafka/tools/consumer/group/CsvUtils.java: ## @@ -0,0 +1,151 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one or

[jira] [Assigned] (KAFKA-14482) Move LogLoader to storage module

2024-03-19 Thread Dmitry Werner (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dmitry Werner reassigned KAFKA-14482: - Assignee: Ismael Juma (was: Dmitry Werner) > Move LogLoader to storage module >

[jira] [Assigned] (KAFKA-14482) Move LogLoader to storage module

2024-03-19 Thread Dmitry Werner (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dmitry Werner reassigned KAFKA-14482: - Assignee: Ismael Juma (was: Dmitry Werner) > Move LogLoader to storage module >

[jira] [Assigned] (KAFKA-14482) Move LogLoader to storage module

2024-03-19 Thread Dmitry Werner (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dmitry Werner reassigned KAFKA-14482: - Assignee: Dmitry Werner (was: Ismael Juma) > Move LogLoader to storage module >

[jira] [Commented] (KAFKA-14482) Move LogLoader to storage module

2024-03-19 Thread Dmitry Werner (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17828518#comment-17828518 ] Dmitry Werner commented on KAFKA-14482: --- [~ijuma] Thank you for the explanation. > Move LogLoader

[jira] [Updated] (KAFKA-16389) consumer_test.py’s test_valid_assignment fails with new consumer

2024-03-19 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True updated KAFKA-16389: -- Description: The following error is reported when running the {{test_valid_assignment}} test from

[jira] [Commented] (KAFKA-16388) add production-ready test of 3.3 - 3.6 release to MetadataVersionTest.testFromVersionString

2024-03-19 Thread Kuan Po Tseng (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17828542#comment-17828542 ] Kuan Po Tseng commented on KAFKA-16388: --- I'm willing to take over this~ Thanks ! > add

[jira] [Assigned] (KAFKA-16388) add production-ready test of 3.3 - 3.6 release to MetadataVersionTest.testFromVersionString

2024-03-19 Thread Kuan Po Tseng (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuan Po Tseng reassigned KAFKA-16388: - Assignee: Kuan Po Tseng > add production-ready test of 3.3 - 3.6 release to >

[jira] [Commented] (KAFKA-14482) Move LogLoader to storage module

2024-03-19 Thread Ismael Juma (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17828514#comment-17828514 ] Ismael Juma commented on KAFKA-14482: - [~javakillah] This ticket can't be done until the dependency

Re: [PR] KAFKA-15853: Move KafkaConfig properties definition out of core [kafka]

2024-03-19 Thread via GitHub
nizhikov commented on PR #15501: URL: https://github.com/apache/kafka/pull/15501#issuecomment-2007922919 Hello @OmniaGM Are you be able to split this PR in several to simplify review and merge? My jira https://issues.apache.org/jira/browse/KAFKA-14588 blocked by migration

Re: [PR] KAFKA-15756: [2/3] Migrate existing integration tests to run old protocol in new coordinator [kafka]

2024-03-19 Thread via GitHub
dongnuo123 commented on code in PR #14675: URL: https://github.com/apache/kafka/pull/14675#discussion_r1531051374 ## core/src/test/scala/integration/kafka/api/ConsumerBounceTest.scala: ## @@ -89,6 +96,8 @@ class ConsumerBounceTest extends AbstractConsumerTest with Logging {

[jira] [Updated] (KAFKA-16389) consumer_test.py’s test_valid_assignment fails with new consumer

2024-03-19 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True updated KAFKA-16389: -- Description: The following error is reported when running the {{test_valid_assignment}} test from

[jira] [Commented] (KAFKA-16389) consumer_test.py’s test_valid_assignment fails with new consumer

2024-03-19 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17828538#comment-17828538 ] Kirk True commented on KAFKA-16389: --- I've attached a patch which _appears_ to address the issue in the

Re: [PR] KAFKA-16217: Stop the abort transaction try loop when closing producers [kafka]

2024-03-19 Thread via GitHub
CalvinConfluent commented on code in PR #15541: URL: https://github.com/apache/kafka/pull/15541#discussion_r1531252560 ## clients/src/main/java/org/apache/kafka/clients/producer/internals/Sender.java: ## @@ -270,14 +270,7 @@ public void run() { while (!forceClose &&

Re: [PR] KAFKA-16217: Stop the abort transaction try loop when closing producers [kafka]

2024-03-19 Thread via GitHub
CalvinConfluent commented on PR #15541: URL: https://github.com/apache/kafka/pull/15541#issuecomment-2008340124 @kirktrue Move the test to the Sender test because less mock is needed to repro the bug. -- This is an automated message from the Apache Git Service. To respond to the message,

[jira] [Created] (KAFKA-16390) consumer_bench_test.py failed using AsyncKafkaConsumer

2024-03-19 Thread Philip Nee (Jira)
Philip Nee created KAFKA-16390: -- Summary: consumer_bench_test.py failed using AsyncKafkaConsumer Key: KAFKA-16390 URL: https://issues.apache.org/jira/browse/KAFKA-16390 Project: Kafka Issue

Re: [PR] KAFKA-16314: Introducing the AbortableTransactionException [kafka]

2024-03-19 Thread via GitHub
sjhajharia commented on PR #15486: URL: https://github.com/apache/kafka/pull/15486#issuecomment-2008655935 On that note @jolshan , do we any more open questions to address or we are good to go with this PR? Or are we in flux for

[jira] [Created] (KAFKA-16391) Cleanup .lock file after server is down

2024-03-19 Thread PoAn Yang (Jira)
PoAn Yang created KAFKA-16391: - Summary: Cleanup .lock file after server is down Key: KAFKA-16391 URL: https://issues.apache.org/jira/browse/KAFKA-16391 Project: Kafka Issue Type: Improvement

Re: [PR] MINOR: fix javadoc warnings [kafka]

2024-03-19 Thread via GitHub
gaurav-narula closed pull request #15527: MINOR: fix javadoc warnings URL: https://github.com/apache/kafka/pull/15527 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

Re: [PR] KAFKA-14752: Kafka examples improvements - processor changes [kafka]

2024-03-19 Thread via GitHub
gaoran10 commented on code in PR #13516: URL: https://github.com/apache/kafka/pull/13516#discussion_r1531455051 ## examples/src/main/java/kafka/examples/ExactlyOnceMessageProcessor.java: ## @@ -81,111 +88,115 @@ public ExactlyOnceMessageProcessor(final String inputTopic,

[jira] [Commented] (KAFKA-16385) Segment is rolled before segment.ms or segment.bytes breached

2024-03-19 Thread Chia-Ping Tsai (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17828594#comment-17828594 ] Chia-Ping Tsai commented on KAFKA-16385: {quote} One potential way to improve this is to use the

[jira] [Commented] (KAFKA-16391) Cleanup .lock file after server is down

2024-03-19 Thread PoAn Yang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17828597#comment-17828597 ] PoAn Yang commented on KAFKA-16391: --- Yes, I think so. From source code, it only close file channel.

Re: [PR] KAFKA-13949: /connectors endpoint supports listing task-configs and active topics [kafka]

2024-03-19 Thread via GitHub
github-actions[bot] commented on PR #15027: URL: https://github.com/apache/kafka/pull/15027#issuecomment-2008611925 This PR is being marked as stale since it has not had any activity in 90 days. If you would like to keep this PR alive, please ask a committer for review. If the PR has

Re: [PR] KAFKA-14589 ConsumerGroupCommand rewritten in java [kafka]

2024-03-19 Thread via GitHub
chia7712 commented on PR #14471: URL: https://github.com/apache/kafka/pull/14471#issuecomment-2008700834 the failed test pass on my local: ```sh ./gradlew cleanTest :streams:test --tests HighAvailabilityTaskAssignorIntegrationTest.shouldScaleOutWithWarmupTasksAndPersistentStores

Re: [PR] KAFKA-16217: Stop the abort transaction try loop when closing producers [kafka]

2024-03-19 Thread via GitHub
jolshan commented on PR #15541: URL: https://github.com/apache/kafka/pull/15541#issuecomment-200839 Looks pretty reasonable to me. I also want to get a +1 from Kirk to make sure he agrees it makes sense. I will also let the tests run.  -- This is an automated message from the

Re: [PR] KAFKA-12187: replace assertTrue(obj instanceof X) with assertInstanceOf [kafka]

2024-03-19 Thread via GitHub
chia7712 commented on PR #15512: URL: https://github.com/apache/kafka/pull/15512#issuecomment-2008579703 the failed tests pass on my local: ```sh ./gradlew cleanTest :streams:test --tests HighAvailabilityTaskAssignorIntegrationTest.shouldScaleOutWithWarmupTasksAndPersistentStores

Re: [PR] KAFKA-12187: replace assertTrue(obj instanceof X) with assertInstanceOf [kafka]

2024-03-19 Thread via GitHub
chia7712 merged PR #15512: URL: https://github.com/apache/kafka/pull/15512 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [PR] KAFKA-16222: KRaft Migration: Incorrect default user-principal quota after migration [kafka]

2024-03-19 Thread via GitHub
omkreddy commented on PR #15481: URL: https://github.com/apache/kafka/pull/15481#issuecomment-2008684718 @showuon Can we merge the PR? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[jira] [Resolved] (KAFKA-12187) replace assertTrue(obj instanceof X) by assertInstanceOf when we update to JUnit 5.8

2024-03-19 Thread Chia-Ping Tsai (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-12187. Fix Version/s: 3.8.0 Resolution: Fixed > replace assertTrue(obj instanceof X) by

[jira] [Resolved] (KAFKA-12217) Apply the new features of Junit 5.8 to code base

2024-03-19 Thread Chia-Ping Tsai (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-12217. Resolution: Fixed > Apply the new features of Junit 5.8 to code base >

[jira] [Commented] (KAFKA-16391) Cleanup .lock file after server is down

2024-03-19 Thread Chia-Ping Tsai (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17828595#comment-17828595 ] Chia-Ping Tsai commented on KAFKA-16391: [~yangpoan] pardon me, are those .lock files existent

Re: [PR] KAFKA-14589 ConsumerGroupCommand rewritten in java [kafka]

2024-03-19 Thread via GitHub
nizhikov commented on code in PR #14471: URL: https://github.com/apache/kafka/pull/14471#discussion_r1530813020 ## tools/src/test/java/org/apache/kafka/tools/consumer/group/DeleteOffsetsConsumerGroupCommandIntegrationTest.java: ## @@ -144,18 +145,18 @@ private void

Re: [PR] KAFKA-15950: Serialize broker heartbeat requests [kafka]

2024-03-19 Thread via GitHub
junrao commented on code in PR #14903: URL: https://github.com/apache/kafka/pull/14903#discussion_r1530918656 ## core/src/test/scala/unit/kafka/server/BrokerLifecycleManagerTest.scala: ## @@ -254,33 +261,38 @@ class BrokerLifecycleManagerTest { @Test def

  1   2   >