[GitHub] [kafka] dengziming commented on a diff in pull request #12669: KAFKA-14248: Fix flaky test PlaintextAdminIntegrationTest.testCreateTopicsReturnsConfigs

2022-09-27 Thread GitBox
dengziming commented on code in PR #12669: URL: https://github.com/apache/kafka/pull/12669#discussion_r981887516 ## core/src/test/scala/integration/kafka/api/PlaintextAdminIntegrationTest.scala: ## @@ -159,22 +158,6 @@ class PlaintextAdminIntegrationTest extends

[GitHub] [kafka] dengziming commented on a diff in pull request #12669: KAFKA-14248: Fix flaky test PlaintextAdminIntegrationTest.testCreateTopicsReturnsConfigs

2022-09-27 Thread GitBox
dengziming commented on code in PR #12669: URL: https://github.com/apache/kafka/pull/12669#discussion_r981881965 ## core/src/test/scala/integration/kafka/api/PlaintextAdminIntegrationTest.scala: ## @@ -159,22 +158,6 @@ class PlaintextAdminIntegrationTest extends

[jira] [Created] (KAFKA-14264) Create a coordinator class for the new implementation

2022-09-27 Thread Philip Nee (Jira)
Philip Nee created KAFKA-14264: -- Summary: Create a coordinator class for the new implementation Key: KAFKA-14264 URL: https://issues.apache.org/jira/browse/KAFKA-14264 Project: Kafka Issue

[GitHub] [kafka] philipnee commented on a diff in pull request #12672: KAFKA-14252: Consumer background thread base implementation

2022-09-27 Thread GitBox
philipnee commented on code in PR #12672: URL: https://github.com/apache/kafka/pull/12672#discussion_r981877223 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/ConsumerBackgroundThread.java: ## @@ -0,0 +1,206 @@ +/* + * Licensed to the Apache Software

[GitHub] [kafka] showuon commented on pull request #12229: MINOR: Include the inner exception stack trace when re-throwing an exception

2022-09-27 Thread GitBox
showuon commented on PR #12229: URL: https://github.com/apache/kafka/pull/12229#issuecomment-1260300450 I'm going to merge this PR this week if there's no more comments. Thanks. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[GitHub] [kafka] philipnee commented on a diff in pull request #12672: KAFKA-14252: Consumer background thread base implementation

2022-09-27 Thread GitBox
philipnee commented on code in PR #12672: URL: https://github.com/apache/kafka/pull/12672#discussion_r981876990 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/DefaultEventHandler.java: ## @@ -0,0 +1,76 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] [kafka] guozhangwang commented on a diff in pull request #12644: KAFKA-14209 : Rewrite self joins to use single state store 2/3

2022-09-27 Thread GitBox
guozhangwang commented on code in PR #12644: URL: https://github.com/apache/kafka/pull/12644#discussion_r981688919 ## streams/src/main/java/org/apache/kafka/streams/kstream/internals/graph/StreamStreamJoinNode.java: ## @@ -92,17 +96,38 @@ public void writeToTopology(final

[GitHub] [kafka] guozhangwang commented on a diff in pull request #12644: KAFKA-14209 : Rewrite self joins to use single state store 2/3

2022-09-27 Thread GitBox
guozhangwang commented on code in PR #12644: URL: https://github.com/apache/kafka/pull/12644#discussion_r981685201 ## streams/src/test/java/org/apache/kafka/streams/kstream/internals/KStreamKStreamSelfJoinTest.java: ## @@ -0,0 +1,341 @@ +/* + * Licensed to the Apache Software

[GitHub] [kafka] hachikuji commented on a diff in pull request #12634: KAFKA-14225: Fix deadlock caused by lazy val exemptSensor

2022-09-27 Thread GitBox
hachikuji commented on code in PR #12634: URL: https://github.com/apache/kafka/pull/12634#discussion_r981556802 ## core/src/main/scala/kafka/server/ClientRequestQuotaManager.scala: ## @@ -30,6 +30,9 @@ import scala.jdk.CollectionConverters._ object ClientRequestQuotaManager {

[GitHub] [kafka] hachikuji merged pull request #12691: MINOR: Small update docs/design.html grammar and typo

2022-09-27 Thread GitBox
hachikuji merged PR #12691: URL: https://github.com/apache/kafka/pull/12691 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[jira] [Created] (KAFKA-14263) Investigate flaky upgrade_test.py (missing messages)

2022-09-27 Thread David Arthur (Jira)
David Arthur created KAFKA-14263: Summary: Investigate flaky upgrade_test.py (missing messages) Key: KAFKA-14263 URL: https://issues.apache.org/jira/browse/KAFKA-14263 Project: Kafka Issue

[GitHub] [kafka] mumrah commented on pull request #12693: MINOR: Fix delegation token system test

2022-09-27 Thread GitBox
mumrah commented on PR #12693: URL: https://github.com/apache/kafka/pull/12693#issuecomment-1259885018 I applied this change to the 3.3 branch as part of the release validation, here is the system test output

[GitHub] [kafka] mumrah opened a new pull request, #12693: MINOR: Fix delegation token system test

2022-09-27 Thread GitBox
mumrah opened a new pull request, #12693: URL: https://github.com/apache/kafka/pull/12693 KIP-373 added a "token requester" field to the output of `kafka-delegation-tokens.sh`. The system test was failing since it was not expecting this new field. This patch adds support for this field and

[GitHub] [kafka] guozhangwang commented on pull request #12659: KAFKA-10199: Integrate Topology Pause/Resume with StateUpdater

2022-09-27 Thread GitBox
guozhangwang commented on PR #12659: URL: https://github.com/apache/kafka/pull/12659#issuecomment-1259877050 After discussed with @cadonna offline, we decide to first try with the simpler approach which let the state updater thread periodically check the source-of-truth topology metadata

[GitHub] [kafka] see-quick opened a new pull request, #12692: MINOR: Add test cases to the Raft module

2022-09-27 Thread GitBox
see-quick opened a new pull request, #12692: URL: https://github.com/apache/kafka/pull/12692 This PR adds a few test cases to the Raft module (i.e., VotedStateTest, ValidOffsetAndEpochTest, UnattachedStateTest, ResignedStateTest). I have also removed an un-used method (i.e.,

[GitHub] [kafka] hachikuji commented on a diff in pull request #12669: KAFKA-14248: Fix flaky test PlaintextAdminIntegrationTest.testCreateTopicsReturnsConfigs

2022-09-27 Thread GitBox
hachikuji commented on code in PR #12669: URL: https://github.com/apache/kafka/pull/12669#discussion_r981539256 ## core/src/test/scala/integration/kafka/api/PlaintextAdminIntegrationTest.scala: ## @@ -169,8 +168,7 @@ class PlaintextAdminIntegrationTest extends

[GitHub] [kafka] divijvaidya commented on pull request #12229: MINOR: Include the inner exception stack trace when re-throwing an exception

2022-09-27 Thread GitBox
divijvaidya commented on PR #12229: URL: https://github.com/apache/kafka/pull/12229#issuecomment-1259755885 Rebased with the latest `trunk` to resolve merge conflicts. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

[GitHub] [kafka] divijvaidya commented on pull request #12590: KAFKA-7109: Close fetch sessions on close of consumer

2022-09-27 Thread GitBox
divijvaidya commented on PR #12590: URL: https://github.com/apache/kafka/pull/12590#issuecomment-1259748550 @dajac this is ready for your review, whenever you get a chance -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [kafka] divijvaidya commented on pull request #12465: KAFKA-12950: Replace EasyMock and PowerMock with Mockito for KafkaStreamsTest

2022-09-27 Thread GitBox
divijvaidya commented on PR #12465: URL: https://github.com/apache/kafka/pull/12465#issuecomment-1259747104 @cadonna this is ready for your review whenever you get a chance. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [kafka] hachikuji commented on a diff in pull request #12682: MINOR: Add section on listener configuration (including kraft) to security docs

2022-09-27 Thread GitBox
hachikuji commented on code in PR #12682: URL: https://github.com/apache/kafka/pull/12682#discussion_r981453929 ## docs/security.html: ## @@ -36,7 +36,136 @@ 7.2 Encryption and Authentication using SSL +7.2 Listener Configuration + +In order to secure a Kafka cluster,

[jira] [Commented] (KAFKA-14250) Exception during normal operation in MirrorSourceTask causes the task to fail instead of shutting down gracefully

2022-09-27 Thread Chris Egerton (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17610141#comment-17610141 ] Chris Egerton commented on KAFKA-14250: --- [~viktorsomogyi] can you confirm which version the

[GitHub] [kafka] C0urante commented on pull request #12671: KAFKA-14250: MirrorSourceTask exception causes the task to fail

2022-09-27 Thread GitBox
C0urante commented on PR #12671: URL: https://github.com/apache/kafka/pull/12671#issuecomment-1259704922 This kind of failure shouldn't propagate beyond rebalances; we don't take task status (running vs. failed vs. unassigned) into account after rebalances when starting/restarting tasks.

[GitHub] [kafka] viktorsomogyi commented on pull request #12671: KAFKA-14250: MirrorSourceTask exception causes the task to fail

2022-09-27 Thread GitBox
viktorsomogyi commented on PR #12671: URL: https://github.com/apache/kafka/pull/12671#issuecomment-1259701968 @C0urante this problem arises when `stop` is called really fast, right after calling `start` when that is still running. I've attached a log sample to the case but the exception

[GitHub] [kafka] vpapavas commented on a diff in pull request #12644: KAFKA-14209 : Rewrite self joins to use single state store 2/3

2022-09-27 Thread GitBox
vpapavas commented on code in PR #12644: URL: https://github.com/apache/kafka/pull/12644#discussion_r981415910 ## streams/src/main/java/org/apache/kafka/streams/kstream/internals/graph/StreamStreamJoinNode.java: ## @@ -92,17 +96,38 @@ public void writeToTopology(final

[jira] [Updated] (KAFKA-14250) Exception during normal operation in MirrorSourceTask causes the task to fail instead of shutting down gracefully

2022-09-27 Thread Viktor Somogyi-Vass (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Viktor Somogyi-Vass updated KAFKA-14250: Attachment: mm2.log > Exception during normal operation in MirrorSourceTask

[GitHub] [kafka] mimaison merged pull request #12689: MINOR: Improve unit test coverage of LeaderAndIsr class

2022-09-27 Thread GitBox
mimaison merged PR #12689: URL: https://github.com/apache/kafka/pull/12689 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[jira] [Assigned] (KAFKA-13187) Replace EasyMock and PowerMock with Mockito for DistributedHerderTest

2022-09-27 Thread Chris Egerton (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Egerton reassigned KAFKA-13187: - Assignee: Matthew de Detrich (was: Chris Egerton) > Replace EasyMock and PowerMock

[GitHub] [kafka] C0urante commented on pull request #11792: Replace EasyMock/PowerMock with Mockito in DistributedHerderTest

2022-09-27 Thread GitBox
C0urante commented on PR #11792: URL: https://github.com/apache/kafka/pull/11792#issuecomment-1259559178 @mdedetrich Great, thanks! I've assigned [KAFKA-13187](https://issues.apache.org/jira/browse/KAFKA-13187) to you to let others know that the ticket is being worked on. If you need to

[jira] [Assigned] (KAFKA-13187) Replace EasyMock and PowerMock with Mockito for DistributedHerderTest

2022-09-27 Thread Chris Egerton (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Egerton reassigned KAFKA-13187: - Assignee: Chris Egerton (was: Dalibor Plavcic) > Replace EasyMock and PowerMock with

[GitHub] [kafka] C0urante commented on pull request #11792: Replace EasyMock/PowerMock with Mockito in DistributedHerderTest

2022-09-27 Thread GitBox
C0urante commented on PR #11792: URL: https://github.com/apache/kafka/pull/11792#issuecomment-1259557319 @divijvaidya I've also used the `OngoingStubbing` class to set up multiple expectations for a mock at once. I'm not sure if it's applicable to your case, but I found that it wasn't too

[jira] [Commented] (KAFKA-14063) CVE-2022-34917: Kafka message parsing can cause ooms with small antagonistic payloads

2022-09-27 Thread Manikumar (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17610078#comment-17610078 ] Manikumar commented on KAFKA-14063: --- There wont be official PR.  Yes, you can pickup the commit from

[GitHub] [kafka] ijuma commented on pull request #12674: KAFKA-14255: Fetching from follower should be disallowed if fetch from follower is disabled

2022-09-27 Thread GitBox
ijuma commented on PR #12674: URL: https://github.com/apache/kafka/pull/12674#issuecomment-1259463709 We could document that fetch from follower must first be enabled on the cluster before it's enabled on the client _if_ KIP-320 is not supported by the client. -- This is an automated

[GitHub] [kafka] zigarn commented on pull request #12175: KAFKA-14146: Config file option for MessageReader/MessageFormatter in ConsoleProducer/ConsoleConsumer (KIP-840)

2022-09-27 Thread GitBox
zigarn commented on PR #12175: URL: https://github.com/apache/kafka/pull/12175#issuecomment-1259448130 @dajac: thanks for your review, I did most of the proposed fixes. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

[GitHub] [kafka] urbandan commented on pull request #12392: KAFKA-14053: Transactional producer should bump the epoch and skip ab…

2022-09-27 Thread GitBox
urbandan commented on PR #12392: URL: https://github.com/apache/kafka/pull/12392#issuecomment-1259383078 @dajac @hachikuji Any chance you can take a look at this? This is a painful issue in transactional producers, with some serious consequences (partition corruption). -- This is an

[GitHub] [kafka] dajac commented on pull request #12674: KAFKA-14255: Fetching from follower should be disallowed if fetch from follower is disabled

2022-09-27 Thread GitBox
dajac commented on PR #12674: URL: https://github.com/apache/kafka/pull/12674#issuecomment-1259370231 @hachikuji Yeah, that's right. If a client already specifies the rack id before the cluster sets up a replica selector, the client won't be able to fetch until all the brokers have the

[GitHub] [kafka] blcksrx commented on pull request #12400: KAFKA-13648: KRaft ClusterInstance does not allow for deferred start

2022-09-27 Thread GitBox
blcksrx commented on PR #12400: URL: https://github.com/apache/kafka/pull/12400#issuecomment-1259349410 Just checking what is the status of this PR -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [kafka] mdedetrich commented on pull request #11792: Replace EasyMock/PowerMock with Mockito in DistributedHerderTest

2022-09-27 Thread GitBox
mdedetrich commented on PR #11792: URL: https://github.com/apache/kafka/pull/11792#issuecomment-1259331955 I will start looking into it to see how I can help -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [kafka] see-quick commented on a diff in pull request #12689: MINOR: Improve unit test coverage of LeaderAndIsr class

2022-09-27 Thread GitBox
see-quick commented on code in PR #12689: URL: https://github.com/apache/kafka/pull/12689#discussion_r981009538 ## core/src/test/scala/kafka/api/LeaderAndIsrTest.scala: ## @@ -31,4 +31,56 @@ final class LeaderAndIsrTest { assertEquals(List(3), recoveringLeaderAndIsr.isr)

[jira] [Created] (KAFKA-14262) Delete MirrorMaker v1

2022-09-27 Thread Mickael Maison (Jira)
Mickael Maison created KAFKA-14262: -- Summary: Delete MirrorMaker v1 Key: KAFKA-14262 URL: https://issues.apache.org/jira/browse/KAFKA-14262 Project: Kafka Issue Type: Task

[GitHub] [kafka] divijvaidya commented on pull request #12684: KAFKA-14254; Format timestamps as dates in logs

2022-09-27 Thread GitBox
divijvaidya commented on PR #12684: URL: https://github.com/apache/kafka/pull/12684#issuecomment-1259199080 1. (Calling this out for completeness sake) `Instant.ofEpochMilli` is slower than existing solution but it is worth making this change for the sake of readability of logs. It will

[GitHub] [kafka] divijvaidya commented on a diff in pull request #12689: MINOR: Improve unit test coverage of LeaderAndIsr class

2022-09-27 Thread GitBox
divijvaidya commented on code in PR #12689: URL: https://github.com/apache/kafka/pull/12689#discussion_r980910425 ## core/src/test/scala/kafka/api/LeaderAndIsrTest.scala: ## @@ -31,4 +31,56 @@ final class LeaderAndIsrTest { assertEquals(List(3), recoveringLeaderAndIsr.isr)

[GitHub] [kafka] divijvaidya commented on pull request #12669: KAFKA-14248: Fix flaky test PlaintextAdminIntegrationTest.testCreateTopicsReturnsConfigs

2022-09-27 Thread GitBox
divijvaidya commented on PR #12669: URL: https://github.com/apache/kafka/pull/12669#issuecomment-1259136260 @hachikuji this is ready for your review. The test failures are unrelated: ``` Build / JDK 8 and Scala 2.12 / testTransactionAfterProducerIdExpires(String).quorum=zk –