[GitHub] [kafka] RivenSun2 commented on a change in pull request #11940: KAFKA-13689: optimize the log output of logUnused method

2022-03-23 Thread GitBox
RivenSun2 commented on a change in pull request #11940: URL: https://github.com/apache/kafka/pull/11940#discussion_r833923860 ## File path: clients/src/main/java/org/apache/kafka/clients/producer/KafkaProducer.java ## @@ -530,6 +530,9 @@ private TransactionManager

[GitHub] [kafka] guozhangwang commented on a change in pull request #11940: KAFKA-13689: optimize the log output of logUnused method

2022-03-23 Thread GitBox
guozhangwang commented on a change in pull request #11940: URL: https://github.com/apache/kafka/pull/11940#discussion_r833912567 ## File path: clients/src/main/java/org/apache/kafka/clients/producer/KafkaProducer.java ## @@ -530,6 +530,9 @@ private TransactionManager

[GitHub] [kafka] vamossagar12 commented on a change in pull request #11433: KAFKA-13295: Avoiding Transation timeouts arising due to long restora…

2022-03-23 Thread GitBox
vamossagar12 commented on a change in pull request #11433: URL: https://github.com/apache/kafka/pull/11433#discussion_r833912049 ## File path: streams/src/main/java/org/apache/kafka/streams/processor/internals/TaskManager.java ## @@ -262,6 +262,42 @@ private void

[GitHub] [kafka] vamossagar12 commented on a change in pull request #11433: KAFKA-13295: Avoiding Transation timeouts arising due to long restora…

2022-03-23 Thread GitBox
vamossagar12 commented on a change in pull request #11433: URL: https://github.com/apache/kafka/pull/11433#discussion_r833912049 ## File path: streams/src/main/java/org/apache/kafka/streams/processor/internals/TaskManager.java ## @@ -262,6 +262,42 @@ private void

[GitHub] [kafka] RivenSun2 commented on pull request #11940: KAFKA-13689: optimize the log output of logUnused method

2022-03-23 Thread GitBox
RivenSun2 commented on pull request #11940: URL: https://github.com/apache/kafka/pull/11940#issuecomment-1077069535 @guozhangwang Of course, I briefly sort out where KafkaClient calls `AbstractConfig.getBoolean` method. Only the `KafkaProducer.configureTransactionState` method needs

[jira] [Resolved] (KAFKA-13672) Race condition in DynamicBrokerConfig

2022-03-23 Thread Luke Chen (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Chen resolved KAFKA-13672. --- Fix Version/s: 3.3.0 Resolution: Fixed > Race condition in DynamicBrokerConfig >

[GitHub] [kafka] showuon commented on pull request #11920: KAFKA-13672: Race condition in DynamicBrokerConfig

2022-03-23 Thread GitBox
showuon commented on pull request #11920: URL: https://github.com/apache/kafka/pull/11920#issuecomment-1077046585 @cadonna , also cherry-pick back to 3.2 branch. Thanks. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[jira] [Commented] (KAFKA-13542) Utilize the new Consumer#enforceRebalance(reason) API in Streams

2022-03-23 Thread Hao Li (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17511577#comment-17511577 ] Hao Li commented on KAFKA-13542: [~mjsax] , [~cadonna] , I haven't got time to figure out why this

[GitHub] [kafka] showuon merged pull request #11920: KAFKA-13672: Race condition in DynamicBrokerConfig

2022-03-23 Thread GitBox
showuon merged pull request #11920: URL: https://github.com/apache/kafka/pull/11920 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[jira] [Commented] (KAFKA-9826) Log cleaning repeatedly picks same segment with no effect when first dirty offset is past start of active segment

2022-03-23 Thread zhangzhisheng (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17511576#comment-17511576 ] zhangzhisheng commented on KAFKA-9826: -- [~junrao]  kafka version from 2.4.1 to 2.8.1,the issue has

[GitHub] [kafka] showuon commented on pull request #11920: KAFKA-13672: Race condition in DynamicBrokerConfig

2022-03-23 Thread GitBox
showuon commented on pull request #11920: URL: https://github.com/apache/kafka/pull/11920#issuecomment-1077041046 Failed tests are unrelated. ``` Build / JDK 11 and Scala 2.13 / org.apache.kafka.streams.integration.PurgeRepartitionTopicIntegrationTest.shouldRestoreState

[GitHub] [kafka] showuon commented on pull request #10367: KAFKA-12495: allow consecutive revoke in incremental cooperative assignor in connector

2022-03-23 Thread GitBox
showuon commented on pull request #10367: URL: https://github.com/apache/kafka/pull/10367#issuecomment-1077035346 @C0urante , sure, please file another PR for other comments. And thanks for the comments. However, I'm still concerned that @kkonstantine doesn't like the current solution,

[jira] [Resolved] (KAFKA-13714) Flaky test IQv2StoreIntegrationTest

2022-03-23 Thread John Roesler (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Roesler resolved KAFKA-13714. -- Fix Version/s: 3.2.0 Assignee: John Roesler Resolution: Fixed > Flaky test

[GitHub] [kafka] vvcephei commented on pull request #11926: KAFKA-13714: Fix cache flush position

2022-03-23 Thread GitBox
vvcephei commented on pull request #11926: URL: https://github.com/apache/kafka/pull/11926#issuecomment-1077034307 Cherry-picked to 3.2 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [kafka] guozhangwang commented on pull request #11940: KAFKA-13689: optimize the log output of logUnused method

2022-03-23 Thread GitBox
guozhangwang commented on pull request #11940: URL: https://github.com/apache/kafka/pull/11940#issuecomment-1077031424 Hi @RivenSun2 I think we also want to call `ignore` when certain producer feature is disabled as well? -- This is an automated message from the Apache Git Service. To

[GitHub] [kafka] showuon commented on a change in pull request #11936: MINOR: Fix an incompatible bug in GetOffsetShell

2022-03-23 Thread GitBox
showuon commented on a change in pull request #11936: URL: https://github.com/apache/kafka/pull/11936#discussion_r833881280 ## File path: core/src/test/scala/kafka/tools/GetOffsetShellTest.scala ## @@ -166,6 +166,13 @@ class GetOffsetShellTest extends KafkaServerTestHarness

[GitHub] [kafka] showuon commented on a change in pull request #11936: MINOR: Fix an incompatible bug in GetOffsetShell

2022-03-23 Thread GitBox
showuon commented on a change in pull request #11936: URL: https://github.com/apache/kafka/pull/11936#discussion_r833881280 ## File path: core/src/test/scala/kafka/tools/GetOffsetShellTest.scala ## @@ -166,6 +166,13 @@ class GetOffsetShellTest extends KafkaServerTestHarness

[GitHub] [kafka] vvcephei merged pull request #11926: KAFKA-13714: Fix cache flush position

2022-03-23 Thread GitBox
vvcephei merged pull request #11926: URL: https://github.com/apache/kafka/pull/11926 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [kafka] vvcephei commented on pull request #11926: KAFKA-13714: Fix cache flush position

2022-03-23 Thread GitBox
vvcephei commented on pull request #11926: URL: https://github.com/apache/kafka/pull/11926#issuecomment-1077021766 Test failures unrelated: ``` Build / JDK 8 and Scala 2.12 / org.apache.kafka.common.network.SslTransportLayerTest.[1] tlsProtocol=TLSv1.2,

[GitHub] [kafka] showuon commented on a change in pull request #11433: KAFKA-13295: Avoiding Transation timeouts arising due to long restora…

2022-03-23 Thread GitBox
showuon commented on a change in pull request #11433: URL: https://github.com/apache/kafka/pull/11433#discussion_r833872517 ## File path: streams/src/main/java/org/apache/kafka/streams/processor/internals/TaskManager.java ## @@ -262,6 +262,42 @@ private void

[GitHub] [kafka] showuon commented on a change in pull request #11433: KAFKA-13295: Avoiding Transation timeouts arising due to long restora…

2022-03-23 Thread GitBox
showuon commented on a change in pull request #11433: URL: https://github.com/apache/kafka/pull/11433#discussion_r833872517 ## File path: streams/src/main/java/org/apache/kafka/streams/processor/internals/TaskManager.java ## @@ -262,6 +262,42 @@ private void

[jira] [Commented] (KAFKA-9366) Upgrade log4j to log4j2

2022-03-23 Thread Luke Chen (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17511547#comment-17511547 ] Luke Chen commented on KAFKA-9366: -- [~brandonk]  and all, we are aware of the log4j CVE issue is

[jira] [Commented] (KAFKA-13765) Describe-consumer admin should not return unstable membership information

2022-03-23 Thread Ryan Leslie (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17511546#comment-17511546 ] Ryan Leslie commented on KAFKA-13765: - [~guozhang] Are you referring to

[jira] [Commented] (KAFKA-13542) Utilize the new Consumer#enforceRebalance(reason) API in Streams

2022-03-23 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17511537#comment-17511537 ] Matthias J. Sax commented on KAFKA-13542: - Curious: did we figure out why the patch resulted in

[jira] [Commented] (KAFKA-13766) Use `max.poll.interval.ms` as the timeout during complete-rebalance phase

2022-03-23 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17511534#comment-17511534 ] Guozhang Wang commented on KAFKA-13766: --- cc [~dajac] > Use `max.poll.interval.ms` as the timeout

[jira] [Created] (KAFKA-13766) Use `max.poll.interval.ms` as the timeout during complete-rebalance phase

2022-03-23 Thread Guozhang Wang (Jira)
Guozhang Wang created KAFKA-13766: - Summary: Use `max.poll.interval.ms` as the timeout during complete-rebalance phase Key: KAFKA-13766 URL: https://issues.apache.org/jira/browse/KAFKA-13766 Project:

[jira] [Commented] (KAFKA-13689) AbstractConfig log print information is incorrect

2022-03-23 Thread RivenSun (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17511533#comment-17511533 ] RivenSun commented on KAFKA-13689: -- [~guozhang] Thank you for your reply. I will create a PR(11940) to

[GitHub] [kafka] RivenSun2 commented on pull request #11940: KAFKA-13689: optimize the log output of logUnused method

2022-03-23 Thread GitBox
RivenSun2 commented on pull request #11940: URL: https://github.com/apache/kafka/pull/11940#issuecomment-1076963317 Hi @guozhangwang please help to review PR when available. Thanks. -- This is an automated message from the Apache Git Service. To respond to the message, please log

[GitHub] [kafka] RivenSun2 opened a new pull request #11940: KAFKA-13689: optimize the log output of logUnused method

2022-03-23 Thread GitBox
RivenSun2 opened a new pull request #11940: URL: https://github.com/apache/kafka/pull/11940 optimize the log output of logUnused method. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[jira] [Created] (KAFKA-13765) Describe-consumer admin should not return unstable membership information

2022-03-23 Thread Guozhang Wang (Jira)
Guozhang Wang created KAFKA-13765: - Summary: Describe-consumer admin should not return unstable membership information Key: KAFKA-13765 URL: https://issues.apache.org/jira/browse/KAFKA-13765 Project:

[GitHub] [kafka] kkonstantine commented on pull request #11908: KAFKA-13748: Do not include file stream connectors in Connect's CLASSPATH and plugin.path by default

2022-03-23 Thread GitBox
kkonstantine commented on pull request #11908: URL: https://github.com/apache/kafka/pull/11908#issuecomment-1076948497 I rebased to get the changes from https://github.com/apache/kafka/pull/11933 and get a green run of system tests -- This is an automated message from the Apache Git

[GitHub] [kafka] kkonstantine commented on a change in pull request #11908: KAFKA-13748: Do not include file stream connectors in Connect's CLASSPATH and plugin.path by default

2022-03-23 Thread GitBox
kkonstantine commented on a change in pull request #11908: URL: https://github.com/apache/kafka/pull/11908#discussion_r833823045 ## File path: docs/connect.html ## @@ -74,6 +74,7 @@ Running Kafka Connectconfig.storage.topic (default connect-configs) - topic to use for

[jira] [Commented] (KAFKA-13689) AbstractConfig log print information is incorrect

2022-03-23 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17511522#comment-17511522 ] Guozhang Wang commented on KAFKA-13689: --- Hi [~RivenSun] I think I agree with you on the general

[GitHub] [kafka] kkonstantine commented on pull request #11933: KAFKA-13759: Disable idempotence by default in producers instantiated by Connect

2022-03-23 Thread GitBox
kkonstantine commented on pull request #11933: URL: https://github.com/apache/kafka/pull/11933#issuecomment-1076884660 Thanks @rhauch. The fix has now been merged to trunk and cherry picked to 3.2, 3.1 and 3.0 with the appropriate adjustments to the upgrade notes. cc @cadonna @tombentley

[jira] [Resolved] (KAFKA-13759) Disable producer idempotence by default in producers instantiated by Connect

2022-03-23 Thread Konstantine Karantasis (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantine Karantasis resolved KAFKA-13759. Resolution: Fixed > Disable producer idempotence by default in producers

[jira] [Commented] (KAFKA-13759) Disable producer idempotence by default in producers instantiated by Connect

2022-03-23 Thread Konstantine Karantasis (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13759?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17511516#comment-17511516 ] Konstantine Karantasis commented on KAFKA-13759: This issue has been now been merged on

[jira] [Updated] (KAFKA-13759) Disable producer idempotence by default in producers instantiated by Connect

2022-03-23 Thread Konstantine Karantasis (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantine Karantasis updated KAFKA-13759: --- Description: https://issues.apache.org/jira/browse/KAFKA-7077 was merged

[jira] [Updated] (KAFKA-13759) Disable producer idempotence by default in producers instantiated by Connect

2022-03-23 Thread Konstantine Karantasis (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantine Karantasis updated KAFKA-13759: --- Fix Version/s: 3.2.0 3.1.1 3.0.2 >

[jira] [Updated] (KAFKA-13759) Disable producer idempotence by default in producers instantiated by Connect

2022-03-23 Thread Konstantine Karantasis (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantine Karantasis updated KAFKA-13759: --- Summary: Disable producer idempotence by default in producers instantiated

[GitHub] [kafka] kkonstantine merged pull request #11933: KAFKA-13759: Disable idempotence by default in producers instantiated by Connect

2022-03-23 Thread GitBox
kkonstantine merged pull request #11933: URL: https://github.com/apache/kafka/pull/11933 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[jira] [Updated] (KAFKA-13763) Improve unit testing coverage for IncrementalCooperativeAssignor

2022-03-23 Thread Chris Egerton (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Egerton updated KAFKA-13763: -- Description: The

[GitHub] [kafka] ijuma commented on a change in pull request #11938: MINOR: Clarify how to publish specific projects to the local repo

2022-03-23 Thread GitBox
ijuma commented on a change in pull request #11938: URL: https://github.com/apache/kafka/pull/11938#discussion_r833746787 ## File path: README.md ## @@ -180,15 +180,21 @@ Please note for this to work you should create/update user maven settings (typic ... -###

[jira] [Commented] (KAFKA-13764) Potential improvements for Connect incremental rebalancing logic

2022-03-23 Thread Chris Egerton (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17511504#comment-17511504 ] Chris Egerton commented on KAFKA-13764: --- Discussed earlier during review of 

[jira] [Created] (KAFKA-13764) Potential improvements for Connect incremental rebalancing logic

2022-03-23 Thread Chris Egerton (Jira)
Chris Egerton created KAFKA-13764: - Summary: Potential improvements for Connect incremental rebalancing logic Key: KAFKA-13764 URL: https://issues.apache.org/jira/browse/KAFKA-13764 Project: Kafka

[jira] [Commented] (KAFKA-13763) Improve unit testing coverage for IncrementalCooperativeAssignor

2022-03-23 Thread Chris Egerton (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17511497#comment-17511497 ] Chris Egerton commented on KAFKA-13763: --- Discussed earlier during review of

[jira] [Created] (KAFKA-13763) Improve unit testing coverage for IncrementalCooperativeAssignor

2022-03-23 Thread Chris Egerton (Jira)
Chris Egerton created KAFKA-13763: - Summary: Improve unit testing coverage for IncrementalCooperativeAssignor Key: KAFKA-13763 URL: https://issues.apache.org/jira/browse/KAFKA-13763 Project: Kafka

[GitHub] [kafka] C0urante commented on a change in pull request #10367: KAFKA-12495: allow consecutive revoke in incremental cooperative assignor in connector

2022-03-23 Thread GitBox
C0urante commented on a change in pull request #10367: URL: https://github.com/apache/kafka/pull/10367#discussion_r833730613 ## File path: connect/runtime/src/test/java/org/apache/kafka/connect/runtime/distributed/IncrementalCooperativeAssignorTest.java ## @@ -180,6 +208,155

[GitHub] [kafka] C0urante commented on a change in pull request #10367: KAFKA-12495: allow consecutive revoke in incremental cooperative assignor in connector

2022-03-23 Thread GitBox
C0urante commented on a change in pull request #10367: URL: https://github.com/apache/kafka/pull/10367#discussion_r833730504 ## File path: connect/runtime/src/test/java/org/apache/kafka/connect/runtime/distributed/IncrementalCooperativeAssignorTest.java ## @@ -180,6 +208,155

[jira] [Comment Edited] (KAFKA-13404) Kafka sink connectors do not commit offset correctly if messages are produced in transaction

2022-03-23 Thread Chris Egerton (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17511487#comment-17511487 ] Chris Egerton edited comment on KAFKA-13404 at 3/23/22, 8:59 PM: - Thanks

[GitHub] [kafka] vvcephei commented on a change in pull request #11926: KAFKA-13714: Fix cache flush position

2022-03-23 Thread GitBox
vvcephei commented on a change in pull request #11926: URL: https://github.com/apache/kafka/pull/11926#discussion_r833701992 ## File path: build.gradle ## @@ -207,7 +207,7 @@ if (file('.git').exists()) { } else { rat.enabled = false } -println("Starting build with version

[jira] [Commented] (KAFKA-13404) Kafka sink connectors do not commit offset correctly if messages are produced in transaction

2022-03-23 Thread Chris Egerton (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17511487#comment-17511487 ] Chris Egerton commented on KAFKA-13404: --- Thanks [~yujhe.li]. Agreed that an ideal fix for this

[GitHub] [kafka] C0urante commented on pull request #11869: KAFKA-13719: fix connector restart cause duplicate tasks

2022-03-23 Thread GitBox
C0urante commented on pull request #11869: URL: https://github.com/apache/kafka/pull/11869#issuecomment-1076799542 @showuon @mimaison would either of you have time for this? Might be worth trying to include in the 3.2.0 release if we're still considering non-regressions. -- This is an

[GitHub] [kafka] kkonstantine commented on pull request #11933: KAFKA-13759: Disable idempotence by default in producers instantiated by Connect

2022-03-23 Thread GitBox
kkonstantine commented on pull request #11933: URL: https://github.com/apache/kafka/pull/11933#issuecomment-1076781304 Thanks @rhauch. I've incorporated your suggestions in all places. The PR is ready for another pass -- This is an automated message from the Apache Git Service. To

[GitHub] [kafka] C0urante commented on pull request #10367: KAFKA-12495: allow consecutive revoke in incremental cooperative assignor in connector

2022-03-23 Thread GitBox
C0urante commented on pull request #10367: URL: https://github.com/apache/kafka/pull/10367#issuecomment-107650 Thanks @showuon. In that case, I can file separate issues for a lot of the comments I've made here, and we can try to keep this PR as focused as possible for the sake of

[GitHub] [kafka] yyu1993 commented on a change in pull request #11939: KAFKA-13761: KafkaLog4jAppender deadlocks when idempotence is enabled

2022-03-23 Thread GitBox
yyu1993 commented on a change in pull request #11939: URL: https://github.com/apache/kafka/pull/11939#discussion_r833676286 ## File path: log4j-appender/src/main/java/org/apache/kafka/log4jappender/KafkaLog4jAppender.java ## @@ -290,6 +291,7 @@ public void activateOptions() {

[GitHub] [kafka] ijuma commented on a change in pull request #11939: KAFKA-13761: KafkaLog4jAppender deadlocks when idempotence is enabled

2022-03-23 Thread GitBox
ijuma commented on a change in pull request #11939: URL: https://github.com/apache/kafka/pull/11939#discussion_r833658737 ## File path: log4j-appender/src/main/java/org/apache/kafka/log4jappender/KafkaLog4jAppender.java ## @@ -290,6 +291,7 @@ public void activateOptions() {

[jira] [Commented] (KAFKA-13761) KafkaLog4jAppender deadlocks when idempotence is enabled

2022-03-23 Thread Yang Yu (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17511452#comment-17511452 ] Yang Yu commented on KAFKA-13761: - Hi [~ijuma] , I have a PR for disabling idemptence, could you review?

[GitHub] [kafka] rhauch commented on a change in pull request #11933: KAFKA-13759: Disable idempotence by default in producers instantiated by Connect

2022-03-23 Thread GitBox
rhauch commented on a change in pull request #11933: URL: https://github.com/apache/kafka/pull/11933#discussion_r833637529 ## File path: connect/runtime/src/main/java/org/apache/kafka/connect/runtime/Worker.java ## @@ -648,6 +648,12 @@ private WorkerTask

[jira] [Commented] (KAFKA-13758) Exclusive locking in kafka.coordinator.group.GroupMetadata.inLock(GroupMetadata.scala:227

2022-03-23 Thread Sree Vaddi (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17511447#comment-17511447 ] Sree Vaddi commented on KAFKA-13758: Work Around: - restart the broker node. ({*}tried and

[GitHub] [kafka] vvcephei merged pull request #11938: MINOR: Clarify how to publish specific projects to the local repo

2022-03-23 Thread GitBox
vvcephei merged pull request #11938: URL: https://github.com/apache/kafka/pull/11938 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [kafka] kkonstantine commented on pull request #11933: KAFKA-13759: Disable idempotence by default in producers instantiated by Connect

2022-03-23 Thread GitBox
kkonstantine commented on pull request #11933: URL: https://github.com/apache/kafka/pull/11933#issuecomment-1076612664 Tests passed on the latest run with a couple of failures that don't seem relevant. Yet, because one failure was on `SourceConnectorsIntegrationTest` I'm rerunning these

[GitHub] [kafka] yyu1993 opened a new pull request #11939: KAFKA-13761: KafkaLog4jAppender deadlocks when idempotence is enabled

2022-03-23 Thread GitBox
yyu1993 opened a new pull request #11939: URL: https://github.com/apache/kafka/pull/11939 When a log entry is appended to a Kafka topic using KafkaLog4jAppender, the producer.send operation may hit a deadlock if the producer network thread also tries to append a log at the same log level.

[jira] [Commented] (KAFKA-13761) KafkaLog4jAppender deadlocks when idempotence is enabled

2022-03-23 Thread Ismael Juma (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17511372#comment-17511372 ] Ismael Juma commented on KAFKA-13761: - I suggest we do the simplest change first (disable

[GitHub] [kafka] vvcephei opened a new pull request #11938: MINOR: Clarify how to publish specific projects to the local repo

2022-03-23 Thread GitBox
vvcephei opened a new pull request #11938: URL: https://github.com/apache/kafka/pull/11938 The current README instruction for local publishing boils the ocean by building and installing every jar in the project with both 2.12 and 2.13. While that is some times what people want to do, they

[jira] [Commented] (KAFKA-13761) KafkaLog4jAppender deadlocks when idempotence is enabled

2022-03-23 Thread Dongjin Lee (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17511283#comment-17511283 ] Dongjin Lee commented on KAFKA-13761: - Hi [~yyu1993] [~showuon], It seems like this issue is a

[GitHub] [kafka] dongjinleekr commented on pull request #7898: KAFKA-9366: Change log4j dependency into log4j2

2022-03-23 Thread GitBox
dongjinleekr commented on pull request #7898: URL: https://github.com/apache/kafka/pull/7898#issuecomment-1076403226 Rebased onto the latest trunk. cc/ @edoardocomar -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

[jira] [Commented] (KAFKA-9366) Upgrade log4j to log4j2

2022-03-23 Thread Brandon Kimbrough (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17511262#comment-17511262 ] Brandon Kimbrough commented on KAFKA-9366: -- [~cadonna] did I really just see that you kicked

[GitHub] [kafka] dengziming commented on pull request #11937: MINOR: A few cleanups in BrokerToControllerChannelManager

2022-03-23 Thread GitBox
dengziming commented on pull request #11937: URL: https://github.com/apache/kafka/pull/11937#issuecomment-1076372788 Maybe we can use the file in checkstyle/checkstyle.xml to force scala code style, but this is a big change and should be done with the approval of at least 3 PMC members. 樂

[GitHub] [kafka] dengziming commented on pull request #11936: MINOR: Fix an incompatible bug in GetOffsetShell

2022-03-23 Thread GitBox
dengziming commented on pull request #11936: URL: https://github.com/apache/kafka/pull/11936#issuecomment-1076366161 > Is this related to the failure we saw here Sadly not, the [failure](

[GitHub] [kafka] showuon commented on pull request #11923: KAFKA-6718 / Documentation

2022-03-23 Thread GitBox
showuon commented on pull request #11923: URL: https://github.com/apache/kafka/pull/11923#issuecomment-1076362860 cc @cadonna , do you want to have another look? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[jira] [Commented] (KAFKA-13761) KafkaLog4jAppender deadlocks when idempotence is enabled

2022-03-23 Thread Luke Chen (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17511246#comment-17511246 ] Luke Chen commented on KAFKA-13761: --- [~ijuma] , I agree. And we should further throw exception to note

[jira] [Commented] (KAFKA-13761) KafkaLog4jAppender deadlocks when idempotence is enabled

2022-03-23 Thread Ismael Juma (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17511236#comment-17511236 ] Ismael Juma commented on KAFKA-13761: - I think we probably want to disable idempotence for the log4j

[GitHub] [kafka] cadonna commented on pull request #11920: KAFKA-13672: Race condition in DynamicBrokerConfig

2022-03-23 Thread GitBox
cadonna commented on pull request #11920: URL: https://github.com/apache/kafka/pull/11920#issuecomment-1076319050 @dajac @showuon: Once this PR is merged, could one of you cherry-pick it to the 3.2 branch? -- This is an automated message from the Apache Git Service. To respond to the

[jira] [Commented] (KAFKA-13542) Utilize the new Consumer#enforceRebalance(reason) API in Streams

2022-03-23 Thread Bruno Cadonna (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17511223#comment-17511223 ] Bruno Cadonna commented on KAFKA-13542: --- [~lihaosky] and [~ableegoldman] do you plan to fix this

[jira] [Commented] (KAFKA-8575) Investigate removing EAGER protocol & cleaning up task suspension in Streams rebalancing

2022-03-23 Thread Bruno Cadonna (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-8575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17511220#comment-17511220 ] Bruno Cadonna commented on KAFKA-8575: -- [~ableegoldman] Is this still a blocker for AK 3.2? >

[jira] [Updated] (KAFKA-13762) Kafka brokers are not coming up

2022-03-23 Thread Kamesh (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kamesh updated KAFKA-13762: --- Description: Out of 9 brokers only 3 brokers coming up. Totally 3 VMs Each VM is having 3 brokers We are

[jira] [Created] (KAFKA-13762) Kafka brokers are not coming up

2022-03-23 Thread Kamesh (Jira)
Kamesh created KAFKA-13762: -- Summary: Kafka brokers are not coming up Key: KAFKA-13762 URL: https://issues.apache.org/jira/browse/KAFKA-13762 Project: Kafka Issue Type: Bug Reporter:

[jira] [Updated] (KAFKA-12399) Deprecate Log4J Appender

2022-03-23 Thread Bruno Cadonna (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruno Cadonna updated KAFKA-12399: -- Fix Version/s: 3.3.0 (was: 3.2.0) > Deprecate Log4J Appender >

[jira] [Updated] (KAFKA-9366) Upgrade log4j to log4j2

2022-03-23 Thread Bruno Cadonna (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruno Cadonna updated KAFKA-9366: - Fix Version/s: 3.3.0 (was: 3.2.0) > Upgrade log4j to log4j2 >

[GitHub] [kafka] LiamClarkeNZ commented on a change in pull request #11920: KAFKA-13672: Race condition in DynamicBrokerConfig

2022-03-23 Thread GitBox
LiamClarkeNZ commented on a change in pull request #11920: URL: https://github.com/apache/kafka/pull/11920#discussion_r833158538 ## File path: core/src/main/scala/kafka/server/DynamicBrokerConfig.scala ## @@ -535,24 +539,24 @@ class DynamicBrokerConfig(private val kafkaConfig:

[GitHub] [kafka] LiamClarkeNZ commented on a change in pull request #11920: KAFKA-13672: Race condition in DynamicBrokerConfig

2022-03-23 Thread GitBox
LiamClarkeNZ commented on a change in pull request #11920: URL: https://github.com/apache/kafka/pull/11920#discussion_r833158352 ## File path: core/src/main/scala/kafka/server/DynamicBrokerConfig.scala ## @@ -35,6 +35,7 @@ import org.apache.kafka.common.network.{ListenerName,

[GitHub] [kafka] LiamClarkeNZ commented on a change in pull request #11920: KAFKA-13672: Race condition in DynamicBrokerConfig

2022-03-23 Thread GitBox
LiamClarkeNZ commented on a change in pull request #11920: URL: https://github.com/apache/kafka/pull/11920#discussion_r833158112 ## File path: core/src/main/scala/kafka/server/DynamicBrokerConfig.scala ## @@ -201,8 +202,11 @@ class DynamicBrokerConfig(private val kafkaConfig:

[GitHub] [kafka] cadonna commented on a change in pull request #11760: KAFKA-13600: Kafka Streams - Fall back to most caught up client if no caught up clients exist

2022-03-23 Thread GitBox
cadonna commented on a change in pull request #11760: URL: https://github.com/apache/kafka/pull/11760#discussion_r833117940 ## File path: streams/src/main/java/org/apache/kafka/streams/processor/internals/assignment/TaskMovement.java ## @@ -102,45 +108,27 @@ static int

[GitHub] [kafka] dajac commented on a change in pull request #11920: KAFKA-13672 Race condition in DynamicBrokerConfig

2022-03-23 Thread GitBox
dajac commented on a change in pull request #11920: URL: https://github.com/apache/kafka/pull/11920#discussion_r833118468 ## File path: core/src/main/scala/kafka/server/DynamicBrokerConfig.scala ## @@ -35,6 +35,7 @@ import org.apache.kafka.common.network.{ListenerName,

[GitHub] [kafka] dajac opened a new pull request #11937: MINOR: A few cleanups in BrokerToControllerChannelManager

2022-03-23 Thread GitBox
dajac opened a new pull request #11937: URL: https://github.com/apache/kafka/pull/11937 I made a few edits to make the code style more consistent while reading that file. ### Committer Checklist (excluded from commit message) - [ ] Verify design and implementation - [ ]

[GitHub] [kafka] LiamClarkeNZ commented on a change in pull request #11920: KAFKA-13672 Race condition in DynamicBrokerConfig

2022-03-23 Thread GitBox
LiamClarkeNZ commented on a change in pull request #11920: URL: https://github.com/apache/kafka/pull/11920#discussion_r833094619 ## File path: core/src/main/scala/kafka/server/DynamicBrokerConfig.scala ## @@ -201,7 +202,9 @@ class DynamicBrokerConfig(private val kafkaConfig:

[GitHub] [kafka] LiamClarkeNZ commented on a change in pull request #11920: KAFKA-13672 Race condition in DynamicBrokerConfig

2022-03-23 Thread GitBox
LiamClarkeNZ commented on a change in pull request #11920: URL: https://github.com/apache/kafka/pull/11920#discussion_r833089404 ## File path: core/src/main/scala/kafka/server/DynamicBrokerConfig.scala ## @@ -535,8 +538,8 @@ class DynamicBrokerConfig(private val kafkaConfig:

[GitHub] [kafka] LiamClarkeNZ commented on a change in pull request #11920: KAFKA-13672 Race condition in DynamicBrokerConfig

2022-03-23 Thread GitBox
LiamClarkeNZ commented on a change in pull request #11920: URL: https://github.com/apache/kafka/pull/11920#discussion_r833080985 ## File path: core/src/main/scala/kafka/server/DynamicBrokerConfig.scala ## @@ -201,7 +202,9 @@ class DynamicBrokerConfig(private val kafkaConfig:

[GitHub] [kafka] LiamClarkeNZ commented on a change in pull request #11920: KAFKA-13672 Race condition in DynamicBrokerConfig

2022-03-23 Thread GitBox
LiamClarkeNZ commented on a change in pull request #11920: URL: https://github.com/apache/kafka/pull/11920#discussion_r833080985 ## File path: core/src/main/scala/kafka/server/DynamicBrokerConfig.scala ## @@ -201,7 +202,9 @@ class DynamicBrokerConfig(private val kafkaConfig:

[GitHub] [kafka] LiamClarkeNZ commented on a change in pull request #11920: KAFKA-13672 Race condition in DynamicBrokerConfig

2022-03-23 Thread GitBox
LiamClarkeNZ commented on a change in pull request #11920: URL: https://github.com/apache/kafka/pull/11920#discussion_r833080985 ## File path: core/src/main/scala/kafka/server/DynamicBrokerConfig.scala ## @@ -201,7 +202,9 @@ class DynamicBrokerConfig(private val kafkaConfig:

[GitHub] [kafka] LiamClarkeNZ commented on a change in pull request #11920: KAFKA-13672 Race condition in DynamicBrokerConfig

2022-03-23 Thread GitBox
LiamClarkeNZ commented on a change in pull request #11920: URL: https://github.com/apache/kafka/pull/11920#discussion_r833080985 ## File path: core/src/main/scala/kafka/server/DynamicBrokerConfig.scala ## @@ -201,7 +202,9 @@ class DynamicBrokerConfig(private val kafkaConfig:

[jira] [Comment Edited] (KAFKA-13689) AbstractConfig log print information is incorrect

2022-03-23 Thread RivenSun (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17511136#comment-17511136 ] RivenSun edited comment on KAFKA-13689 at 3/23/22, 10:04 AM: - Hi [~guozhang] 

[jira] [Comment Edited] (KAFKA-13689) AbstractConfig log print information is incorrect

2022-03-23 Thread RivenSun (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17511136#comment-17511136 ] RivenSun edited comment on KAFKA-13689 at 3/23/22, 10:02 AM: - Hi [~guozhang] 

[jira] [Comment Edited] (KAFKA-13689) AbstractConfig log print information is incorrect

2022-03-23 Thread RivenSun (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17511136#comment-17511136 ] RivenSun edited comment on KAFKA-13689 at 3/23/22, 10:01 AM: - Hi [~guozhang] 

[GitHub] [kafka] LiamClarkeNZ commented on pull request #11920: KAFKA-13672 Race condition in DynamicBrokerConfig

2022-03-23 Thread GitBox
LiamClarkeNZ commented on pull request #11920: URL: https://github.com/apache/kafka/pull/11920#issuecomment-1076165670 > @LiamClarkeNZ Thanks for the patch! I left a few comments below. Could you please better explain the race condition in the description? Definitely :) Will do so

[GitHub] [kafka] dajac commented on a change in pull request #11920: KAFKA-13672 Race condition in DynamicBrokerConfig

2022-03-23 Thread GitBox
dajac commented on a change in pull request #11920: URL: https://github.com/apache/kafka/pull/11920#discussion_r833010111 ## File path: core/src/main/scala/kafka/server/DynamicBrokerConfig.scala ## @@ -201,7 +202,9 @@ class DynamicBrokerConfig(private val kafkaConfig:

[jira] [Commented] (KAFKA-13689) AbstractConfig log print information is incorrect

2022-03-23 Thread RivenSun (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17511136#comment-17511136 ] RivenSun commented on KAFKA-13689: -- Hi [~guozhang]  I thought about it carefully, maybe we are thinking

[GitHub] [kafka] dajac commented on pull request #11936: MINOR: Fix an incompatible bug in GetOffsetShell

2022-03-23 Thread GitBox
dajac commented on pull request #11936: URL: https://github.com/apache/kafka/pull/11936#issuecomment-1076082992 @dengziming Is this related to the failure we saw here: https://ci-builds.apache.org/blue/organizations/jenkins/Kafka%2Fkafka-pr/detail/PR-11900/4/tests? I will review the PR

[GitHub] [kafka] showuon commented on pull request #11691: KAFKA-13598: enable idempotence producer by default and validate the configs

2022-03-23 Thread GitBox
showuon commented on pull request #11691: URL: https://github.com/apache/kafka/pull/11691#issuecomment-1076036468 No, I'm not Yang Yu :) Glad we found out the root cause! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[jira] [Commented] (KAFKA-13761) KafkaLog4jAppender deadlocks when idempotence is enabled

2022-03-23 Thread Luke Chen (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17511079#comment-17511079 ] Luke Chen commented on KAFKA-13761: --- Nice find! > KafkaLog4jAppender deadlocks when idempotence is

  1   2   >