[GitHub] [kafka] Owen-CH-Leung commented on pull request #14136: Add metadatacache into RemoteLogManager, and refactor all relevant codes

2023-08-01 Thread via GitHub
Owen-CH-Leung commented on PR #14136: URL: https://github.com/apache/kafka/pull/14136#issuecomment-1661525755 Hello @divijvaidya , I'm still in the process of writing the PR and would like to ask something : For this ticket, in order to reuse the metadata cache inside broker (which

[GitHub] [kafka] philipnee commented on pull request #14123: MINOR: Fix committed API in the PrototypeAsyncConsumer timeout

2023-08-01 Thread via GitHub
philipnee commented on PR #14123: URL: https://github.com/apache/kafka/pull/14123#issuecomment-1661525036 @junrao - Thank you so much for the reviews. The latest commit addressed your comments. Let me know if you have more. -- This is an automated message from the Apache Git Service. To

[GitHub] [kafka] riedelmax commented on a diff in pull request #14124: Kafka-14509; [1/2] Define ConsumerGroupDescribe API request and response schemas and classes.

2023-08-01 Thread via GitHub
riedelmax commented on code in PR #14124: URL: https://github.com/apache/kafka/pull/14124#discussion_r1281414899 ## clients/src/main/resources/common/message/ConsumerGroupDescribeResponse.json: ## @@ -0,0 +1,98 @@ +// Licensed to the Apache Software Foundation (ASF) under one

[GitHub] [kafka] philipnee commented on a diff in pull request #14123: MINOR: Fix committed API in the PrototypeAsyncConsumer timeout

2023-08-01 Thread via GitHub
philipnee commented on code in PR #14123: URL: https://github.com/apache/kafka/pull/14123#discussion_r1281412776 ## core/src/test/scala/integration/kafka/api/BaseAsyncConsumerTest.scala: ## @@ -35,8 +39,12 @@ class BaseAsyncConsumerTest extends AbstractConsumerTest {

[jira] [Comment Edited] (KAFKA-15267) Cluster-wide disablement of Tiered Storage

2023-08-01 Thread Luke Chen (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17750101#comment-17750101 ] Luke Chen edited comment on KAFKA-15267 at 8/2/23 5:22 AM: --- For option (4),

[jira] [Commented] (KAFKA-15267) Cluster-wide disablement of Tiered Storage

2023-08-01 Thread Luke Chen (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17750101#comment-17750101 ] Luke Chen commented on KAFKA-15267: --- For option (4), It looks like we can want to validate one of the

[GitHub] [kafka] philipnee commented on a diff in pull request #14123: MINOR: Fix committed API in the PrototypeAsyncConsumer timeout

2023-08-01 Thread via GitHub
philipnee commented on code in PR #14123: URL: https://github.com/apache/kafka/pull/14123#discussion_r1281407606 ## clients/src/test/java/org/apache/kafka/clients/consumer/internals/PrototypeAsyncConsumerTest.java: ## @@ -150,15 +151,33 @@ public void

[GitHub] [kafka] satishd commented on pull request #14128: KAFKA-15272: Fix the logic which finds candidate log segments to upload it to tiered storage

2023-08-01 Thread via GitHub
satishd commented on PR #14128: URL: https://github.com/apache/kafka/pull/14128#issuecomment-1661492281 Unrelated test failures in Jenkins jobs, merging it to trunk. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[GitHub] [kafka] riedelmax commented on a diff in pull request #14124: Kafka-14509; [1/2] Define ConsumerGroupDescribe API request and response schemas and classes.

2023-08-01 Thread via GitHub
riedelmax commented on code in PR #14124: URL: https://github.com/apache/kafka/pull/14124#discussion_r1281390210 ## clients/src/main/resources/common/message/ConsumerGroupDescribeResponse.json: ## @@ -0,0 +1,98 @@ +// Licensed to the Apache Software Foundation (ASF) under one

[GitHub] [kafka] riedelmax commented on a diff in pull request #14124: Kafka-14509; [1/2] Define ConsumerGroupDescribe API request and response schemas and classes.

2023-08-01 Thread via GitHub
riedelmax commented on code in PR #14124: URL: https://github.com/apache/kafka/pull/14124#discussion_r1281390210 ## clients/src/main/resources/common/message/ConsumerGroupDescribeResponse.json: ## @@ -0,0 +1,98 @@ +// Licensed to the Apache Software Foundation (ASF) under one

[GitHub] [kafka] github-actions[bot] commented on pull request #13667: KAFKA-12693: ALOS fencing

2023-08-01 Thread via GitHub
github-actions[bot] commented on PR #13667: URL: https://github.com/apache/kafka/pull/13667#issuecomment-1661437886 This PR is being marked as stale since it has not had any activity in 90 days. If you would like to keep this PR alive, please ask a committer for review. If the PR has

[GitHub] [kafka] showuon commented on a diff in pull request #14133: KAFKA-15189: only init remote topic metrics when enabled

2023-08-01 Thread via GitHub
showuon commented on code in PR #14133: URL: https://github.com/apache/kafka/pull/14133#discussion_r1281346254 ## build.gradle: ## @@ -1634,6 +1634,8 @@ project(':storage:api') { dependencies { implementation project(':clients') +implementation

[GitHub] [kafka] showuon commented on a diff in pull request #14133: KAFKA-15189: only init remote topic metrics when enabled

2023-08-01 Thread via GitHub
showuon commented on code in PR #14133: URL: https://github.com/apache/kafka/pull/14133#discussion_r1281346254 ## build.gradle: ## @@ -1634,6 +1634,8 @@ project(':storage:api') { dependencies { implementation project(':clients') +implementation

[GitHub] [kafka] showuon commented on a diff in pull request #14133: KAFKA-15189: only init remote topic metrics when enabled

2023-08-01 Thread via GitHub
showuon commented on code in PR #14133: URL: https://github.com/apache/kafka/pull/14133#discussion_r1281344968 ## core/src/main/java/kafka/log/remote/RemoteStorageMetrics.java: ## @@ -0,0 +1,66 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one or more + *

[jira] (KAFKA-12829) Remove Deprecated methods under Topology

2023-08-01 Thread Junyao Huang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12829 ] Junyao Huang deleted comment on KAFKA-12829: -- was (Author: pegasas): [~josep.prat]  I am new to kafka contribution, seeing other threads replies, I am willing to track this issue,  Would

[GitHub] [kafka] mjsax commented on a diff in pull request #14108: KAFKA-15022: [5/N] compute rack aware assignment for standby tasks

2023-08-01 Thread via GitHub
mjsax commented on code in PR #14108: URL: https://github.com/apache/kafka/pull/14108#discussion_r1281300901 ## streams/src/main/java/org/apache/kafka/streams/processor/internals/assignment/ClientTagAwareStandbyTaskAssignor.java: ## @@ -156,6 +163,38 @@ public boolean

[GitHub] [kafka] jeffkbkim commented on a diff in pull request #14124: Kafka-14509 Define ConsumerGroupDescribe API request and response schemas and classes.

2023-08-01 Thread via GitHub
jeffkbkim commented on code in PR #14124: URL: https://github.com/apache/kafka/pull/14124#discussion_r1281259172 ## clients/src/main/java/org/apache/kafka/common/requests/ConsumerGroupDescribeRequest.java: ## @@ -0,0 +1,82 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] [kafka] mjsax merged pull request #14097: KAFKA-15022: [4/N] use client tag assignor for rack aware standby task assignment

2023-08-01 Thread via GitHub
mjsax merged PR #14097: URL: https://github.com/apache/kafka/pull/14097 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[jira] [Updated] (KAFKA-9597) Flaky Test KafkaProducerTest#testInitTransactionTimeout

2023-08-01 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True updated KAFKA-9597: - Component/s: clients > Flaky Test KafkaProducerTest#testInitTransactionTimeout >

[jira] [Updated] (KAFKA-13514) Flaky test StickyAssignorTest

2023-08-01 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True updated KAFKA-13514: -- Component/s: consumer > Flaky test StickyAssignorTest > - > >

[jira] [Updated] (KAFKA-2933) Failure in kafka.api.PlaintextConsumerTest.testMultiConsumerDefaultAssignment

2023-08-01 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-2933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True updated KAFKA-2933: - Component/s: consumer > Failure in kafka.api.PlaintextConsumerTest.testMultiConsumerDefaultAssignment >

[jira] [Updated] (KAFKA-8589) Flaky test ResetConsumerGroupOffsetTest#testResetOffsetsExistingTopic

2023-08-01 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-8589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True updated KAFKA-8589: - Summary: Flaky test ResetConsumerGroupOffsetTest#testResetOffsetsExistingTopic (was: Flakey test

[jira] [Updated] (KAFKA-13514) Flaky test StickyAssignorTest

2023-08-01 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True updated KAFKA-13514: -- Summary: Flaky test StickyAssignorTest (was: Flakey test StickyAssignorTest) > Flaky test

[jira] [Updated] (KAFKA-10663) Flaky test ConsumerBounceTest#testSeekAndCommitWithBrokerFailures

2023-08-01 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True updated KAFKA-10663: -- Summary: Flaky test ConsumerBounceTest#testSeekAndCommitWithBrokerFailures (was: Flakey test

[jira] [Updated] (KAFKA-10663) Flakey test ConsumerBounceTest#testSeekAndCommitWithBrokerFailures

2023-08-01 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True updated KAFKA-10663: -- Component/s: clients unit tests > Flakey test

[jira] [Updated] (KAFKA-8529) Flaky test ConsumerBounceTest#testCloseDuringRebalance

2023-08-01 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-8529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True updated KAFKA-8529: - Summary: Flaky test ConsumerBounceTest#testCloseDuringRebalance (was: Flakey test

[jira] [Updated] (KAFKA-8529) Flakey test ConsumerBounceTest#testCloseDuringRebalance

2023-08-01 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-8529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True updated KAFKA-8529: - Labels: clients consumer flaky-test unit-test (was: flaky-test) > Flakey test

[jira] [Updated] (KAFKA-10663) Flakey test ConsumerBounceTest#testSeekAndCommitWithBrokerFailures

2023-08-01 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True updated KAFKA-10663: -- Labels: clients consumer flaky-test unit-test (was: flaky-test) > Flakey test

[jira] [Updated] (KAFKA-13421) Fix ConsumerBounceTest#testRollingBrokerRestartsWithSmallerMaxGroupSizeConfigDisruptsBigGroup

2023-08-01 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True updated KAFKA-13421: -- Labels: clients consumer flaky-test unit-test (was: flaky-test) > Fix >

[jira] [Updated] (KAFKA-8459) Flakey test BaseQuotaTest#testThrottledRequest

2023-08-01 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-8459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True updated KAFKA-8459: - Labels: flaky-test (was: ) > Flakey test BaseQuotaTest#testThrottledRequest >

[jira] [Updated] (KAFKA-8645) Flakey test SaslSslAdminClientIntegrationTest#testElectUncleanLeadersAndNoop

2023-08-01 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-8645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True updated KAFKA-8645: - Labels: flaky-test (was: ) > Flakey test

[jira] [Updated] (KAFKA-8462) flakey test RestServerTest#testCORSEnabled

2023-08-01 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-8462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True updated KAFKA-8462: - Labels: flaky-test (was: ) > flakey test RestServerTest#testCORSEnabled >

[jira] [Updated] (KAFKA-8720) Flakey test AdminClientIntegrationTest #testElectUncleanLeadersForManyPartitions

2023-08-01 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-8720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True updated KAFKA-8720: - Labels: flaky-test (was: ) > Flakey test AdminClientIntegrationTest >

[jira] [Updated] (KAFKA-8502) Flakey test AdminClientIntegrationTest#testElectUncleanLeadersForAllPartitions

2023-08-01 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-8502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True updated KAFKA-8502: - Labels: flaky-test (was: ) > Flakey test

[GitHub] [kafka] kirktrue commented on pull request #13990: KAFKA-14937: Refactoring for client code to reduce boilerplate

2023-08-01 Thread via GitHub
kirktrue commented on PR #13990: URL: https://github.com/apache/kafka/pull/13990#issuecomment-1661230252 @junrao It doesn't seem that our [test history](https://ge.apache.org/scans/tests?search.relativeStartTime=P90D=kafka=America/Los_Angeles) goes back much further than a few weeks, so

[GitHub] [kafka] lihaosky opened a new pull request, #14139: KAFKA-15022: [6/N] use RackAwareTaskAssignor in HAAssignor

2023-08-01 Thread via GitHub
lihaosky opened a new pull request, #14139: URL: https://github.com/apache/kafka/pull/14139 ## Description Use rack aware task assignor in HAAssignor. This is on top of https://github.com/apache/kafka/pull/14108 ## Test TODO -- This is an automated message from the

[jira] [Updated] (KAFKA-15273) Log common name of expired client certificate

2023-08-01 Thread Eike Thaden (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eike Thaden updated KAFKA-15273: Labels: PatchAvailable (was: ) > Log common name of expired client certificate >

[GitHub] [kafka] nizhikov commented on pull request #13247: KAFKA-14595 [WIP] Move ReassignPartitionsCommand to java

2023-08-01 Thread via GitHub
nizhikov commented on PR #13247: URL: https://github.com/apache/kafka/pull/13247#issuecomment-1661218798 @ijuma @tombentley @mimaison I rewrite `ReassignPartitionsCommand` and all tests belong to it. All tests regarding `ReassignPartitionsCommand.java` pass. The only link to

[GitHub] [kafka] junrao commented on a diff in pull request #14123: MINOR: Fix committed API in the PrototypeAsyncConsumer timeout

2023-08-01 Thread via GitHub
junrao commented on code in PR #14123: URL: https://github.com/apache/kafka/pull/14123#discussion_r1281188661 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/events/ApplicationEventProcessor.java: ## @@ -106,12 +106,18 @@ private boolean process(final

[jira] [Updated] (KAFKA-15292) Flaky test IdentityReplicationIntegrationTest#testReplicateSourceDefault()

2023-08-01 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True updated KAFKA-15292: -- Summary: Flaky test IdentityReplicationIntegrationTest#testReplicateSourceDefault() (was: Test

[jira] [Updated] (KAFKA-15292) Test IdentityReplicationIntegrationTest#testReplicateSourceDefault() is flaky

2023-08-01 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True updated KAFKA-15292: -- Issue Type: Bug (was: Test) > Test IdentityReplicationIntegrationTest#testReplicateSourceDefault()

[jira] [Updated] (KAFKA-15292) Test IdentityReplicationIntegrationTest#testReplicateSourceDefault() is flaky

2023-08-01 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True updated KAFKA-15292: -- Description: The test testReplicateSourceDefault in

[jira] [Created] (KAFKA-15292) Test IdentityReplicationIntegrationTest#testReplicateSourceDefault() is flaky

2023-08-01 Thread Kirk True (Jira)
Kirk True created KAFKA-15292: - Summary: Test IdentityReplicationIntegrationTest#testReplicateSourceDefault() is flaky Key: KAFKA-15292 URL: https://issues.apache.org/jira/browse/KAFKA-15292 Project:

[jira] [Updated] (KAFKA-15020) integration.kafka.server.FetchFromFollowerIntegrationTest.testRackAwareRangeAssignor test is flaky

2023-08-01 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True updated KAFKA-15020: -- Labels: flaky-test (was: ) >

[GitHub] [kafka] gharris1727 commented on pull request #12806: KAFKA-14345: Fix flakiness with more accurate bound in (Dynamic)ConnectionQuotaTest

2023-08-01 Thread via GitHub
gharris1727 commented on PR #12806: URL: https://github.com/apache/kafka/pull/12806#issuecomment-1661163878 @divijvaidya Are you interested in reviewing this? This is a KIP-less alternative to solve the flakiness in this test. -- This is an automated message from the Apache Git Service.

[jira] [Created] (KAFKA-15291) Implemented Versioned interfaces in common Connect plugins

2023-08-01 Thread Greg Harris (Jira)
Greg Harris created KAFKA-15291: --- Summary: Implemented Versioned interfaces in common Connect plugins Key: KAFKA-15291 URL: https://issues.apache.org/jira/browse/KAFKA-15291 Project: Kafka

[jira] [Updated] (KAFKA-15197) Flaky test MirrorConnectorsIntegrationExactlyOnceTest.testOffsetTranslationBehindReplicationFlow()

2023-08-01 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True updated KAFKA-15197: -- Labels: flaky-test (was: flaky) > Flaky test >

[jira] [Updated] (KAFKA-15197) Flaky test MirrorConnectorsIntegrationExactlyOnceTest.testOffsetTranslationBehindReplicationFlow()

2023-08-01 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True updated KAFKA-15197: -- Labels: flaky (was: ) > Flaky test >

[GitHub] [kafka] gharris1727 commented on pull request #14064: KAFKA-15030: Add connect-plugin-path command-line tool.

2023-08-01 Thread via GitHub
gharris1727 commented on PR #14064: URL: https://github.com/apache/kafka/pull/14064#issuecomment-1661121133 > Hmmm... getting an NPE when I try to run the command now: I've fixed that, sorry. I've also added tests that would catch that NPE. > made a note of any collisions that

[GitHub] [kafka] junrao commented on pull request #13990: KAFKA-14937: Refactoring for client code to reduce boilerplate

2023-08-01 Thread via GitHub
junrao commented on PR #13990: URL: https://github.com/apache/kafka/pull/13990#issuecomment-1661118945 @kirktrue : For consistent infra issues, we could file an infra jira for the ASF infra team to help. For transient test failures, if we could identify when the test failure first occurred

[GitHub] [kafka] see-quick commented on pull request #14011: MINOR: Fix MiniKdc Java 17 issue in system tests

2023-08-01 Thread via GitHub
see-quick commented on PR #14011: URL: https://github.com/apache/kafka/pull/14011#issuecomment-1661048470 @ijuma. It also passed with Java 11 and Java 8 :) So I think it is good to go :) WDYT? -- This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [kafka] CalvinConfluent opened a new pull request, #14138: Fix a race when query isUnderMinIsr

2023-08-01 Thread via GitHub
CalvinConfluent opened a new pull request, #14138: URL: https://github.com/apache/kafka/pull/14138 When the leader becomes the follower, we first remove the ISR and then reset the leader. If we call isUnderMinIsr in between, we will get an answer with true which is a race bug. -- This

[GitHub] [kafka] mehbey commented on a diff in pull request #14135: KAFKA-14991: Implementation of KIP-937 which improves message timesta…

2023-08-01 Thread via GitHub
mehbey commented on code in PR #14135: URL: https://github.com/apache/kafka/pull/14135#discussion_r1280981876 ## core/src/test/scala/integration/kafka/api/PlaintextProducerSendTest.scala: ## @@ -124,7 +124,7 @@ class PlaintextProducerSendTest extends BaseProducerSendTest {

[GitHub] [kafka] gharris1727 commented on pull request #14055: KAFKA-15031: Add plugin.discovery to Connect worker configuration (KIP-898)

2023-08-01 Thread via GitHub
gharris1727 commented on PR #14055: URL: https://github.com/apache/kafka/pull/14055#issuecomment-1660818460 > LGTM assuming the two small remaining comments (tweaking language in Plugins::maybeReportHybridDiscoveryIssue and using lowercase values in docs for plugin.discovery.mode property)

[GitHub] [kafka] C0urante commented on pull request #14064: KAFKA-15030: Add connect-plugin-path command-line tool.

2023-08-01 Thread via GitHub
C0urante commented on PR #14064: URL: https://github.com/apache/kafka/pull/14064#issuecomment-1660814545 Hmmm... getting an NPE when I try to run the command now: ``` Cannot invoke "java.util.Set.removeIf(java.util.function.Predicate)" because the return value of

[GitHub] [kafka] C0urante commented on pull request #14055: KAFKA-15031: Add plugin.discovery to Connect worker configuration (KIP-898)

2023-08-01 Thread via GitHub
C0urante commented on PR #14055: URL: https://github.com/apache/kafka/pull/14055#issuecomment-1660769007 > I don't think it's possible to make the classpath and plugins behave the consistently in this case... Do you think this behavior is worth changing? Absolutely not! Haha, I'm

[GitHub] [kafka] C0urante commented on a diff in pull request #14055: KAFKA-15031: Add plugin.discovery to Connect worker configuration (KIP-898)

2023-08-01 Thread via GitHub
C0urante commented on code in PR #14055: URL: https://github.com/apache/kafka/pull/14055#discussion_r1280925188 ## connect/runtime/src/main/java/org/apache/kafka/connect/runtime/isolation/Plugins.java: ## @@ -63,16 +67,72 @@ public Plugins(Map props) { // VisibleForTesting

[GitHub] [kafka] gharris1727 merged pull request #14089: KAFKA-15244: Remove PluginType.from(Class)

2023-08-01 Thread via GitHub
gharris1727 merged PR #14089: URL: https://github.com/apache/kafka/pull/14089 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [kafka] gharris1727 commented on pull request #14089: KAFKA-15244: Remove PluginType.from(Class)

2023-08-01 Thread via GitHub
gharris1727 commented on PR #14089: URL: https://github.com/apache/kafka/pull/14089#issuecomment-1660748446 CI failures appear unrelated, and the JDK8 tests all passed. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

[jira] [Updated] (KAFKA-15229) Increase default value of task.shutdown.graceful.timeout.ms

2023-08-01 Thread Sagar Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Rao updated KAFKA-15229: -- Description: The Kafka Connect config [task.shutdown.graceful.timeout.ms.

[jira] [Updated] (KAFKA-15229) Increase default value of task.shutdown.graceful.timeout.ms

2023-08-01 Thread Sagar Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Rao updated KAFKA-15229: -- Description: The Kafka Connect config [task.shutdown.graceful.timeout.ms.

[jira] [Updated] (KAFKA-15229) Increase default value of task.shutdown.graceful.timeout.ms

2023-08-01 Thread Sagar Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Rao updated KAFKA-15229: -- Labels: (was: needs-kip) > Increase default value of task.shutdown.graceful.timeout.ms >

[GitHub] [kafka] kamalcph commented on a diff in pull request #14114: KAFKA-12969: Add broker level config synonyms for topic level tiered storage configs

2023-08-01 Thread via GitHub
kamalcph commented on code in PR #14114: URL: https://github.com/apache/kafka/pull/14114#discussion_r1280887247 ## storage/src/main/java/org/apache/kafka/storage/internals/log/LogConfig.java: ## @@ -102,49 +102,14 @@ public String topicWarningMessage(String topicName) {

[GitHub] [kafka] kamalcph commented on a diff in pull request #14114: KAFKA-12969: Add broker level config synonyms for topic level tiered storage configs

2023-08-01 Thread via GitHub
kamalcph commented on code in PR #14114: URL: https://github.com/apache/kafka/pull/14114#discussion_r1280887247 ## storage/src/main/java/org/apache/kafka/storage/internals/log/LogConfig.java: ## @@ -102,49 +102,14 @@ public String topicWarningMessage(String topicName) {

[GitHub] [kafka] divijvaidya commented on a diff in pull request #14135: KAFKA-14991: Implementation of KIP-937 which improves message timesta…

2023-08-01 Thread via GitHub
divijvaidya commented on code in PR #14135: URL: https://github.com/apache/kafka/pull/14135#discussion_r1280547981 ## core/src/test/scala/integration/kafka/api/PlaintextProducerSendTest.scala: ## @@ -124,7 +124,7 @@ class PlaintextProducerSendTest extends BaseProducerSendTest

[jira] [Updated] (KAFKA-15290) Add support to onboard existing topics to tiered storage

2023-08-01 Thread Kamal Chandraprakash (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kamal Chandraprakash updated KAFKA-15290: - Parent: KAFKA-7739 Issue Type: Sub-task (was: Task) > Add support to

[jira] [Created] (KAFKA-15290) Add support to onboard existing topics to tiered storage

2023-08-01 Thread Kamal Chandraprakash (Jira)
Kamal Chandraprakash created KAFKA-15290: Summary: Add support to onboard existing topics to tiered storage Key: KAFKA-15290 URL: https://issues.apache.org/jira/browse/KAFKA-15290 Project:

[GitHub] [kafka] AndrewJSchofield commented on pull request #14111: KAFKA-9800: Exponential backoff for Kafka clients - KIP-580

2023-08-01 Thread via GitHub
AndrewJSchofield commented on PR #14111: URL: https://github.com/apache/kafka/pull/14111#issuecomment-1660648111 > Yes, I agree that it needs more work for the cases that you mentioned. I'm looking at the Sender/RecordAccumulator next. -- This is an automated message from the

[GitHub] [kafka] philipnee commented on pull request #14123: MINOR: Fix committed API in the PrototypeAsyncConsumer timeout

2023-08-01 Thread via GitHub
philipnee commented on PR #14123: URL: https://github.com/apache/kafka/pull/14123#issuecomment-1660477317 latest test failures are unrelated ``` New failing - 10 Build / JDK 17 and Scala 2.13 / testBumpTransactionalEpoch(String).quorum=kraft – kafka.api.TransactionsTest 1m 17s

[GitHub] [kafka] Cerchie opened a new pull request, #14137: Kafka-15126: fix merge issue and range queries to accept null lower and upper bounds

2023-08-01 Thread via GitHub
Cerchie opened a new pull request, #14137: URL: https://github.com/apache/kafka/pull/14137 Change in response to [KIP-941](https://cwiki.apache.org/confluence/display/KAFKA/KIP-941%3A+Range+queries+to+accept+null+lower+and+upper+bounds). New PR due to merge issue. Changes

[GitHub] [kafka] ivanyu commented on a diff in pull request #13984: KAFKA-15107: Support custom metadata for remote log segment

2023-08-01 Thread via GitHub
ivanyu commented on code in PR #13984: URL: https://github.com/apache/kafka/pull/13984#discussion_r1280742713 ## core/src/main/java/kafka/log/remote/RemoteLogManager.java: ## @@ -621,10 +626,30 @@ private void copyLogSegment(UnifiedLog log, LogSegment segment, long nextSegment

[GitHub] [kafka] ivanyu commented on a diff in pull request #13984: KAFKA-15107: Support custom metadata for remote log segment

2023-08-01 Thread via GitHub
ivanyu commented on code in PR #13984: URL: https://github.com/apache/kafka/pull/13984#discussion_r1280718946 ## storage/src/main/java/org/apache/kafka/server/log/remote/storage/RemoteLogManagerConfig.java: ## @@ -393,6 +413,7 @@ public boolean equals(Object o) {

[GitHub] [kafka] ivanyu commented on a diff in pull request #13984: KAFKA-15107: Support custom metadata for remote log segment

2023-08-01 Thread via GitHub
ivanyu commented on code in PR #13984: URL: https://github.com/apache/kafka/pull/13984#discussion_r1280718863 ## storage/src/main/java/org/apache/kafka/server/log/remote/storage/RemoteLogManagerConfig.java: ## @@ -169,6 +176,11 @@ public final class RemoteLogManagerConfig {

[GitHub] [kafka] ivanyu commented on a diff in pull request #13984: KAFKA-15107: Support custom metadata for remote log segment

2023-08-01 Thread via GitHub
ivanyu commented on code in PR #13984: URL: https://github.com/apache/kafka/pull/13984#discussion_r1280710406 ## core/src/main/java/kafka/log/remote/RemoteLogManager.java: ## @@ -621,10 +626,30 @@ private void copyLogSegment(UnifiedLog log, LogSegment segment, long nextSegment

[GitHub] [kafka] ivanyu commented on a diff in pull request #13984: KAFKA-15107: Support custom metadata for remote log segment

2023-08-01 Thread via GitHub
ivanyu commented on code in PR #13984: URL: https://github.com/apache/kafka/pull/13984#discussion_r1280708300 ## core/src/main/java/kafka/log/remote/RemoteLogManager.java: ## @@ -621,10 +626,30 @@ private void copyLogSegment(UnifiedLog log, LogSegment segment, long nextSegment

[GitHub] [kafka] divijvaidya merged pull request #13260: KAFKA-14661: Upgrade Zookeeper to 3.8.1

2023-08-01 Thread via GitHub
divijvaidya merged PR #13260: URL: https://github.com/apache/kafka/pull/13260 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [kafka] divijvaidya commented on pull request #13260: KAFKA-14661: Upgrade Zookeeper to 3.8.1

2023-08-01 Thread via GitHub
divijvaidya commented on PR #13260: URL: https://github.com/apache/kafka/pull/13260#issuecomment-1660410928 Unrelated test failures at https://ci-builds.apache.org/blue/organizations/jenkins/Kafka%2Fkafka-pr/detail/PR-13260/9/pipeline/ . Merging this one. -- This is an automated message

[GitHub] [kafka] ivanyu commented on a diff in pull request #13984: KAFKA-15107: Support custom metadata for remote log segment

2023-08-01 Thread via GitHub
ivanyu commented on code in PR #13984: URL: https://github.com/apache/kafka/pull/13984#discussion_r1280704854 ## core/src/main/java/kafka/log/remote/CustomMetadataSizeLimitExceededException.java: ## @@ -0,0 +1,20 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under

[GitHub] [kafka] divijvaidya commented on a diff in pull request #13260: KAFKA-14661: Upgrade Zookeeper to 3.8.1

2023-08-01 Thread via GitHub
divijvaidya commented on code in PR #13260: URL: https://github.com/apache/kafka/pull/13260#discussion_r1280704453 ## build.gradle: ## @@ -893,6 +893,10 @@ project(':core') { implementation libs.dropwizardMetrics exclude module: 'slf4j-log4j12' exclude

[GitHub] [kafka] Owen-CH-Leung opened a new pull request, #14136: Add metadatacache into RemoteLogManager, and refactor all relevant codes

2023-08-01 Thread via GitHub
Owen-CH-Leung opened a new pull request, #14136: URL: https://github.com/apache/kafka/pull/14136 PR in response to [KAFKA-15038](https://issues.apache.org/jira/browse/KAFKA-15038). This PR incorporates `MetaDataCache` into `RemoteLogManager` and refactor all other relevant codes

[GitHub] [kafka] divijvaidya commented on a diff in pull request #13260: KAFKA-14661: Upgrade Zookeeper to 3.8.1

2023-08-01 Thread via GitHub
divijvaidya commented on code in PR #13260: URL: https://github.com/apache/kafka/pull/13260#discussion_r1280702334 ## build.gradle: ## @@ -893,6 +893,10 @@ project(':core') { implementation libs.dropwizardMetrics exclude module: 'slf4j-log4j12' exclude

[GitHub] [kafka] clolov commented on a diff in pull request #13260: KAFKA-14661: Upgrade Zookeeper to 3.8.1

2023-08-01 Thread via GitHub
clolov commented on code in PR #13260: URL: https://github.com/apache/kafka/pull/13260#discussion_r1280697282 ## build.gradle: ## @@ -893,6 +893,10 @@ project(':core') { implementation libs.dropwizardMetrics exclude module: 'slf4j-log4j12' exclude module:

[GitHub] [kafka] clolov commented on a diff in pull request #13260: KAFKA-14661: Upgrade Zookeeper to 3.8.1

2023-08-01 Thread via GitHub
clolov commented on code in PR #13260: URL: https://github.com/apache/kafka/pull/13260#discussion_r1280697282 ## build.gradle: ## @@ -893,6 +893,10 @@ project(':core') { implementation libs.dropwizardMetrics exclude module: 'slf4j-log4j12' exclude module:

[GitHub] [kafka] clolov commented on a diff in pull request #13260: KAFKA-14661: Upgrade Zookeeper to 3.8.1

2023-08-01 Thread via GitHub
clolov commented on code in PR #13260: URL: https://github.com/apache/kafka/pull/13260#discussion_r1280689006 ## build.gradle: ## @@ -893,6 +893,10 @@ project(':core') { implementation libs.dropwizardMetrics exclude module: 'slf4j-log4j12' exclude module:

[jira] [Commented] (KAFKA-15258) Consider moving MockAdminClient to the public API

2023-08-01 Thread Mickael Maison (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17749773#comment-17749773 ] Mickael Maison commented on KAFKA-15258: This needs a KIP to decide whether it should be made

[GitHub] [kafka] yashmayya commented on pull request #13530: KAFKA-14858: Handle exceptions thrown from Connector::taskConfigs in Connect's standalone mode

2023-08-01 Thread via GitHub
yashmayya commented on PR #13530: URL: https://github.com/apache/kafka/pull/13530#issuecomment-1660303528 Hey Chris, thanks for the reviews and apologies for the late response. > Honestly, I think the biggest obstacle to preventing pause/resume for connectors that have failed to

[GitHub] [kafka] divijvaidya commented on a diff in pull request #13260: KAFKA-14661: Upgrade Zookeeper to 3.8.1

2023-08-01 Thread via GitHub
divijvaidya commented on code in PR #13260: URL: https://github.com/apache/kafka/pull/13260#discussion_r1280597042 ## build.gradle: ## @@ -893,6 +893,10 @@ project(':core') { implementation libs.dropwizardMetrics exclude module: 'slf4j-log4j12' exclude

[GitHub] [kafka] divijvaidya commented on a diff in pull request #14133: KAFKA-15189: only init remote topic metrics when enabled

2023-08-01 Thread via GitHub
divijvaidya commented on code in PR #14133: URL: https://github.com/apache/kafka/pull/14133#discussion_r1280583213 ## core/src/main/java/kafka/log/remote/RemoteStorageMetrics.java: ## @@ -0,0 +1,66 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one or more +

[jira] [Commented] (KAFKA-15267) Cluster-wide disablement of Tiered Storage

2023-08-01 Thread Christo Lolov (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17749709#comment-17749709 ] Christo Lolov commented on KAFKA-15267: --- Heya [~showuon] and thank you for the comment! I will

[GitHub] [kafka] fvaleri commented on a diff in pull request #13562: KAFKA-14581: Moving GetOffsetShell to tools

2023-08-01 Thread via GitHub
fvaleri commented on code in PR #13562: URL: https://github.com/apache/kafka/pull/13562#discussion_r1280546556 ## tools/src/main/java/org/apache/kafka/tools/ToolsUtils.java: ## @@ -0,0 +1,44 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one or more + *

[GitHub] [kafka] showuon commented on pull request #14133: KAFKA-15189: only init remote topic metrics when enabled

2023-08-01 Thread via GitHub
showuon commented on PR #14133: URL: https://github.com/apache/kafka/pull/14133#issuecomment-1660201278 @divijvaidya @kamalcph , thanks for the comments. PR updated. Thanks. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [kafka] showuon commented on a diff in pull request #14133: KAFKA-15189: only init remote topic metrics when enabled

2023-08-01 Thread via GitHub
showuon commented on code in PR #14133: URL: https://github.com/apache/kafka/pull/14133#discussion_r1280543902 ## core/src/main/java/kafka/log/remote/RemoteStorageMetrics.java: ## @@ -0,0 +1,53 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one or more + *

[GitHub] [kafka] showuon commented on a diff in pull request #14133: KAFKA-15189: only init remote topic metrics when enabled

2023-08-01 Thread via GitHub
showuon commented on code in PR #14133: URL: https://github.com/apache/kafka/pull/14133#discussion_r1280542689 ## core/src/main/java/kafka/log/remote/RemoteStorageMetrics.java: ## @@ -0,0 +1,53 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one or more + *

[GitHub] [kafka] showuon commented on a diff in pull request #14133: KAFKA-15189: only init remote topic metrics when enabled

2023-08-01 Thread via GitHub
showuon commented on code in PR #14133: URL: https://github.com/apache/kafka/pull/14133#discussion_r1280542403 ## core/src/main/java/kafka/server/builders/ReplicaManagerBuilder.java: ## @@ -179,6 +180,7 @@ public ReplicaManager build() { if (metadataCache == null)

[GitHub] [kafka] divijvaidya commented on a diff in pull request #13847: KAFKA-15082: The log retention policy doesn't take effect after altering log dir

2023-08-01 Thread via GitHub
divijvaidya commented on code in PR #13847: URL: https://github.com/apache/kafka/pull/13847#discussion_r1280542310 ## core/src/main/scala/kafka/server/ReplicaManager.scala: ## @@ -1808,7 +1809,10 @@ class ReplicaManager(val config: KafkaConfig, // pause cleaning

[GitHub] [kafka] showuon commented on a diff in pull request #14133: KAFKA-15189: only init remote topic metrics when enabled

2023-08-01 Thread via GitHub
showuon commented on code in PR #14133: URL: https://github.com/apache/kafka/pull/14133#discussion_r1280529448 ## core/src/main/java/kafka/log/remote/RemoteStorageMetrics.java: ## @@ -0,0 +1,53 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one or more + *

[GitHub] [kafka] ruslankrivoshein commented on a diff in pull request #13562: KAFKA-14581: Moving GetOffsetShell to tools

2023-08-01 Thread via GitHub
ruslankrivoshein commented on code in PR #13562: URL: https://github.com/apache/kafka/pull/13562#discussion_r1280526285 ## tools/src/main/java/org/apache/kafka/tools/ToolsUtils.java: ## @@ -0,0 +1,44 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one or more

[GitHub] [kafka] fvaleri commented on a diff in pull request #13562: KAFKA-14581: Moving GetOffsetShell to tools

2023-08-01 Thread via GitHub
fvaleri commented on code in PR #13562: URL: https://github.com/apache/kafka/pull/13562#discussion_r1280446002 ## tools/src/main/java/org/apache/kafka/tools/ToolsUtils.java: ## @@ -0,0 +1,44 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one or more + *

[GitHub] [kafka] kamalcph commented on a diff in pull request #14133: KAFKA-15189: only init remote topic metrics when enabled

2023-08-01 Thread via GitHub
kamalcph commented on code in PR #14133: URL: https://github.com/apache/kafka/pull/14133#discussion_r1280432985 ## core/src/main/java/kafka/server/builders/ReplicaManagerBuilder.java: ## @@ -179,6 +180,7 @@ public ReplicaManager build() { if (metadataCache == null)

[GitHub] [kafka] ruslankrivoshein commented on pull request #1348: KAFKA-1489: Global threshold on data retention size

2023-08-01 Thread via GitHub
ruslankrivoshein commented on PR #1348: URL: https://github.com/apache/kafka/pull/1348#issuecomment-1660030396 Is this PR not going to be considered? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

  1   2   >