[jira] [Resolved] (KAFKA-15552) Duplicate Producer ID blocks during ZK migration

2023-11-16 Thread Luke Chen (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Chen resolved KAFKA-15552. --- Resolution: Fixed > Duplicate Producer ID blocks during ZK migration >

Re: [DISCUSS] Should we continue to merge without a green build? No!

2023-11-16 Thread Igor Soarez
Hi all, I think at least one of those is my fault, apologies. I'll try to make sure all my tests are passing from now on. It doesn't help that GitHub always shows that the tests have failed, even when they have not. I suspect this is because Jenkins always marks the builds as unstable, even when

Re: [DISCUSS] KIP-968: Support single-key_multi-timestamp interactive queries (IQv2) for versioned state stores

2023-11-16 Thread Bruno Cadonna
Hi, 80) We do not keep backwards compatibility with IQv1, right? I would even say that currently we do not need to keep backwards compatibility among IQv2 versions since we marked the API "Evolving" (do we only mean code compatibility here or also behavioral compatibility?). I propose to try

[jira] [Resolved] (KAFKA-15755) LeaveGroupResponse v0-v2 should handle no members

2023-11-16 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot resolved KAFKA-15755. - Fix Version/s: 3.4.2 3.5.2 3.7.0 3.6.1

Re: [DISCUSS] KIP-997 Support fetch(fromKey, toKey, from, to) to WindowRangeQuery and unify WindowKeyQuery and WindowRangeQuery

2023-11-16 Thread Bruno Cadonna
Hi Hanyu, Thanks for the KIP! 1) Could you please mark the pieces that you want to add to the API in the code listing in the KIP? You can add a comment like "// newly added" or similar. That would make reading the KIP a bit easier because one does not need to compare your code with the code

Re: [DISCUSS] KIP-963: Upload and delete lag metrics in Tiered Storage

2023-11-16 Thread Satish Duggana
Thanks Christo for your reply. 101 and 102 We have conclusion on them. 103. I am not strongly opinionated on this. I am fine if it is helpful for your scenarios. 104. It seems you want to compare this metric with the number of segments that are copied. Do you have such a metric now? Kamal and

Re: [VOTE] KIP-1000: List Client Metrics Configuration Resources

2023-11-16 Thread Doğuşcan Namal
Thanks for the brief KIP Andrew. Having discussed the details in KIP-714, I see this is a natural follow up to that. +1(non-binding) On Wed, 15 Nov 2023 at 15:23, Andrew Schofield < andrew_schofield_j...@outlook.com> wrote: > Hi, > I’d like to start the voting for KIP-1000: List Client Metrics

Re: [VOTE] KIP-1000: List Client Metrics Configuration Resources

2023-11-16 Thread Apoorv Mittal
Thanks a lot for writing the KIP Andrew. This is much required to list all configured client metrics resources. I have one minor question related to the zkBroker listener in the new RPC. As the client-metrics resource is not supported in Zookeeper mode hence shouldn't we disallow

[jira] [Created] (KAFKA-15840) Correct initialization of ConsumerGroupHeartbeat by client

2023-11-16 Thread Andrew Schofield (Jira)
Andrew Schofield created KAFKA-15840: Summary: Correct initialization of ConsumerGroupHeartbeat by client Key: KAFKA-15840 URL: https://issues.apache.org/jira/browse/KAFKA-15840 Project: Kafka

Build failed in Jenkins: Kafka » Kafka Branch Builder » 3.6 #114

2023-11-16 Thread Apache Jenkins Server
See Changes: -- [...truncated 307712 lines...] Gradle Test Run :core:test > Gradle Test Executor 91 > KafkaZkClientTest > testConditionalUpdatePath() PASSED Gradle Test

Re: [VOTE] KIP-997: Partition-Level Throughput Metrics

2023-11-16 Thread Kamal Chandraprakash
+1 (non-binding). Thanks for the KIP! On Thu, Nov 16, 2023 at 9:00 AM Satish Duggana wrote: > Thanks Qichao for the KIP. > > +1 (binding) > > ~Satish. > > On Thu, 16 Nov 2023 at 02:20, Jorge Esteban Quilcate Otoya > wrote: > > > > Qichao, thanks again for leading this proposal! > > > > +1

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #2387

2023-11-16 Thread Apache Jenkins Server
See Changes: -- [...truncated 415933 lines...] Gradle Test Run :connect:runtime:test > Gradle Test Executor 44 > org.apache.kafka.connect.util.SinkUtilsTest >

Jenkins build is still unstable: Kafka » Kafka Branch Builder » 3.5 #98

2023-11-16 Thread Apache Jenkins Server
See

[jira] [Created] (KAFKA-15841) Add Support for Topic-Level Partitioning in Kafka Connect

2023-11-16 Thread Henrique Mota (Jira)
Henrique Mota created KAFKA-15841: - Summary: Add Support for Topic-Level Partitioning in Kafka Connect Key: KAFKA-15841 URL: https://issues.apache.org/jira/browse/KAFKA-15841 Project: Kafka

Build failed in Jenkins: Kafka » Kafka Branch Builder » 3.4 #172

2023-11-16 Thread Apache Jenkins Server
See Changes: -- [...truncated 538281 lines...] Gradle Test Run :core:integrationTest > Gradle Test Executor 172 > KafkaZkClientTest > testCreateTopLevelPaths() STARTED

[jira] [Resolved] (KAFKA-15633) Bug: Generated Persistent Directory IDs are overwritten on startup.

2023-11-16 Thread Proven Provenzano (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Proven Provenzano resolved KAFKA-15633. --- Resolution: Fixed > Bug: Generated Persistent Directory IDs are overwritten on

[jira] [Created] (KAFKA-15842) Correct handling of KafkaConsumer.committed for new consumer

2023-11-16 Thread Andrew Schofield (Jira)
Andrew Schofield created KAFKA-15842: Summary: Correct handling of KafkaConsumer.committed for new consumer Key: KAFKA-15842 URL: https://issues.apache.org/jira/browse/KAFKA-15842 Project: Kafka

Re: [DISCUSS] KIP-968: Support single-key_multi-timestamp interactive queries (IQv2) for versioned state stores

2023-11-16 Thread Alieh Saeedi
Hi all, Thank you for the feedback and the interesting solutions you suggested. The KIP and the corresponding PR are updated as follows: - Snapshot semantics is implemented in the `get(key, fromTime, toTime)` method to guarantee consistency. - The `ValueIterator` interface is replaced

[jira] [Created] (KAFKA-15845) Add Junit5 test extension which detects leaked Kafka clients and servers

2023-11-16 Thread Greg Harris (Jira)
Greg Harris created KAFKA-15845: --- Summary: Add Junit5 test extension which detects leaked Kafka clients and servers Key: KAFKA-15845 URL: https://issues.apache.org/jira/browse/KAFKA-15845 Project:

[jira] [Created] (KAFKA-15843) Review consumer onPartitionsAssigned called with empty partitions

2023-11-16 Thread Lianet Magrans (Jira)
Lianet Magrans created KAFKA-15843: -- Summary: Review consumer onPartitionsAssigned called with empty partitions Key: KAFKA-15843 URL: https://issues.apache.org/jira/browse/KAFKA-15843 Project: Kafka

Re: [DISCUSS] KIP-1000: List Client Metrics Configuration Resources

2023-11-16 Thread Andrew Schofield
Hi Jun, KIP-714 includes `kafka-client-metrics.sh` which provides an easier way to work with client metrics config than the general-purpose `kafka-configs.sh`. So, this new RPC will actually be used in the `kafka-client-metrics.sh` tool. Thanks, Andrew > On 16 Nov 2023, at 18:00, Jun Rao

Re: [DISCUSS] KIP-1000: List Client Metrics Configuration Resources

2023-11-16 Thread Jason Gustafson
Hey Andrew, Thanks for the KIP. Just clarifying a couple small details. 1. I assume any broker can handle this API, so admin clients will choose a node randomly? 2. Does the controller need to support this API? If not, we can drop "controller" from "listeners." Thanks, Jason On Thu, Nov 16,

Re: [DISCUSS] KIP-1000: List Client Metrics Configuration Resources

2023-11-16 Thread Jun Rao
Hi, Andrew, Thanks for the KIP. Just one comment. Should we extend ConfigCommand or add a new tool to list client metrics? Thanks, Jun On Tue, Nov 7, 2023 at 9:42 AM Andrew Schofield < andrew_schofield_j...@outlook.com> wrote: > Hi, > I would like to start discussion of a small KIP which

[jira] [Resolved] (KAFKA-15481) Concurrency bug in RemoteIndexCache leads to IOException

2023-11-16 Thread Divij Vaidya (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Divij Vaidya resolved KAFKA-15481. -- Resolution: Fixed > Concurrency bug in RemoteIndexCache leads to IOException >

Jenkins build is unstable: Kafka » Kafka Branch Builder » trunk #2388

2023-11-16 Thread Apache Jenkins Server
See

Re: [VOTE] KIP-997: Partition-Level Throughput Metrics

2023-11-16 Thread Matthias J. Sax
This is KIP-977, right? Not as the subject says. Guess we won't be able to fix this now. Hope it does not cause confusion down the line... -Matthias On 11/16/23 4:43 AM, Kamal Chandraprakash wrote: +1 (non-binding). Thanks for the KIP! On Thu, Nov 16, 2023 at 9:00 AM Satish Duggana

[jira] [Created] (KAFKA-15844) Broker does re-register

2023-11-16 Thread Jira
José Armando García Sancio created KAFKA-15844: -- Summary: Broker does re-register Key: KAFKA-15844 URL: https://issues.apache.org/jira/browse/KAFKA-15844 Project: Kafka Issue

Re: [VOTE] KIP-1000: List Client Metrics Configuration Resources

2023-11-16 Thread Andrew Schofield
Hi Apoorv, Thanks for your vote. Initially, I put support for zkBroker in order to be able to control the error response in this case. I have validated the error handling for this RPC on a ZK cluster in which the RPC is not supported, and the error is entirely understandable. Consequently, I

Re: [VOTE] KIP-979 Allow independently stop KRaft processes

2023-11-16 Thread Hailey Ni
Hey Justine, Thank you very much for the review. I've updated the KIP to add a log line stating that when both flags are given, node-id will take precedence. Thanks, Hailey On Wed, Nov 15, 2023 at 3:37 PM Justine Olshan wrote: > Hey Hailey, > > Thanks for the KIP. > I wonder if it would be

[jira] [Created] (KAFKA-15851) broker under replicated due to error java.nio.BufferOverflowException

2023-11-16 Thread wangliucheng (Jira)
wangliucheng created KAFKA-15851: Summary: broker under replicated due to error java.nio.BufferOverflowException Key: KAFKA-15851 URL: https://issues.apache.org/jira/browse/KAFKA-15851 Project: Kafka

Re: Request permissions to contribute to Apache Kafka

2023-11-16 Thread Josep Prat
Hi there! Thanks for your interest in Apache Kafka. Your accounts are all set, let me know if you have any questions. Best, On Thu, Nov 16, 2023 at 10:46 PM shang xinli wrote: > I would like to contribute to Apache Kafka. Could you please review and > approve the request for permission to

Re: [DISCUSS] KIP-968: Support single-key_multi-timestamp interactive queries (IQv2) for versioned state stores

2023-11-16 Thread Matthias J. Sax
Thanks, Alieh. Overall SGTM. About `validTo` -- wondering if we should make it an `Optional` and set to `empty()` by default? I am totally ok with going with the 3-way option about ordering using default "undefined". For this KIP (as it's all net new) nothing really changes. -- However, we

[jira] [Created] (KAFKA-15850) Improve KafkaMetrics APIs to expose Value Provider information

2023-11-16 Thread Apoorv Mittal (Jira)
Apoorv Mittal created KAFKA-15850: - Summary: Improve KafkaMetrics APIs to expose Value Provider information Key: KAFKA-15850 URL: https://issues.apache.org/jira/browse/KAFKA-15850 Project: Kafka

[jira] [Created] (KAFKA-15848) Consumer API timeout inconsistent between LegacyKafkaConsumer and AsyncKafkaConsumer

2023-11-16 Thread Kirk True (Jira)
Kirk True created KAFKA-15848: - Summary: Consumer API timeout inconsistent between LegacyKafkaConsumer and AsyncKafkaConsumer Key: KAFKA-15848 URL: https://issues.apache.org/jira/browse/KAFKA-15848

[jira] [Created] (KAFKA-15846) Review consumer leave group request

2023-11-16 Thread Lianet Magrans (Jira)
Lianet Magrans created KAFKA-15846: -- Summary: Review consumer leave group request Key: KAFKA-15846 URL: https://issues.apache.org/jira/browse/KAFKA-15846 Project: Kafka Issue Type: Sub-task

Build failed in Jenkins: Kafka » Kafka Branch Builder » 3.6 #117

2023-11-16 Thread Apache Jenkins Server
See Changes: -- [...truncated 309159 lines...] Gradle Test Run :streams:test > Gradle Test Executor 62 > RocksDBBlockCacheMetricsTest >

Re: [DISCUSS] KIP-994: Minor Enhancements to ListTransactions and DescribeTransactions APIs

2023-11-16 Thread Artem Livshits
Hi Raman, I see that you've updated the KIP. The content looks good to me. A couple nits on the format: - can you highlight which fields are new in the message? - can you add your original proposal of using a tagged field in ListTransactionsRequest to the list of rejected alternatives? -Artem

Build failed in Jenkins: Kafka » Kafka Branch Builder » 3.6 #115

2023-11-16 Thread Apache Jenkins Server
See Changes: -- [...truncated 309249 lines...] Gradle Test Run :streams:test > Gradle Test Executor 89 > RocksDBBlockCacheMetricsTest >

[jira] [Created] (KAFKA-15847) Allow to resolve client metadata for specific topics

2023-11-16 Thread Lianet Magrans (Jira)
Lianet Magrans created KAFKA-15847: -- Summary: Allow to resolve client metadata for specific topics Key: KAFKA-15847 URL: https://issues.apache.org/jira/browse/KAFKA-15847 Project: Kafka

Re: [DISCUSS] KIP-997 Support fetch(fromKey, toKey, from, to) to WindowRangeQuery and unify WindowKeyQuery and WindowRangeQuery

2023-11-16 Thread Matthias J. Sax
Thanks for the KIP. Given how `WindowRangeQuery` works right now, it's really time to improve it. 1) Agree. It's not clear what will be added right now. I think we should deprecate existing `getKey()` w/o an actually replacement? For `getFromKey` and `getToKey` we should actually be

[jira] [Created] (KAFKA-15849) Fix ListGroups API when runtime partition size is zero

2023-11-16 Thread Dongnuo Lyu (Jira)
Dongnuo Lyu created KAFKA-15849: --- Summary: Fix ListGroups API when runtime partition size is zero Key: KAFKA-15849 URL: https://issues.apache.org/jira/browse/KAFKA-15849 Project: Kafka Issue

Request permissions to contribute to Apache Kafka

2023-11-16 Thread shang xinli
I would like to contribute to Apache Kafka. Could you please review and approve the request for permission to contribute to Apache Kafka with the following Wiki & Jira ID? Wiki ID: shangxinli Jira ID: shangxinli Xinli Shang

Build failed in Jenkins: Kafka » Kafka Branch Builder » 3.6 #116

2023-11-16 Thread Apache Jenkins Server
See Changes: -- [...truncated 308710 lines...] Gradle Test Run :core:test > Gradle Test Executor 93 > KafkaZkClientTest > testConditionalUpdatePath() PASSED Gradle Test

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #2389

2023-11-16 Thread Apache Jenkins Server
See

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #2390

2023-11-16 Thread Apache Jenkins Server
See Changes: -- [...truncated 325483 lines...] Gradle Test Run :streams:test > Gradle Test Executor 89 > DefaultTaskManagerTest >