Re: [DISCUSS] KIP-1018: Introduce max remote fetch timeout config

2024-05-06 Thread Kamal Chandraprakash
Hi all, If there are no more comments, I'll open a VOTE thread. -- Kamal On Sat, May 4, 2024 at 8:39 AM Kamal Chandraprakash < kamal.chandraprak...@gmail.com> wrote: > Luke, > > Thanks for the review! > > DelayedFetch and DelayedRemoteFetch are orthogonal calls >

[jira] [Created] (KAFKA-16672) Fix flaky DedicatedMirrorIntegrationTest.testMultiNodeCluster

2024-05-06 Thread Chia-Ping Tsai (Jira)
Chia-Ping Tsai created KAFKA-16672: -- Summary: Fix flaky DedicatedMirrorIntegrationTest.testMultiNodeCluster Key: KAFKA-16672 URL: https://issues.apache.org/jira/browse/KAFKA-16672 Project: Kafka

[jira] [Created] (KAFKA-16671) Revisit SessionedProtocolIntegrationTest.ensureInternalEndpointIsSecured

2024-05-06 Thread Chia-Ping Tsai (Jira)
Chia-Ping Tsai created KAFKA-16671: -- Summary: Revisit SessionedProtocolIntegrationTest.ensureInternalEndpointIsSecured Key: KAFKA-16671 URL: https://issues.apache.org/jira/browse/KAFKA-16671

[VOTE] KIP-1018: Introduce max remote fetch timeout config

2024-05-06 Thread Kamal Chandraprakash
Hi all, We would like to start a voting thread for KIP-1018: Introduce max remote fetch timeout config for DelayedRemoteFetch requests. The KIP is available on https://cwiki.apache.org/confluence/display/KAFKA/KIP-1018%3A+Introduce+max+remote+fetch+timeout+config+for+DelayedRemoteFetch+requests

[jira] [Created] (KAFKA-16673) Optimize toTopicPartitions with ConsumerProtocolSubscription

2024-05-06 Thread Dongnuo Lyu (Jira)
Dongnuo Lyu created KAFKA-16673: --- Summary: Optimize toTopicPartitions with ConsumerProtocolSubscription Key: KAFKA-16673 URL: https://issues.apache.org/jira/browse/KAFKA-16673 Project: Kafka

[jira] [Resolved] (KAFKA-16393) SslTransportLayer doesn't implement write(ByteBuffer[], int, int) correctly

2024-05-06 Thread Chia-Ping Tsai (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-16393. Fix Version/s: 3.8.0 Resolution: Fixed > SslTransportLayer doesn't implement

Re: [DISCUSS] KIP-1035: StateStore managed changelog offsets

2024-05-06 Thread Bruno Cadonna
Hi Matthias, I see what you mean. To sum up: With this KIP the .checkpoint file is written when the store closes. That is when: 1. a task moves away from Kafka Streams client 2. Kafka Streams client shuts down A Kafka Streams client needs the information in the .checkpoint file 1. on

[jira] [Created] (KAFKA-16674) Adjust classicGroupJoinToConsumerGroup to add subscription model

2024-05-06 Thread Dongnuo Lyu (Jira)
Dongnuo Lyu created KAFKA-16674: --- Summary: Adjust classicGroupJoinToConsumerGroup to add subscription model Key: KAFKA-16674 URL: https://issues.apache.org/jira/browse/KAFKA-16674 Project: Kafka

Re: [DISCUSS] KIP-932: Queues for Kafka

2024-05-06 Thread Jun Rao
Hi, Andrew, Thanks for the reply. 162. It's fine to start with just the group type. Since ListGroups() is a generic API, I want to make sure that it covers all existing groups. Currently, GroupType only has "classic" and "consumer", both of which seem to be related to groups formed by consumers

Re: [DISCUSS] KIP-932: Queues for Kafka

2024-05-06 Thread Jun Rao
Hi, Andrew, Removing AdminClient.listGroups() and the LisGroups RPC for now sounds good to me. Thanks, Jun On Mon, May 6, 2024 at 11:10 AM Andrew Schofield wrote: > Hi Jun, > Thanks for the reply. > > 162. I’ve mentioned before that I plan another KIP for administration > of groups. I think

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #2875

2024-05-06 Thread Apache Jenkins Server
See

[jira] [Created] (KAFKA-16676) Security docs missing RPCs from KIP-714 and KIP-1000

2024-05-06 Thread Andrew Schofield (Jira)
Andrew Schofield created KAFKA-16676: Summary: Security docs missing RPCs from KIP-714 and KIP-1000 Key: KAFKA-16676 URL: https://issues.apache.org/jira/browse/KAFKA-16676 Project: Kafka

[jira] [Created] (KAFKA-16675) Move rebalance callback test for positions to callbacks test file

2024-05-06 Thread Lianet Magrans (Jira)
Lianet Magrans created KAFKA-16675: -- Summary: Move rebalance callback test for positions to callbacks test file Key: KAFKA-16675 URL: https://issues.apache.org/jira/browse/KAFKA-16675 Project: Kafka

Re: [DISCUSS] KIP-1042 support for wildcard when creating new acls

2024-05-06 Thread Greg Harris
Hi Murali, Thanks for the KIP! I think I understand the motivation for this KIP in situations where there are a "cross product" of topics for two or more variables X and Y, and want to write ACLs for each of the variable axes. If you format your topics "X-Y-suffix", it's not easy to write rules

Re: [DISCUSS] KIP-1042 support for wildcard when creating new acls

2024-05-06 Thread Claude Warren
I have an idea for how to reduce the time for ACL lookups in general and particularly where wildcards are involved using sequence characterization techniques from bioinformatics. But I need a set of ACL patterns and associated topics to test with. On Fri, May 3, 2024 at 2:45 PM Haruki Okada

Re: [DISCUSS] KIP-932: Queues for Kafka

2024-05-06 Thread Jun Rao
Hi, Andrew, Thanks for addressing all the comments. The KIP looks good to me now. Jun On Mon, May 6, 2024 at 2:15 PM Andrew Schofield wrote: > Hi Jun, > I have removed AdminClient.listGroups and the associated classes and > interfaces. > > Version 6 of the ListGroups RPC remains because it

Re: [VOTE] KIP-932: Queues for Kafka

2024-05-06 Thread Jun Rao
Hi, Andrew, Thanks for the KIP. +1 Jun On Mon, Mar 18, 2024 at 11:00 AM Edoardo Comar wrote: > Thanks Andrew, > > +1 (binding) > > Edo > > On Mon, 18 Mar 2024 at 16:32, Kenneth Eversole > wrote: > > > > Hi Andrew > > > > + 1 (Non-Binding) > > > > This will be great addition to Kafka > > > >

[jira] [Resolved] (KAFKA-16356) Remove class-name dispatch in RemoteLogMetadataSerde

2024-05-06 Thread Greg Harris (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Greg Harris resolved KAFKA-16356. - Fix Version/s: 3.8.0 Resolution: Fixed > Remove class-name dispatch in

Re: [DISCUSS] KIP-936 Throttle number of active PIDs

2024-05-06 Thread Justine Olshan
Hi Claude, I can clarify my comments. Just to clarify -- my understanding is that we don't intend to throttle any new producer IDs at the beginning. I believe this amount is specified by `producer_ids_rate`, but you can see this as a number of producer IDs per hour. So consider a case where

Re: [DISCUSS] KIP-924: customizable task assignment for Streams

2024-05-06 Thread Sophie Blee-Goldman
Thanks guys. Updated the error codes in both the code and the explanation under "Public Changes". To sum up, here are the error codes listed in the KIP: enum AssignmentError { NONE, ACTIVE_TASK_ASSIGNED_MULTIPLE_TIMES, ACTIVE_AND_STANDBY_TASK_ASSIGNED_TO_SAME_KAFKASTREAMS,

[jira] [Resolved] (KAFKA-16470) kafka-dump-log --offsets-decoder should support new records

2024-05-06 Thread Chia-Ping Tsai (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-16470. Fix Version/s: 3.8.0 Resolution: Fixed > kafka-dump-log --offsets-decoder should

[jira] [Resolved] (KAFKA-16608) AsyncKafkaConsumer doesn't honor interrupted thread status on KafkaConsumer.poll(Duration)

2024-05-06 Thread Chia-Ping Tsai (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-16608. Fix Version/s: 3.8.0 Resolution: Fixed > AsyncKafkaConsumer doesn't honor

request permissions to contribute to Kafka

2024-05-06 Thread Zhisheng Zhang
Hi I'd like to request permissions to contribute to Kafka to propose a KIP Wiki ID:zhangzhisheng Jira ID:zhangzhisheng Thank you

[jira] [Created] (KAFKA-16677) Replace ClusterType#ALL and ClusterType#DEFAULT by Array

2024-05-06 Thread Chia-Ping Tsai (Jira)
Chia-Ping Tsai created KAFKA-16677: -- Summary: Replace ClusterType#ALL and ClusterType#DEFAULT by Array Key: KAFKA-16677 URL: https://issues.apache.org/jira/browse/KAFKA-16677 Project: Kafka

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #2877

2024-05-06 Thread Apache Jenkins Server
See

Re: request permissions to contribute to Kafka

2024-05-06 Thread Luke Chen
Hi Zhisheng, I've granted your permission. Thank you. Luke On Tue, May 7, 2024 at 10:25 AM Zhisheng Zhang <31791909...@gmail.com> wrote: > Hi > > I'd like to request permissions to contribute to Kafka to propose a KIP > > Wiki ID:zhangzhisheng > Jira ID:zhangzhisheng > > Thank you >