Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #2816

2024-04-15 Thread Apache Jenkins Server
See Changes: -- [...truncated 472154 lines...] [2024-04-16T03:44:32.447Z] > Task :connect:json:testClasses UP-TO-DATE [2024-04-16T03:44:32.447Z] > Task

Jenkins build is still unstable: Kafka » Kafka Branch Builder » 3.7 #136

2024-04-15 Thread Apache Jenkins Server
See

Re: [DISCUSS] KIP-1036: Extend RecordDeserializationException exception

2024-04-15 Thread Almog Gavra
Hi Frederik - thanks for the KIP, this will be a fantastic and elegant addition to Kafka Streams. I have a higher level question about this, which is that the `poll` interface returns multiple records and yet the DeserializationException will be thrown if any record in the batch cannot be

Re: [DISCUSS] KIP-932: Queues for Kafka

2024-04-15 Thread Jun Rao
Hi, Andrew, Thanks for the updated KIP. 42.1 "If the share group offset is altered multiple times when the group remains empty, it would be harmless if the same state epoch was reused to initialize the state." Hmm, how does the partition leader know for sure that it has received the latest share

[jira] [Created] (KAFKA-16558) Implement HeartbeatRequestState.toStringBase()

2024-04-15 Thread Kirk True (Jira)
Kirk True created KAFKA-16558: - Summary: Implement HeartbeatRequestState.toStringBase() Key: KAFKA-16558 URL: https://issues.apache.org/jira/browse/KAFKA-16558 Project: Kafka Issue Type: Bug

[jira] [Created] (KAFKA-16557) Fix CommitRequestManager’s OffsetFetchRequestState.toString()

2024-04-15 Thread Kirk True (Jira)
Kirk True created KAFKA-16557: - Summary: Fix CommitRequestManager’s OffsetFetchRequestState.toString() Key: KAFKA-16557 URL: https://issues.apache.org/jira/browse/KAFKA-16557 Project: Kafka

[jira] [Created] (KAFKA-16556) Race condition between ConsumerRebalanceListener and SubscriptionState

2024-04-15 Thread Kirk True (Jira)
Kirk True created KAFKA-16556: - Summary: Race condition between ConsumerRebalanceListener and SubscriptionState Key: KAFKA-16556 URL: https://issues.apache.org/jira/browse/KAFKA-16556 Project: Kafka

[jira] [Created] (KAFKA-16555) Consumer's RequestState has incorrect logic to determine if inflight

2024-04-15 Thread Kirk True (Jira)
Kirk True created KAFKA-16555: - Summary: Consumer's RequestState has incorrect logic to determine if inflight Key: KAFKA-16555 URL: https://issues.apache.org/jira/browse/KAFKA-16555 Project: Kafka

Re: [VOTE] KIP-1022 Formatting and Updating Features

2024-04-15 Thread Justine Olshan
Hey folks, Thanks everyone! I will go ahead and call it. The KIP passes with the following +1 votes: - Andrew Schofield (non-binding) - David Jacot (binding) - José Armando García Sancio (binding) - Jun Rao (binding) Thanks again, Justine On Fri, Apr 12, 2024 at 11:16 AM Jun Rao wrote: > Hi,

Re:[ANNOUNCE] New Kafka PMC Member: Greg Harris

2024-04-15 Thread Hector Geraldino (BLOOMBERG/ 919 3RD A)
Congrats! Well deserved From: dev@kafka.apache.org At: 04/13/24 14:42:22 UTC-4:00To: dev@kafka.apache.org Subject: [ANNOUNCE] New Kafka PMC Member: Greg Harris Hi all, Greg Harris has been a Kafka committer since July 2023. He has remained very active and instructive in the community since

[jira] [Created] (KAFKA-16554) Online downgrade triggering and group type conversion

2024-04-15 Thread Dongnuo Lyu (Jira)
Dongnuo Lyu created KAFKA-16554: --- Summary: Online downgrade triggering and group type conversion Key: KAFKA-16554 URL: https://issues.apache.org/jira/browse/KAFKA-16554 Project: Kafka Issue

Re: [DISCUSS] KIP-932: Queues for Kafka

2024-04-15 Thread Andrew Schofield
Hi David, Thanks for reviewing the KIP and your comments. 001: I think the `group.type` is the area of the KIP that has had the most comments. I think you’re right that a better approach would be to make the creation of the group explicit, for users who want that. I have removed `group.type`

Re: [DISCUSS] KIP-1035: StateStore managed changelog offsets

2024-04-15 Thread Nick Telford
Hi Sophie, Interesting idea! Although what would that mean for the StateStore interface? Obviously we can't require that the constructor take the TaskId. Is it enough to add the parameter to the StoreSupplier? Would doing this be in-scope for this KIP, or are we over-complicating it? Nick On

Re: [DISCUSS] KIP-936 Throttle number of active PIDs

2024-04-15 Thread Omnia Ibrahim
Hi Claude, Thanks for the implementation of the LayeredBloomFilter in apache commons. > Define a new configuration option "producer.id.quota.window.count" as > the number of windows active in window.size.seconds. What is the different between “producer.id.quota.window.count” and

Re: [VOTE] KIP-899: Allow producer and consumer clients to rebootstrap

2024-04-15 Thread Andrew Schofield
Thanks for the KIP +1 (non-binding) Andrew > On 15 Apr 2024, at 14:16, Chris Egerton wrote: > > Hi Ivan, > > Thanks for the KIP. After the recent changes, this LGTM. +1 (binding) > > Cheers, > > Chris > > On Wed, Aug 2, 2023 at 12:15 AM Ivan Yurchenko > wrote: > >> Hello, >> >> The discussion

Re: [DISCUSS] KIP-932: Queues for Kafka

2024-04-15 Thread David Jacot
Hi Andrew, Thanks for the KIP. This work is really exciting. I finally had a bit of time to go through the KIP. I need to read it a second time in order to get into the details. I have noted a few points/questions: 001: The dynamic config to force the group type is really weird. As you said,

Re: [VOTE] KIP-899: Allow producer and consumer clients to rebootstrap

2024-04-15 Thread Chris Egerton
Hi Ivan, Thanks for the KIP. After the recent changes, this LGTM. +1 (binding) Cheers, Chris On Wed, Aug 2, 2023 at 12:15 AM Ivan Yurchenko wrote: > Hello, > > The discussion [1] for KIP-899 [2] has been open for quite some time. I'd > like to put the KIP up for a vote. > > Best, > Ivan > >

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #2814

2024-04-15 Thread Apache Jenkins Server
See

[jira] [Created] (KAFKA-16553) log controller configs when startup

2024-04-15 Thread Chia-Ping Tsai (Jira)
Chia-Ping Tsai created KAFKA-16553: -- Summary: log controller configs when startup Key: KAFKA-16553 URL: https://issues.apache.org/jira/browse/KAFKA-16553 Project: Kafka Issue Type:

Re: [DISCUSS] KIP-950: Tiered Storage Disablement

2024-04-15 Thread Christo Lolov
Heya Doguscan, I believe that the state of the world after this KIP will be the following: For Zookeeper-backed clusters there will be 3 states: ENABLED, DISABLING and DISABLED. We want this because Zookeeper-backed clusters will await a confirmation from the brokers that they have indeed

Re: [DISCUSS] KIP-1037: Allow WriteTxnMarkers API with Alter Cluster Permission

2024-04-15 Thread Christo Lolov
Heya Nikhil, Thank you for raising this KIP! Your proposal makes sense to me. In essence you are saying that the permission required by WriteTxnMarkers should be the same as for CreateAcls and DeleteAcls, which is reasonable. If we trust an administrator to assign the correct permissions then we

[jira] [Resolved] (KAFKA-15230) ApiVersions data between controllers is not reliable

2024-04-15 Thread Chia-Ping Tsai (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-15230. Fix Version/s: (was: 3.7.0) Resolution: Duplicate this is fixed by

[jira] [Reopened] (KAFKA-15230) ApiVersions data between controllers is not reliable

2024-04-15 Thread Chia-Ping Tsai (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai reopened KAFKA-15230: reopen to make it as duplicate > ApiVersions data between controllers is not reliable >

[jira] [Resolved] (KAFKA-15369) Allow AdminClient to Talk Directly with the KRaft Controller Quorum and add Controller Registration

2024-04-15 Thread Chia-Ping Tsai (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-15369. Fix Version/s: 3.7.0 Assignee: Colin McCabe Resolution: Fixed > Allow

Re: [ANNOUNCE] New Kafka PMC Member: Greg Harris

2024-04-15 Thread Christo Lolov
Congratulations, Greg :) On Mon, 15 Apr 2024 at 07:34, Zhisheng Zhang <31791909...@gmail.com> wrote: > Congratulations Greg! > > > Manikumar 于2024年4月15日周一 13:49写道: > > > Congratulations, Greg. > > > > On Mon, Apr 15, 2024 at 11:18 AM Bruno Cadonna > wrote: > > > > > > Congratulations, Greg! >

[jira] [Created] (KAFKA-16552) Create an internal config to control InitialTaskDelayMs in LogManager to speed up tests

2024-04-15 Thread Luke Chen (Jira)
Luke Chen created KAFKA-16552: - Summary: Create an internal config to control InitialTaskDelayMs in LogManager to speed up tests Key: KAFKA-16552 URL: https://issues.apache.org/jira/browse/KAFKA-16552

Re: [DISCUSS] KIP-936 Throttle number of active PIDs

2024-04-15 Thread Claude Warren
After thinking about his KIP over the weekend I think that there is another lighter weight approach. I think the question is not whether or not we have seen a given PID before but rather how many unique PIDs did the principal create in the last hour. Perhaps more exactly it is: did the Principal

[jira] [Created] (KAFKA-16551) add integration test for ClusterTool

2024-04-15 Thread Chia-Ping Tsai (Jira)
Chia-Ping Tsai created KAFKA-16551: -- Summary: add integration test for ClusterTool Key: KAFKA-16551 URL: https://issues.apache.org/jira/browse/KAFKA-16551 Project: Kafka Issue Type: Test

[jira] [Created] (KAFKA-16550) add integration test for LogDirsCommand

2024-04-15 Thread Chia-Ping Tsai (Jira)
Chia-Ping Tsai created KAFKA-16550: -- Summary: add integration test for LogDirsCommand Key: KAFKA-16550 URL: https://issues.apache.org/jira/browse/KAFKA-16550 Project: Kafka Issue Type: Test

[jira] [Resolved] (KAFKA-16490) Upgrade gradle from 8.6 to 8.7

2024-04-15 Thread Chia-Ping Tsai (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-16490. Fix Version/s: 3.8.0 Resolution: Fixed > Upgrade gradle from 8.6 to 8.7 >

[jira] [Created] (KAFKA-16549) suppress the warnings from RemoteLogManager

2024-04-15 Thread Chia-Ping Tsai (Jira)
Chia-Ping Tsai created KAFKA-16549: -- Summary: suppress the warnings from RemoteLogManager Key: KAFKA-16549 URL: https://issues.apache.org/jira/browse/KAFKA-16549 Project: Kafka Issue Type:

Re: [DISCUSS] KIP-1028: Docker Official Image for Apache Kafka

2024-04-15 Thread Manikumar
Hi Krish, Thanks for the updated KIP. a few comments below. > "These actions can be carried out by the RM or any contributor post the > release process." Maybe as part of the release process, RM can create a JIRA for this task. This can be taken by RM or any comitter or any contributor (with

Re: [ANNOUNCE] New Kafka PMC Member: Greg Harris

2024-04-15 Thread Zhisheng Zhang
Congratulations Greg! Manikumar 于2024年4月15日周一 13:49写道: > Congratulations, Greg. > > On Mon, Apr 15, 2024 at 11:18 AM Bruno Cadonna wrote: > > > > Congratulations, Greg! > > > > Best, > > Bruno > > > > On 4/15/24 7:33 AM, Claude Warren wrote: > > > Congrats Greg! All the hard work paid off. >