[jira] [Reopened] (KAFKA-15777) Configurable remote fetch bytes per partition from Consumer

[ https://issues.apache.org/jira/browse/KAFKA-15777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kamal Chandraprakash reopened KAFKA-15777: -- > Configurable remote fetch bytes per partition from Consumer > --

[jira] [Created] (KAFKA-19249) Replace Consumer#close(Duration) with Consumer#close(CloseOptions)

TengYao Chi created KAFKA-19249: --- Summary: Replace Consumer#close(Duration) with Consumer#close(CloseOptions) Key: KAFKA-19249 URL: https://issues.apache.org/jira/browse/KAFKA-19249 Project: Kafka

Re: [DISCUSS] KIP-1176: Tiered Storage for Active Log Segment

Hi Henry and Tom, I've read the entire KIP-1176, and I think it's a smart move to advance tiered storage. If I understand correctly, KIP-1176 aims to eliminate cross-AZ traffic in tier 1 storage by replicating data to followers through the S3EOZ bucket. After that, followers only need to replicat

Jenkins build is still unstable: Kafka » Kafka PowerPC Daily » test-powerpc #290

See

Re: [DISCUSS] KIP-1153: Kafka Streams `CloseOptions` should not have a public constructor

Thanks for the update! I think this is looking good now, my only feedback would be to update the KIP title as well to reflect these latest changes. Feel free to pick one yourself but if you want a suggestion, maybe something like "Redo Kafka Streams CloseOptions in fluent style" or similar. Let's

Re: [DISCUSS] KIP-1176: Tiered Storage for Active Log Segment

Christo, In terms of supporting transactional messages, I looked at the current FetchRequest/Response code, looks like for follower fetch it's always fetching to the LOG_END offset (while for consumer fetch there is a choice of fetch up to HIGH_WATERMARK vs fetch  up to TXN_COMMITTED) , since o

Re: [VOTE] KIP-1139: Add support for OAuth jwt-bearer grant type

Hi all, KIP-1139 has been accepted with 3 binding votes (Jun, Lianet, and Manikumar). Voting is now closed. Thanks all for your input, feedback, and improvements! Thanks, Kirk On Tue, May 6, 2025, at 4:13 AM, Lianet M. wrote: > Thanks for the KIP Kirk, > > +1 (binding) > > Lianet > > > On

Performance testing bug in KAFKA-18115

Hi all – I’d like to bring up about a small bug in performance testing [1] – about misusing String. The pull request [2] is available for a while now, with CI approved and some reviews done (one from myself). As far as I can tell, it’s pending a committer review. Would someone from the commit

Re: [DISCUSS] KIP-1150 Diskless Topics

Chia-Ping, Thanks for looking into our proposal (KIP-1176).  We have a preliminary prototype running in our cluster, there are still some bugs and enhancements we want to make to make it more mature.  Given there are multiple KIPs proposed in this area, we want to share our proposal to the comm

Re: [DISCUSS] KIP-1176: Tiered Storage for Active Log Segment

Christo, Thanks for your detailed comments and see my answer below inline. On Tuesday, May 6, 2025 at 02:40:29 AM PDT, Christo Lolov wrote: Hello! It is great to see another proposal on the same topic, but optimising for different scenarios, so thanks a lot for the effort put in this!

RE: [VOTE] KIP-1157: Enforce KafkaPrincipalSerde Implementation for KafkaPrincipalBuilder

+1 (non-binding) Yunyung On 2025/05/05 08:03:12 Johnny Wang wrote: > Hi all, > I would like to call a vote for KIP-1157. > https://cwiki.apache.org/confluence/x/1gq9F > > This KIP proposes to enforce the implementation of KafkaPrincipalSerde > alongside KafkaPrincipalBuilder, which is currently o

Re: [DISCUSS] KIP-1161: cleanup.policy shouldn't be empty

Hi, Jiunn-Yang, Thanks for the updated KIP. It looks good to me. Jun On Tue, May 6, 2025 at 4:58 AM 黃竣陽 wrote: > Hi Jun, chia > > Thanks for all the comments. They have all been addressed in the updated > KIP. > > I've removed all deprecated-related sections. Additionally, an exception > will

[jira] [Created] (KAFKA-19248) Plugins Test for Multiversioning in Kafka Connect

Snehashis Pal created KAFKA-19248: - Summary: Plugins Test for Multiversioning in Kafka Connect Key: KAFKA-19248 URL: https://issues.apache.org/jira/browse/KAFKA-19248 Project: Kafka Issue Typ

[jira] [Resolved] (KAFKA-18988) Updates to connector status and connector metrics

[ https://issues.apache.org/jira/browse/KAFKA-18988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Snehashis Pal resolved KAFKA-18988. --- Fix Version/s: 4.1.0 Resolution: Fixed > Updates to connector status and connector me

[jira] [Resolved] (KAFKA-19247) Move SchedulerTest to server-common module

[ https://issues.apache.org/jira/browse/KAFKA-19247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] 黃竣陽 resolved KAFKA-19247. - Resolution: Duplicate Duplicate with KAFKA-19182 > Move SchedulerTest to server-common module > ---

[jira] [Created] (KAFKA-19247) Move SchedulerTest to server-common module

黃竣陽 created KAFKA-19247: --- Summary: Move SchedulerTest to server-common module Key: KAFKA-19247 URL: https://issues.apache.org/jira/browse/KAFKA-19247 Project: Kafka Issue Type: Improvement

Re: [DISCUSS] KIP-1176: Tiered Storage for Active Log Segment

Hi Christo, Thanks for your feedback! Responding as a co-author to some of these items: For acks=-1, it's true with AZ failure S3E1Z data could be lost. In this case, we can use option 1 "The leader broker will wait until all in-sync follower replicas have reached the given offset before the ackn

Re: [PR] KAFKA-19209: Clarify index.interval.bytes impact on offset and time index [kafka-site]

shmily7829 commented on code in PR #686: URL: https://github.com/apache/kafka-site/pull/686#discussion_r2075855172 ## 40/generated/topic_config.html: ## @@ -111,7 +111,12 @@ index.interval.bytes -This setting controls how frequently Kafka adds an index entry to its offset index

[jira] [Resolved] (KAFKA-19228) `kafka-storage format` should not support explicitly setting kraft.version feature level

[ https://issues.apache.org/jira/browse/KAFKA-19228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Wu resolved KAFKA-19228. -- Resolution: Won't Fix Closing with won't fix, since although the current behavior is undesirable UX,

Re: [DISCUSS] KIP-1139: Add support for OAuth jwt-bearer grant type

Great, thank you On Mon, May 5, 2025 at 9:20 PM Kirk True wrote: > Hi Emanuele, > > The inability to generate the assertion will ultimately end up as a > javax.security.auth.login.LoginException. The OAuth layer uses the same > error handling as the other Kafka client security plugins. > > Thank

Code Review KAFKA-18336 jmh tests

Hi Could someone make a review? https://github.com/apache/kafka/pull/18293 Issue - https://issues.apache.org/jira/browse/KAFKA-18336 Take a note jmh tests run for approx 15 hours With best regards Kuvardin Evgeny

[jira] [Resolved] (KAFKA-19207) Move ForwardingManagerMetrics and ForwardingManagerMetricsTest to server module

[ https://issues.apache.org/jira/browse/KAFKA-19207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-19207. Fix Version/s: 4.1.0 Resolution: Fixed > Move ForwardingManagerMetrics and Forwardi

[jira] [Resolved] (KAFKA-19170) Migrate MetricsDuringTopicCreationDeletionTest to clients-integration-tests module

[ https://issues.apache.org/jira/browse/KAFKA-19170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-19170. Fix Version/s: 4.1.0 Resolution: Fixed > Migrate MetricsDuringTopicCreationDeletion

Re: [DISCUSS] KIP-1161: cleanup.policy shouldn't be empty

Hi Jun, chia Thanks for all the comments. They have all been addressed in the updated KIP. I've removed all deprecated-related sections. Additionally, an exception will now be thrown if a developer passes an empty validStrings list to the inNonEmpty method. Best Regards, Jiunn-Yang > Chia-Pin

Re: [DISCUSS] KIP-1159: Large message reference based Serializer

Hi Kirk, thanks for having time to look into this, > KT1: In PayloadReferenceValue, Is "payloadStoreClass" intended to be a > fully-qualified Java class name, or something else? I'm considering the case > where a Producer and/or Consumer are using a non-Java-based client. This would be any stri

Re: [VOTE] KIP-1139: Add support for OAuth jwt-bearer grant type

Thanks for the KIP Kirk, +1 (binding) Lianet On Tue, May 6, 2025, 4:23 a.m. Manikumar wrote: > Thanks for the detailed KIP. > +1 (binding) > > Thanks, > > On Tue, May 6, 2025 at 3:24 AM Jun Rao wrote: > > > Hi, Kirk, > > > > Thanks for the KIP. +1 > > > > Jun > > > > On Fri, May 2, 2025 at 9

Re: [VOTE] KIP-1130: Add metrics indicating the connection count exceeds

+1 (non-binding) Best, PoAn > On May 6, 2025, at 6:42 PM, 黃竣陽 wrote: > > +1 (non-binding) > > Best Regards, > Jiunn-Yang > >> Kuan Po Tseng 於 2025年5月6日 凌晨12:31 寫道： >> >> +1(non-binding), thanks for the KIP! >> >> Best, >> Kuan-Po Tseng >> >> On 2025/05/05 07:02:04 TengYao Chi wrote: >>> H

Re: [VOTE] KIP-1130: Add metrics indicating the connection count exceeds

+1 (non-binding) Best Regards, Jiunn-Yang > Kuan Po Tseng 於 2025年5月6日 凌晨12:31 寫道： > > +1(non-binding), thanks for the KIP! > > Best, > Kuan-Po Tseng > > On 2025/05/05 07:02:04 TengYao Chi wrote: >> Hello everyone, >> >> I would like to call a vote for KIP-1130 >>

[jira] [Resolved] (KAFKA-19218) Add missing leader epoch to read share group state summary response

[ https://issues.apache.org/jira/browse/KAFKA-19218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Schofield resolved KAFKA-19218. -- Fix Version/s: 4.1.0 Resolution: Fixed > Add missing leader epoch to read share

Re: [DISCUSS] KIP-1176: Tiered Storage for Active Log Segment

Hello! It is great to see another proposal on the same topic, but optimising for different scenarios, so thanks a lot for the effort put in this! I have a few questions and statements in no particular order. If you use acks=-1 (acks=all) then an acknowledgement can only be sent to the producer i

[jira] [Resolved] (KAFKA-19227) Fix performance for share fetch with piggyback acknowledgements

[ https://issues.apache.org/jira/browse/KAFKA-19227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apoorv Mittal resolved KAFKA-19227. --- Fix Version/s: 4.1.0 Resolution: Fixed > Fix performance for share fetch with piggyba

Re: [DISCUSS] KIP-1150 Diskless Topics

hi Henry Haiying Cai Thanks for sharing the cool idea. Out of curiosity, do you already have an implementation running in your cluster? Best, Chia-Ping On 2025/05/06 05:56:28 Henry Haiying Cai wrote: > If it's not too late into the party, we (Slack/Salesforce) also have > submitted KIP-1176:

[jira] [Created] (KAFKA-19246) OffsetFetch API does not return group level errors correctly with version 1

David Jacot created KAFKA-19246: --- Summary: OffsetFetch API does not return group level errors correctly with version 1 Key: KAFKA-19246 URL: https://issues.apache.org/jira/browse/KAFKA-19246 Project: Ka

Re: [VOTE] 3.9.1 RC1

Hi Justine, Thank you for your validation. Nice catch for the documentation issue! We'll fix it soon. Thank you. Luke On Sat, May 3, 2025 at 3:12 AM Justine Olshan wrote: > Hey folks, > Thanks again for your patience! > > I've done the following validations: > * Verified signatures > * Built

Re: [VOTE] KIP-1139: Add support for OAuth jwt-bearer grant type

Thanks for the detailed KIP. +1 (binding) Thanks, On Tue, May 6, 2025 at 3:24 AM Jun Rao wrote: > Hi, Kirk, > > Thanks for the KIP. +1 > > Jun > > On Fri, May 2, 2025 at 9:15 AM Kirk True wrote: > > > Hi, > > > > Thanks to all who provided feedback on KIP-1139: Add support for OAuth > > jwt-be

[jira] [Created] (KAFKA-19245) Update defaults for preview of queues configurations

Apoorv Mittal created KAFKA-19245: - Summary: Update defaults for preview of queues configurations Key: KAFKA-19245 URL: https://issues.apache.org/jira/browse/KAFKA-19245 Project: Kafka Issue