[jira] [Created] (KAFKA-19810) Kafka streams with chained emitStrategy(onWindowClose) example does not work

2025-10-18 Thread Greg F (Jira)
Greg F created KAFKA-19810: -- Summary: Kafka streams with chained emitStrategy(onWindowClose) example does not work Key: KAFKA-19810 URL: https://issues.apache.org/jira/browse/KAFKA-19810 Project: Kafka

Jenkins build is still unstable: Kafka » Kafka PowerPC Daily » test-powerpc #455

2025-10-18 Thread Apache Jenkins Server
See

[jira] [Created] (KAFKA-19790) Parsing of the scope claim does not comply with RFC-8693

2025-10-18 Thread Keith Wall (Jira)
Keith Wall created KAFKA-19790: -- Summary: Parsing of the scope claim does not comply with RFC-8693 Key: KAFKA-19790 URL: https://issues.apache.org/jira/browse/KAFKA-19790 Project: Kafka Issue Ty

Re: [VOTE] KIP-1066: Mechanism to cordon brokers and log directories

2025-10-18 Thread PoAn Yang
Hi, +1 (binding). Thanks for the KIP. Best, PoAn > On Oct 6, 2025, at 9:00 PM, Mickael Maison wrote: > > Hi, > > Bumping this thread again. We're still missing 1 binding vote. > > Thanks, > Mickael > > On Thu, Sep 25, 2025 at 6:09 AM Christo Lolov wrote: >> >> Hello, >> >> +1 (binding) f

Re: [DISCUSS] KIP-1176: Tiered Storage for Active Log Segment

2025-10-18 Thread Thomas Thornton
Hi Jun, Thank you for the feedback and thorough discussion on this. JR1: > I feel there are lots of details left out in the KIP to fully understand the correctness and availability. For example, how does the leader decide which data to republish to S31Z in a different AZ? If the metadata for tho

[VOTE] KIP-1206: Strict max fetch records in share fetch

2025-10-18 Thread Wang Jimmy
Hi, I'd like to start a vote on KIP-1206: Strict max fetch records in share fetch: https://cwiki.apache.org/confluence/x/p4mhFg The discussion thread is here: https://lists.apache.org/thread/9fn7n7n3wys9y6olmcz5p56q9n3tp45v Thanks, Jimmy Wang

Re: Weird behavior on Kafka Connect class loading

2025-10-18 Thread Martin Andersson
Hello Mario. I didn't look into this in detail, but are you using the new plugin discovery mechanism? https://kafka.apache.org/documentation/#connectconfigs_plugin.discovery Regards, From: Mario Fiore Vitale Sent: Friday, October 3, 2025 17:14 To: [email protected]

Re: Weird behavior on Kafka Connect class loading

2025-10-18 Thread Mario Fiore Vitale
Hi Martin, I'm using the default but I also tried with the other options and nothing changed. In any case I reported the issue and it seems that we found the root cause. https://issues.apache.org/jira/browse/KAFKA-19758 Regards, Mario. On Tue, Oct 7, 2025 at 2:36 PM Martin Andersson wrote: >

[jira] [Created] (KAFKA-19771) Upgrade SpotBugs (and enable checks for Java 25)

2025-10-18 Thread Jira
Dejan Stojadinović created KAFKA-19771: -- Summary: Upgrade SpotBugs (and enable checks for Java 25) Key: KAFKA-19771 URL: https://issues.apache.org/jira/browse/KAFKA-19771 Project: Kafka

Re: [DISCUSS] KIP-1228: Add Transaction Version to WriteTxnMarkersRequest

2025-10-18 Thread Artem Livshits
Hi Ritika, Thanks for the KIP! The proposal makes sense to me. I have one clarification question, in the rejected alternatives the first alternative says "However, its state is cleared after the first control record is written". Is this the control record or the first batch? -Artem On Tue, Oc

Re: [VOTE] KIP-1217: Include push interval in ClientTelemetryReceiver context

2025-10-18 Thread Apoorv Mittal
Hi Mickael, Thanks for the KIP, it seems right to add push interval details in the context and replace old interfaces. +1 (binding) Regards, Apoorv Mittal On Mon, Sep 29, 2025 at 3:15 PM Andrew Schofield < [email protected]> wrote: > Hi Mickael, > Thanks for the KIP. > > +1 (bi

[PR] AK 4.1 updates [kafka-site]

2025-10-18 Thread via GitHub
hvishwanath opened a new pull request, #727: URL: https://github.com/apache/kafka-site/pull/727 (no comment) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe,

[jira] [Created] (KAFKA-19728) Disk space is not being freed

2025-10-18 Thread Jianbin Chen (Jira)
Jianbin Chen created KAFKA-19728: Summary: Disk space is not being freed Key: KAFKA-19728 URL: https://issues.apache.org/jira/browse/KAFKA-19728 Project: Kafka Issue Type: Wish Affects Ve

Re: [EXT] Re: [DISCUSS] KIP-1225: Add Optional TTL Support to Kafka Streams State Stores

2025-10-18 Thread Ankur Sinha
I agree, sole point summarizes to very basic point that KStreams is pure Java, so it can call a JNI bridge to access native RocksDB compaction filter and shiping the native JNI code inside streams would be possible but very tricky and will surely add cross platform build complexity, extra maint

Account request follow-up for Kafka JIRA access

2025-10-18 Thread Abdelkader Messeguem
Hello Kafka dev team, I recently requested an account on the Kafka JIRA to submit and discuss an idea related to state management and persistence improvements in Kafka-based applications. I just wanted to check if my request is being processed, or if you need any additional information from me.

[VOTE] KIP-1170: Unify cluster metadata bootstrapping

2025-10-18 Thread José Armando García Sancio
Hi all, I would like to starting the voting for KIP-1170: Unify cluster metadata bootstrapping: https://cwiki.apache.org/confluence/x/ZYoEFQ The discussion thread is here: https://lists.apache.org/thread/mb98kw1qjq2hb0ksj14d3thz3g50x9ck Thanks -- -José

[VOTE] KIP-1221 adding application-id to Kafka Streams client state metric

2025-10-18 Thread Bill Bejeck
Hi All, Since KIP-1221 proposes a simple and straightforward change, I'm going to start a vote now. KIP-1221 Discussion thread

Re: [DISCUSS] KIP-19759: Add built-in TTL (Time-to-Live) support for Kafka Streams State Stores

2025-10-18 Thread Matthias J. Sax
If you want to start a KIP, you need to write one :) A Jira ticket is not a KIP https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Improvement+Proposals -Matthias On 10/6/25 10:26 AM, Ankur Sinha wrote: Hi all, I’d like to start the discussion for KAFKA-19759: Add built-in TTL (Time-t

Re: [VOTE] KIP-1136: Make ConsumerGroupMetadata an interface

2025-10-18 Thread Lianet M.
Thanks for the KIP! The private constructor approach would surely have been clearer to the users, but agree that it's out of our reach given the code structure we currently have. I would suggest we add a note to the KIP alternatives about the sealed approach Chia suggested, that surely would be 2n

[jira] [Created] (KAFKA-19774) Mechanism to cordon brokers and log directories

2025-10-18 Thread Mickael Maison (Jira)
Mickael Maison created KAFKA-19774: -- Summary: Mechanism to cordon brokers and log directories Key: KAFKA-19774 URL: https://issues.apache.org/jira/browse/KAFKA-19774 Project: Kafka Issue Typ

[Vote] KIP-1206: Strict max fetch records in share fetch

2025-10-18 Thread Wang Jimmy
Hi, I'd like to start a vote on KIP-1206: Strict max fetch records in share fetch: https://cwiki.apache.org/confluence/x/p4mhFg The discussion thread is here: https://lists.apache.org/thread/9fn7n7n3wys9y6olmcz5p56q9n3tp45v Thanks, Jimmy Wang

Re: [VOTE] KIP-1224: Adaptive append.linger.ms for the group coordinator and share coordinator

2025-10-18 Thread Lianet M.
+1 (binding) Best, Lianet On Thu, Oct 16, 2025 at 8:49 AM David Jacot wrote: > > +1 (binding) > > On Thu, Oct 16, 2025 at 12:00 PM Sean Quah > wrote: > > > Hi, > > > > I would like to start a vote on KIP-1224: Adaptive append.linger.ms for > > the > > group coordinator and share coordinator. >

[jira] [Resolved] (KAFKA-19787) kafka server ClusterAuthorization don't support acks=-1 for kafka-client version>3.1.0

2025-10-18 Thread zhuming (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-19787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhuming resolved KAFKA-19787. - Resolution: Abandoned > kafka server ClusterAuthorization don't support acks=-1 for kafka-client > vers

[jira] [Resolved] (KAFKA-19478) Optimize sticky assignor

2025-10-18 Thread Lucas Brutschy (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-19478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lucas Brutschy resolved KAFKA-19478. Resolution: Fixed > Optimize sticky assignor > > >

Re: [PR] Minor: Add blog and downloads for 4.0.1 [kafka-site]

2025-10-18 Thread via GitHub
clolov commented on code in PR #731: URL: https://github.com/apache/kafka-site/pull/731#discussion_r2426450629 ## downloads.html: ## @@ -13,68 +13,67 @@ Download Supported releases - -4.1.0 + Review Comment: Agreed, moving back to

[VOTE] KIP-1196: Introduce group.coordinator.append.max.bytes config

2025-10-18 Thread Lan Ding
Hi, I'd like to start a vote on KIP-1196: Introduce group.coordinator.append.max.bytes config: https://cwiki.apache.org/confluence/x/hA5JFg Thanks, Lan

Re: [VOTE] KIP-1205: Improve RecordHeader to be Thread-Safe

2025-10-18 Thread Andrew Schofield
Thanks for the KIP. +1 (binding) > On 10 Oct 2025, at 17:15, Bill Bejeck wrote: > > Thanks for the KIP! Nice fix, plus I appreciate the completeness regarding > thread-safety. > > +1 (binding) > > On Sat, Sep 13, 2025 at 6:57 PM Chia-Ping Tsai wrote: > >> +1 (binding) >> >> Ming-Yen Chung 於 20

[jira] [Created] (KAFKA-19758) Weird behavior on Kafka Connect 4.1 class loading

2025-10-18 Thread Mario Fiore Vitale (Jira)
Mario Fiore Vitale created KAFKA-19758: -- Summary: Weird behavior on Kafka Connect 4.1 class loading Key: KAFKA-19758 URL: https://issues.apache.org/jira/browse/KAFKA-19758 Project: Kafka

[DISCUSS] KIP-1228: Add Transaction Version to WriteTxnMarkersRequest

2025-10-18 Thread Ritika Reddy
Hi All, I would like to start a discussion thread for KIP-1228. It's a relatively simple change and would really help strengthen EOS guarantees in Kafka. KIP Link - https://cwiki.apache.org/confluence/display/KAFKA/KIP-1228%3A+Add+Transaction+Version+to+WriteTxnMarkersRequest JIRA - https://issues.

Re: [VOTE] KIP-1170: Unify cluster metadata bootstrapping

2025-10-18 Thread Alyssa Huang
Thanks Jose for the KIP! +1 (non-binding) On Mon, Sep 29, 2025 at 8:39 AM José Armando García Sancio wrote: > Hi all, > > I would like to starting the voting for KIP-1170: Unify cluster > metadata bootstrapping: https://cwiki.apache.org/confluence/x/ZYoEFQ > > The discussion thread is here: > h

Re: Re: [DISCUSS] KIP-1206: Strict max fetch records in share fetch

2025-10-18 Thread Andrew Schofield
Hi Jimmy, Sorry for the long delay responding to the KIP. I think it's important to be careful with the refinements to KIP-932, so I'm taking my time to make sure whatever we do is good. There are good reasons why KIP-932 optimised for batch delivery, but I know from talking to early users of the

[jira] [Created] (KAFKA-19744) restore metrics s calculated incorrectly

2025-10-18 Thread Nikita Shupletsov (Jira)
Nikita Shupletsov created KAFKA-19744: - Summary: restore metrics s calculated incorrectly Key: KAFKA-19744 URL: https://issues.apache.org/jira/browse/KAFKA-19744 Project: Kafka Issue Type

Re: [DISCUSS] KIP-1219: Configurations for KRaft Fetch and FetchSnapshot Byte Size

2025-10-18 Thread Kevin Wu
Hi Jonah, Thanks for this KIP! Being able to configure this would definitely help users with slower networks from unnecessary disruptive elections. I have a question about the new default you're proposing. > the behavioural change in this KIP primarily reducing the (current) 8MiB limit to 1MiB (s

[jira] [Created] (KAFKA-19767) Improve handling of long processing times

2025-10-18 Thread Andrew Schofield (Jira)
Andrew Schofield created KAFKA-19767: Summary: Improve handling of long processing times Key: KAFKA-19767 URL: https://issues.apache.org/jira/browse/KAFKA-19767 Project: Kafka Issue Type:

Jenkins build is still unstable: Kafka » Kafka Branch Builder » 3.9 #226

2025-10-18 Thread Apache Jenkins Server
See

[jira] [Created] (KAFKA-19734) Add application-id as a tag to the ClientState JMX metric

2025-10-18 Thread Bill Bejeck (Jira)
Bill Bejeck created KAFKA-19734: --- Summary: Add application-id as a tag to the ClientState JMX metric Key: KAFKA-19734 URL: https://issues.apache.org/jira/browse/KAFKA-19734 Project: Kafka Issue

Re: [VOTE] 4.0.1 RC2

2025-10-18 Thread Chia-Ping Tsai
+1 (binding) - run 4.0.1 cluster under JDK 21 - run e2e-latency test with 100GB - run all e2e tests - all pass after retry - run all integration tests - all pass Best, Chia-Ping On 2025/09/11 10:09:00 Christo Lolov wrote: > Hello Kafka users, developers and client-developers, > > This is the th

Re: [VOTE] KIP-1066: Mechanism to cordon brokers and log directories

2025-10-18 Thread Mickael Maison
Hi, Bumping the thread once more. Let me know if you have any feedback. Thanks, Mickael On Thu, Aug 28, 2025 at 9:36 PM Mickael Maison wrote: > > Hi, > > Bumping this thread, as I've addressed all the feedback in the DISCUSS thread. > > Thanks, > Mickael > > On Wed, Jul 16, 2025 at 4:44 PM Fede

Re: [DISCUSS] KIP-1219: Configurations for KRaft Fetch and FetchSnapshot Byte Size

2025-10-18 Thread Jonah Hooper
Thanks for the feedback José! Did some work to apply the KIP to a correct format. The motivation section starts with the solution without motivating the > problem. I think you want to delete the first paragraph in the > motivation section. Done. In the motivation section you have "non-terminati

Re: [DISCUSS] KIP-1228: Add Transaction Version to WriteTxnMarkersRequest

2025-10-18 Thread Ritika Reddy
Hey David, Thanks for the comments! 1) The plan was to originally use an API version bump for this, but we decided to use a tagged field so that we don't have to implement a new IBP. cc: @Artem Livshits 2) Yes, let me add that to the rejected alternatives section. On Wed, Oct 15, 2025 at 2:49 AM

Re: [Vote] KIP-1206: Strict max fetch records in share fetch

2025-10-18 Thread Lianet M.
Thanks for the KIP Jimmy! +1 (binding) Lianet On Wed, Oct 15, 2025 at 1:07 PM Apoorv Mittal wrote: > > Hi Jimmy, > Thanks for the KIP. > > +1 (binding) > > - Regards, > Apoorv Mittal > > > On 14 Oct 2025, at 14:02, Andrew Schofield > > wrote: > > > > Hi Jimmy, > > Thanks for the KIP. > > > >

[jira] [Resolved] (KAFKA-6333) java.awt.headless should not be on commandline

2025-10-18 Thread Mickael Maison (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-6333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mickael Maison resolved KAFKA-6333. --- Fix Version/s: 4.2.0 Resolution: Fixed > java.awt.headless should not be on commandlin

Re: [DISCUSS] KIP-1170: Unify cluster metadata bootstrapping

2025-10-18 Thread José Armando García Sancio
Hi David, Thanks for the feedback. See my comments below. On Mon, Sep 29, 2025 at 2:25 PM David Arthur wrote: > If we automatically rewrite the bootstrap checkpoint into the zero > checkpoint, does this limit how far back we can downgrade a controller's > binary? If the cluster has been activat

Re: [VOTE] KIP-1130: Add metrics indicating the connection count exceeds

2025-10-18 Thread Andrew Schofield
Hi, I could be wrong but I believe there are some comments on the DISCUSS thread which are not resolved. Thanks, Andrew From: PoAn Yang Sent: 06 May 2025 11:46 To: [email protected] Subject: Re: [VOTE] KIP-1130: Add metrics indicating the connection c

Re: [VOTE] KIP-1170: Unify cluster metadata bootstrapping

2025-10-18 Thread Luke Chen
Hi Jose, +1 (binding) from me. Thanks. Luke On Wed, Oct 1, 2025 at 3:02 AM Alyssa Huang wrote: > Thanks Jose for the KIP! > > +1 (non-binding) > > On Mon, Sep 29, 2025 at 8:39 AM José Armando García Sancio > wrote: > > > Hi all, > > > > I would like to starting the voting for KIP-1170: Unify

[jira] [Resolved] (KAFKA-12293) Remove JCenter and Bintray repositories mentions out of Gradle build (sunset is announced for those repositories)

2025-10-18 Thread Jira
[ https://issues.apache.org/jira/browse/KAFKA-12293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dejan Stojadinović resolved KAFKA-12293. Resolution: Fixed All in all: JCenter was closed on August 15th, 2024 (https://jf

[jira] [Created] (KAFKA-19782) Improve perfomance Authorizer.authorizeByResourceType by using Prefix Trie

2025-10-18 Thread Evgeny Kuvardin (Jira)
Evgeny Kuvardin created KAFKA-19782: --- Summary: Improve perfomance Authorizer.authorizeByResourceType by using Prefix Trie Key: KAFKA-19782 URL: https://issues.apache.org/jira/browse/KAFKA-19782 Proj

[jira] [Created] (KAFKA-19784) Expose Rack ID in MemberDescription

2025-10-18 Thread fujian (Jira)
fujian created KAFKA-19784: -- Summary: Expose Rack ID in MemberDescription Key: KAFKA-19784 URL: https://issues.apache.org/jira/browse/KAFKA-19784 Project: Kafka Issue Type: Task Components

Re: [DISCUSS] KIP-1227: Expose Rack ID in MemberDescription and ShareMemberDescription

2025-10-18 Thread Andrew Schofield
Hi Jian, Thanks for the KIP. Looks like a worthwhile improvement. AS1: You need to add a method `rackId()` to both MemberDescription and ShareMemberDescription. AS2: In the description of the ShareMemberDescription, you have referred to it as o.a.k.clients.admin.MemberDescription. AS3: I wonder

[jira] [Created] (KAFKA-19777) Generator | Fix order of arguments to assertEquals in unit tests

2025-10-18 Thread Ksolves India Limited (Jira)
Ksolves India Limited created KAFKA-19777: - Summary: Generator | Fix order of arguments to assertEquals in unit tests Key: KAFKA-19777 URL: https://issues.apache.org/jira/browse/KAFKA-19777 Pr

Re: [DISCUSS] KIP-1217: Include push interval in ClientTelemetryReceiver context

2025-10-18 Thread Chia-Ping Tsai
hi Mickael Apologies for the delayed review. I have a quick question. chia_00: The rejected alternative is a simpler approach, and the need for recompilation is an acceptable drawback. The method is slated for removal in a major release, which requires recompilation anyway I think. Best, Chi

Re: Apache Kafka 4.2 -- Release Manager

2025-10-18 Thread Christo Lolov
Hello, Apologies for the delay as I wasn’t near a computer these last few days. Okay, I will begin with a release plan to get the conversation going! Best, Christo On Mon, 22 Sep 2025 at 08:40, Bruno Cadonna wrote: > Thanks for volunteering, Christo! > > Best, > Bruno > > On 20.09.25 01:15, Ch

Re: [VOTE] KIP-1206: Strict max fetch records in share fetch

2025-10-18 Thread Andrew Schofield
Hi Jimmy, Thanks for the KIP. +1 (binding) Andrew > On 14 Oct 2025, at 08:47, Wang Jimmy wrote: > > Hi, > > I'd like to start a vote on KIP-1206: Strict max fetch records in share fetch: > > https://cwiki.apache.org/confluence/x/p4mhFg > > The discussion thread is here: > > https://lists.apache

Re: [VOTE] KIP-877: Mechanism for plugins and connectors to register metrics

2025-10-18 Thread 黃竣陽
Hello all, There is an improvement in KIP-877 with the following changes: 1. Removed KafkaPrincipalBuilder plugin: Its lifecycle is short, so adding metrics for it would be meaningless. 2. Added new extra tags for Login, and AuthenticateCallbackHandler plugins to avoid collisions. These plugin

[jira] [Resolved] (KAFKA-19624) Consistency of command-line arguments for consumer performance tests

2025-10-18 Thread Andrew Schofield (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-19624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Schofield resolved KAFKA-19624. -- Fix Version/s: 4.2.0 Resolution: Fixed > Consistency of command-line arguments

Re: [VOTE] 4.0.1 RC2

2025-10-18 Thread Matthias J. Sax
We got some more insights about the memory leak, and I filed: https://issues.apache.org/jira/browse/KAFKA-19748 Thanks to Eduwer Camcaro to helping us narrowing down this issue. The issue seems to only affect 4.1.0+, but not 4.0.x, so from our side, we can move forward with the current RC.

[jira] [Created] (KAFKA-19797) Implement deliveryCompleteCount in writeShareGroupStateRPC

2025-10-18 Thread Chirag Wadhwa (Jira)
Chirag Wadhwa created KAFKA-19797: - Summary: Implement deliveryCompleteCount in writeShareGroupStateRPC Key: KAFKA-19797 URL: https://issues.apache.org/jira/browse/KAFKA-19797 Project: Kafka

[jira] [Created] (KAFKA-19756) Write down the steps for upgrading Gradle

2025-10-18 Thread Chia-Ping Tsai (Jira)
Chia-Ping Tsai created KAFKA-19756: -- Summary: Write down the steps for upgrading Gradle Key: KAFKA-19756 URL: https://issues.apache.org/jira/browse/KAFKA-19756 Project: Kafka Issue Type: Imp

Re: [VOTE] KIP-1066: Mechanism to cordon brokers and log directories

2025-10-18 Thread Mickael Maison
Hi, Bumping this thread again. We're still missing 1 binding vote. Thanks, Mickael On Thu, Sep 25, 2025 at 6:09 AM Christo Lolov wrote: > > Hello, > > +1 (binding) from me! > > Best, > Christo > > > On 24 Sep 2025, at 22:24, Mickael Maison wrote: > > > > Hi, > > > > Bumping the thread once mo

Re: [DISCUSS] Apache Kafka 4.1.1 release

2025-10-18 Thread Mickael Maison
Hi, Thanks Lianet for volunteering. Regarding the Connect issue, so far we've confirmed there's indeed a regression introduced in 4.1.0 regarding plugin loading. In the Jira [0] there is agreement on the expected behavior. I've started working on a fix. I'll update you once things have progresse

Re: [VOTE] KIP-1209: Add configuration to control internal topic creation in Kafka Connect

2025-10-18 Thread Anton Liauchuk
Hi, Bumping this thread - one binding vote is still required On Wed, Oct 1, 2025 at 10:18 PM Yash Mayya wrote: > Hi Anton, > > I'm +1 (binding), thanks for the KIP! > > Yash > > On Thu, Sep 4, 2025 at 10:24 AM Anton Liauchuk > wrote: > > > hi > > > > I would like to start a vote on *KIP-1209:

Re: [DISCUSS] KIP-1150 Diskless Topics

2025-10-18 Thread Ivan Yurchenko
Hi Jun, Thank you for your message. I’m sorry that I failed to clearly explain the idea. Let me try to fix this. > Does each partition now have a metadata partition and a separate data > partition? If so, I am concerned that it essentially doubles the number of > partitions, which impacts the nu

[jira] [Created] (KAFKA-19780) Create a CI to verify all gradle tasks

2025-10-18 Thread Chia-Ping Tsai (Jira)
Chia-Ping Tsai created KAFKA-19780: -- Summary: Create a CI to verify all gradle tasks Key: KAFKA-19780 URL: https://issues.apache.org/jira/browse/KAFKA-19780 Project: Kafka Issue Type: Improv

Re: [VOTE] KIP-1197: Introduce new method to improve the TopicBasedRemoteLogMetadataManager's initialization

2025-10-18 Thread jian fu
Hi Kafka commiters: I’ve summarized the current voting status as follows. We still need two binding votes to move forward. Could anyone take a look at the KIP? Thanks. Anatolii PopovKIP! +1 (non-binding) Kamal Chandraprakash KIP! +1 (binding) Jhen-Yung Hsu KIP! +1

Re: [VOTE] 4.0.1 RC2

2025-10-18 Thread Hong-Yi Chen
Hi Christo, I went through the verification of 4.0.1-RC2 with the following steps: - Built and executed all unit and integration tests from the source tarball (OpenJDK 23 Zulu) - Confirmed basic produce and consume functionality works as expected - Checked signatures and c

Re: [Vote] KIP-1206: Strict max fetch records in share fetch

2025-10-18 Thread Apoorv Mittal
Hi Jimmy, Thanks for the KIP. +1 (binding) - Regards, Apoorv Mittal > On 14 Oct 2025, at 14:02, Andrew Schofield wrote: > > Hi Jimmy, > Thanks for the KIP. > > +1 (binding) > > Andrew > >> On 14 Oct 2025, at 10:35, Wang Jimmy wrote: >> >> Hi, >> >> I'd like to start a vote on KIP-1206:

[jira] [Created] (KAFKA-19778) Share Partition Lag Persistence and Retrieval

2025-10-18 Thread Chirag Wadhwa (Jira)
Chirag Wadhwa created KAFKA-19778: - Summary: Share Partition Lag Persistence and Retrieval Key: KAFKA-19778 URL: https://issues.apache.org/jira/browse/KAFKA-19778 Project: Kafka Issue Type: I

Re: [DISCUSS] KIP-1222: Acquisition lock timeout renewal in share consumer explicit mode

2025-10-18 Thread Andrew Schofield
Hi Sushant, Thanks for the KIP. I tried replying previously but messed up so let's try again. AS1: In the section of Proposed Changes, the KIP states that the acknowledge(ConsumerRecord, AcknowledgementType) method causes RPCs to be sent. This is incorrect. Only the poll and commit methods do thi

[jira] [Created] (KAFKA-19748) Memory leak using range scans

2025-10-18 Thread Matthias J. Sax (Jira)
Matthias J. Sax created KAFKA-19748: --- Summary: Memory leak using range scans Key: KAFKA-19748 URL: https://issues.apache.org/jira/browse/KAFKA-19748 Project: Kafka Issue Type: Bug

Re: Access to the Kafka Confluence wiki

2025-10-18 Thread Matthias J. Sax
You should be all set. On 9/30/25 9:59 AM, Ankur Sinha wrote: Hi all, I would like to contribute a new KIP and need edit access to the Kafka Confluence wiki. My Confluence username is ankursinha07 Best Regards/ Bien Cordialement, *Ankur Sinha* Software Developer/Devops Engineer S2S | UPX |

Re: [VOTE] KIP-1207: Fix anomaly of JMX metrics RequestHandlerAvgIdlePercent in kraft combined mode

2025-10-18 Thread Andrew Schofield
Thanks for the KIP. +1 (binding) Andrew From: José Armando García Sancio Sent: 26 September 2025 20:58 To: [email protected] Subject: Re: [VOTE] KIP-1207: Fix anomaly of JMX metrics RequestHandlerAvgIdlePercent in kraft combined mode Thanks for impro

Re: [DISCUSS] KIP-1228: Add Transaction Version to WriteTxnMarkersRequest

2025-10-18 Thread Andrew Schofield
Hi Ritika, Thanks for the KIP. I have one question. AS1: Does the new WriteTxnMarkers V1 request introduce support for TV == 2 or TV >= 2? I only ask because the pseudo-code is quite loose in the checking logic. I would have thought that V1 specifically introduces TV == 2 and it would take another

Re: [PR] MINOR: Add 4.0.1 Javadocs [kafka-site]

2025-10-18 Thread via GitHub
clolov merged PR #723: URL: https://github.com/apache/kafka-site/pull/723 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected]

Re: [VOTE] KIP-1140: Avoid to return null value in Map from public api of consumer

2025-10-18 Thread 黃竣陽
Hello Kirk, Since Jun raised concerns about whether we should return null values, I think this KIP vote should remain pending. We can revisit and reconsider this decision in the future based on user feedback. FYI: Best Regards,

Re: [PR] MINOR: Correct JIRA issue link in ops.html [kafka-site]

2025-10-18 Thread via GitHub
chia7712 merged PR #730: URL: https://github.com/apache/kafka-site/pull/730 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected]

Re: [EXT] Re: [DISCUSS] KIP-1225: Add Optional TTL Support to Kafka Streams State Stores

2025-10-18 Thread Nick Telford
On reflection, I actually really like Lucas' suggestion of using the RocksDB CompactionFilter to discard timed-out records. The downside of this approach is that, at the moment, RocksJNI doesn't support Java CompactionFilters. The advantage of this approach is that the CompactionFilter can be made

Re: [DISCUSS] KIP-1219: Configurations for KRaft Fetch and FetchSnapshot Byte Size

2025-10-18 Thread Jonah Hooper
Hey Jun, Thanks for reading the KIP! > controller.quorum.fetch.timeout.ms defaults to 2 secs. Is that a bit too low? I personally think that controller.quorum.fetch.timeout.ms is best kept at the current value. It determines how long until we start elections. If an active controller is truly dow

[jira] [Resolved] (KAFKA-19750) Address the compileClasspath resolution warnings for the `releaseTarGz` task

2025-10-18 Thread Chia-Ping Tsai (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-19750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-19750. Fix Version/s: 4.2.0 Resolution: Fixed > Address the compileClasspath resolution wa

[jira] [Resolved] (KAFKA-19390) AbstractIndex#resize() does not release old mmap on Linux

2025-10-18 Thread Chia-Ping Tsai (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-19390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-19390. Resolution: Fixed > AbstractIndex#resize() does not release old mmap on Linux > --

Re: [PR] KAFKA-19480: Add workaround for hanging kraft migration due to null /migration znode [kafka-site]

2025-10-18 Thread via GitHub
viktorsomogyi merged PR #708: URL: https://github.com/apache/kafka-site/pull/708 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected]

Re: [DISCUSS] Apache Kafka 4.1.1 release

2025-10-18 Thread Lianet M.
Thanks for the updates Mickael and David! Both jiras in the plan as blockers. Lianet On Wed, Oct 8, 2025, 12:15 p.m. Mickael Maison wrote: > Hi, > > Thanks Lianet for volunteering. > > Regarding the Connect issue, so far we've confirmed there's indeed a > regression introduced in 4.1.0 regardin

Re: Re: [DISCUSS] KIP-1206: Strict max fetch records in share fetch

2025-10-18 Thread Apoorv Mittal
Hi Jimmy, Thanks for making the changes, I agree with Andrew's suggestions and here are some additional comments: AM6: Now when we have changed the enum value from "STRICT" to "RECOR_LIMIT" then we need to update some sentences where still strict is being referenced. For example, in "Proposed Chan

Re: Re: [DISCUSS] KIP-1206: Strict max fetch records in share fetch

2025-10-18 Thread Wang Jimmy
Hi Andrew, Thanks for your feedback! AS10: You’re right. I have replaced the max.fetch.records with max.poll.records. AS11: Hmm, my intention was to illustrate the potential features that could be enabled after implementing this KIP, such as better handling poison records. However, I agree with

Build failed in Jenkins: Kafka » Kafka Branch Builder » 3.9 #231

2025-10-18 Thread Apache Jenkins Server
See Changes: -- [...truncated 555654 lines...] [2025-10-17T14:06:19.622Z] Gradle Test Run :core:test > Gradle Test Executor 79 > ZkMigrationClientTest > testClaimAbsentContro

Re: [DISCUSS] KIP-1227: Expose Rack ID in MemberDescription and ShareMemberDescription

2025-10-18 Thread jian fu
Hi Andrew: Thanks for your feedback. It gave me a broader perspective ! Regards Jian Andrew Schofield 于2025年10月14日周二 16:52写道: > Hi Jian, > Sounds good to me. Leaving the CLI tools enhancement to a > potential future KIP works for me. > > Thanks, > Andrew > > > On 13 Oct 2025, at 12:47, jian fu

Re: Re: [DISCUSS] KIP-1206: Strict max fetch records in share fetch

2025-10-18 Thread Andrew Schofield
Hi Jimmy, Thanks for the updates. Just a few minor comments remain, but it's nearly ready. AS10: There is no max.fetch.records parameter. I think you mean max.poll.records. There might be share.max.fetch.records in the future but not yet. AS11: I don't understand the point about poison records. T

Jenkins build is still unstable: Kafka » Kafka PowerPC Daily » test-powerpc #437

2025-10-18 Thread Apache Jenkins Server
See

Re: [VOTE] KIP-1136: Make ConsumerGroupMetadata an interface

2025-10-18 Thread Paweł Szymczyk
Hi all, KIP-1136 has been approved. +3 (binding) – Matthias J.Sax, Lianet Magrans, Bill Bejeck Thanks everyone for the votes. pt., 10 paź 2025 o 00:07 Bill Bejeck napisał(a): > Thanks for the KIP Paweł, it's a needed change. > > +1(binding) > > -Bill > > On Thu, Oct 9, 2025 at 12:29 PM Lia

Re: [DISCUSS] KIP-1222: Acquisition lock timeout renewal in share consumer explicit mode

2025-10-18 Thread Sushant Mahajan
Hi Lianet, Thanks for the feedback. I have incorporated LM1 and LM2. For LM3 and LM4. The behavior is not different from what we have currently, where the poll results are buffered on the client side. If an application renews records continuously, the record the will get added to exisiting fetch b

Re: [DISCUSS] KIP-1222: Acquisition lock timeout renewal in share consumer explicit mode

2025-10-18 Thread Lianet M.
Hi Sushant, thanks for the KIP. LM1: About the validation for brokers that may not support this feature, the KIP proposes to validate on the "acknowledge" call, but that does not build any request or have any relationship with the NetworkClient (where the ApiVersions info lives), so how exactly ar

Re: [DISCUSS] KIP-1188: New ConnectorClientConfigOverridePolicy with allowlist of configurations

2025-10-18 Thread Federico Valeri
Thanks. LGTM. On Thu, Oct 16, 2025 at 4:10 PM Mickael Maison wrote: > > Hi, > > Thanks Fede for the feedback! > > I was going to keep PrincipalConnectorClientConfigOverridePolicy but > after taking another look I think we can also deprecate it and mark it > for deletion. > Principal has been a so

[jira] [Created] (KAFKA-19735) Add automatic commit offset caching in subscribe mode

2025-10-18 Thread kangning.li (Jira)
kangning.li created KAFKA-19735: --- Summary: Add automatic commit offset caching in subscribe mode Key: KAFKA-19735 URL: https://issues.apache.org/jira/browse/KAFKA-19735 Project: Kafka Issue Typ

[DISCUSS] KIP-977: Partition-Level Throughput Metrics Implementation Question

2025-10-18 Thread Afshin Moazami
Hi everyone, I'd like to reinitiate the conversation about KIP-977. This KIP was approved and scheduled for release 3.8.0 but appears not to have been shipped. At Salesforce, we're exploring implementing this KIP (draft PR: [ https://github.com/apache/kafka/pull/20397](https://github.com/apache/k

Requesting wiki permissions to create KIPs

2025-10-18 Thread Sanskar Jhajharia
Hey team, I got my wiki ID from ASF self service portal, but it seems to be missing the permissions to Create KIPs. Could someone please help me with this? wiki user name: sjhajharia Thanks in advance! Sanskar Jhajharia Software Engineer @ Confluent Contact: Personal | Official

[jira] [Resolved] (KAFKA-18193) Refactor Kafka Streams CloseOptions to Fluent API Style

2025-10-18 Thread Bill Bejeck (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-18193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bill Bejeck resolved KAFKA-18193. - Resolution: Fixed > Refactor Kafka Streams CloseOptions to Fluent API Style > --

RE: [DISCUSS] KIP-1149 Helm Chart for Apache Kafka

2025-10-18 Thread Miles, Joe
Hi all, Can this be revisited at all? https://github.com/apache/kafka/pull/19249 given bitnami is going behind a paywall this helm chart for apache kafka would be very useful On 2025/03/24 13:50:31 Stephen Askew wrote: > Hi All, > > I've opened a new KIP-1149: Helm Chart for Apache > Kafka

Access to the Kafka Confluence wiki

2025-10-18 Thread Ankur Sinha
Hi all, I would like to contribute a new KIP and need edit access to the Kafka Confluence wiki. My Confluence username is ankursinha07 Best Regards/ Bien Cordialement, Ankur Sinha Software Developer/Devops Engineer S2S | UPX | OPO | D3C DOTI – SC Michelin India Private Limited Tower-4 World

Re: [VOTE] KIP-1140: Avoid to return null value in Map from public api of consumer

2025-10-18 Thread Kirk True
We ended up with 1 binding vote. Can we restart the vote to give it another push? On Wed, May 14, 2025, at 8:36 AM, Federico Valeri wrote: > +1 non binding > > Thanks > > On Sat, Apr 26, 2025 at 4:32 PM Kirk True wrote: > > > > +1 (non-binding) > > > > Thanks! > > > > On Sat, Apr 26, 2025, at

Re: [DISCUSS] KIP-1219: Configurations for KRaft Fetch and FetchSnapshot Byte Size

2025-10-18 Thread Jonah Hooper
Hi Kevin, thanks for reading and responding to the KIP! > What is the motivation for lowering this default limit from 8MiB to 1MiB? I think that a 1MiB default is more appropriate for most users. The new configuration slows things down (slightly) in a way which does not affect availability but

Re: [PR] Minor: Add blog and downloads for 4.0.1 [kafka-site]

2025-10-18 Thread via GitHub
mimaison commented on code in PR #731: URL: https://github.com/apache/kafka-site/pull/731#discussion_r2426431171 ## downloads.html: ## @@ -116,6 +115,38 @@ 3.9.1Archived releases + Review Comment: For archive releases, update the links to use `archive.apache.or

  1   2   >