Request for filing KIP

2024-05-20 Thread Harsh Panchal
Dear Apache Kafka Team, As instructed, I would like to write a KIP for PR - https://github.com/apache/kafka/pull/15905. I see that I don't have access to the "Create KIP" button on confluence. I kindly request you to grant access to write up KIP. My user name is: bootmgr Best Regards, Harsh

[jira] [Resolved] (KAFKA-16760) alterReplicaLogDirs failed even if responded with none error

2024-05-20 Thread Luke Chen (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Chen resolved KAFKA-16760. --- Resolution: Not A Problem > alterReplicaLogDirs failed even if responded with none error >

requesting permissions to contribute to Apache Kafka.

2024-05-20 Thread jiang dou
hello: my wiki ID is 'bmilk' and Jira ID is 'bmilk' thank you

Re: [DISCUSS] KIP-1027 Add MockFixedKeyProcessorContext

2024-05-20 Thread Matthias J. Sax
Had a discussion on https://issues.apache.org/jira/browse/KAFKA-15242 and it was pointed out, that we also need to do something about `FixedKeyRecord`. It does not have a public constructor (what is correct; it should not have one). However, this makes testing `FixedKeyProcessor` impossible

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #2921

2024-05-20 Thread Apache Jenkins Server
See

[jira] [Resolved] (KAFKA-16197) Connect Worker poll timeout prints Consumer poll timeout specific warnings.

2024-05-20 Thread Greg Harris (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Greg Harris resolved KAFKA-16197. - Fix Version/s: 3.8.0 Resolution: Fixed > Connect Worker poll timeout prints Consumer

[jira] [Created] (KAFKA-16806) Explicitly declare JUnit dependencies for all test modules

2024-05-20 Thread Greg Harris (Jira)
Greg Harris created KAFKA-16806: --- Summary: Explicitly declare JUnit dependencies for all test modules Key: KAFKA-16806 URL: https://issues.apache.org/jira/browse/KAFKA-16806 Project: Kafka

[jira] [Created] (KAFKA-16805) Stop using a ClosureBackedAction to configure Spotbugs reports

2024-05-20 Thread Greg Harris (Jira)
Greg Harris created KAFKA-16805: --- Summary: Stop using a ClosureBackedAction to configure Spotbugs reports Key: KAFKA-16805 URL: https://issues.apache.org/jira/browse/KAFKA-16805 Project: Kafka

[jira] [Created] (KAFKA-16804) Replace gradle archivesBaseName with archivesName

2024-05-20 Thread Greg Harris (Jira)
Greg Harris created KAFKA-16804: --- Summary: Replace gradle archivesBaseName with archivesName Key: KAFKA-16804 URL: https://issues.apache.org/jira/browse/KAFKA-16804 Project: Kafka Issue Type:

[jira] [Created] (KAFKA-16803) Upgrade to a version of ShadowJavaPlugin which doesn't use ConfigureUtil

2024-05-20 Thread Greg Harris (Jira)
Greg Harris created KAFKA-16803: --- Summary: Upgrade to a version of ShadowJavaPlugin which doesn't use ConfigureUtil Key: KAFKA-16803 URL: https://issues.apache.org/jira/browse/KAFKA-16803 Project:

[jira] [Created] (KAFKA-16802) Move build.gradle java version information inside of a java block

2024-05-20 Thread Greg Harris (Jira)
Greg Harris created KAFKA-16802: --- Summary: Move build.gradle java version information inside of a java block Key: KAFKA-16802 URL: https://issues.apache.org/jira/browse/KAFKA-16802 Project: Kafka

[jira] [Created] (KAFKA-16801) Streams upgrade :test target doesn't find any junit tests

2024-05-20 Thread Greg Harris (Jira)
Greg Harris created KAFKA-16801: --- Summary: Streams upgrade :test target doesn't find any junit tests Key: KAFKA-16801 URL: https://issues.apache.org/jira/browse/KAFKA-16801 Project: Kafka

[jira] [Created] (KAFKA-16800) Resolve Gradle 9.0 deprecations

2024-05-20 Thread Greg Harris (Jira)
Greg Harris created KAFKA-16800: --- Summary: Resolve Gradle 9.0 deprecations Key: KAFKA-16800 URL: https://issues.apache.org/jira/browse/KAFKA-16800 Project: Kafka Issue Type: Task

[jira] [Created] (KAFKA-16799) NetworkClientDelegate is not backing off if the node is not found

2024-05-20 Thread Philip Nee (Jira)
Philip Nee created KAFKA-16799: -- Summary: NetworkClientDelegate is not backing off if the node is not found Key: KAFKA-16799 URL: https://issues.apache.org/jira/browse/KAFKA-16799 Project: Kafka

[jira] [Resolved] (KAFKA-16645) CVEs in 3.7.0 docker image

2024-05-20 Thread Igor Soarez (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Igor Soarez resolved KAFKA-16645. - Resolution: Resolved > CVEs in 3.7.0 docker image > -- > >

[jira] [Reopened] (KAFKA-16645) CVEs in 3.7.0 docker image

2024-05-20 Thread Igor Soarez (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Igor Soarez reopened KAFKA-16645: - Need to re-open to change the resolution, release_notes.py doesn't like the one I picked > CVEs

DescribeLogDirs in Kafka 3.3.1 returns all topics instead of one provided in the request. Bug or "bad user error"?

2024-05-20 Thread Maxim Senin
Hello. I’m having a problem with Kafka protocol API. Requests: DescribeLogDirs Request (Version: 0) => [topics] topics => topic [partitions] topic => STRING partitions => INT32 My request contains `[{topic: “blah”, partitions: [0,1,2,3,4,5,6,7,8,9]}]`, but the result Responses:

Re: [DISCUSS] KIP-1045 Decide MockAdminClient to move to public api or not

2024-05-20 Thread Muralidhar Basani
Hi all, Any thoughts on this ? In my view, it helps developers in having an end to end testing framework embedded into their applications, right from mocking of creating topics, acls itself. Even though creation and listing of these are done during design time, automating these could be

[DISCUSS] KIP-655: Add deduplication processor in kafka-streams

2024-05-20 Thread Ayoub
Hello, Following a discussion on community slack channel, I would like to revive the discussion on the KIP-655, which is about adding a deduplication processor in kafka-streams. https://cwiki.apache.org/confluence/display/KAFKA/KIP-655%3A+Windowed+Distinct+Operation+for+Kafka+Streams+API Even

[jira] [Resolved] (KAFKA-16692) InvalidRequestException: ADD_PARTITIONS_TO_TXN with version 4 which is not enabled when upgrading from kafka 3.5 to 3.6

2024-05-20 Thread Justine Olshan (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Justine Olshan resolved KAFKA-16692. Fix Version/s: 3.6.3 Resolution: Fixed > InvalidRequestException:

Re: [DISCUSS] KIP-1044: A proposal to change idempotent producer -- server implementation

2024-05-20 Thread Justine Olshan
My team has looked at it from a high level, but we haven't had the time to come up with a full proposal. I'm not aware if others have worked on it. Justine On Mon, May 20, 2024 at 10:21 AM Omnia Ibrahim wrote: > Hi Justine are you aware of anyone looking into such new protocol at the >

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #2920

2024-05-20 Thread Apache Jenkins Server
See

Re: [DISCUSS] KIP-1044: A proposal to change idempotent producer -- server implementation

2024-05-20 Thread Omnia Ibrahim
Hi Justine are you aware of anyone looking into such new protocol at the moment? > On 20 May 2024, at 18:00, Justine Olshan wrote: > > I would say I have first hand knowledge of this issue as someone who > responds to such incidents as part of my work at Confluent over the past > couple years.

Re: [DISCUSS] KIP-1044: A proposal to change idempotent producer -- server implementation

2024-05-20 Thread Justine Olshan
I would say I have first hand knowledge of this issue as someone who responds to such incidents as part of my work at Confluent over the past couple years. :) > We only persist the information for the length of time we retain snapshots. This seems a bit contradictory to me. We are going to

Re: [DISCUSS] KIP-1044: A proposal to change idempotent producer -- server implementation

2024-05-20 Thread Claude Warren
> > Why should we persist useless information > for clients that are long gone and will never use it? We are not. We only persist the information for the length of time we retain snapshots. The change here is to make the snapshots work as longer term storage for infrequent producers and

Re: [VOTE] KIP-1038: Add Custom Error Handler to Producer

2024-05-20 Thread Kirk True
+1 (non-binding) Thanks Alieh! > On May 20, 2024, at 6:00 AM, Walker Carlson > wrote: > > Hey Alieh, > > Thanks for the KIP. > > +1 binding > > Walker > > On Tue, May 7, 2024 at 10:57 AM Alieh Saeedi > wrote: > >> Hi all, >> >> It seems that we have no more comments, discussions, or

Re: [DISCUSS] KIP-1044: A proposal to change idempotent producer -- server implementation

2024-05-20 Thread Omnia Ibrahim
I agree with Justine, especially considering that the number of producers on a Kafka cluster is usually very limited. This makes me think we are focusing on the symptom in my KIP-936 and this KIP, which is the memory issue, instead of addressing the root cause. The root cause is that the

[jira] [Reopened] (KAFKA-16692) InvalidRequestException: ADD_PARTITIONS_TO_TXN with version 4 which is not enabled when upgrading from kafka 3.5 to 3.6

2024-05-20 Thread Igor Soarez (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Igor Soarez reopened KAFKA-16692: - Re-opening as 3.6 backport is still missing > InvalidRequestException: ADD_PARTITIONS_TO_TXN with

Re: [PR] Add Skillsoft to "Powered By" [kafka-site]

2024-05-20 Thread via GitHub
brandon-powers commented on PR #601: URL: https://github.com/apache/kafka-site/pull/601#issuecomment-2120763191 Hi team  - when someone has a moment to take a look, feel free to ping me if there's anything else required. -- This is an automated message from the Apache Git Service. To

Re: [DISCUSS] KIP-1031: Control offset translation in MirrorSourceConnector

2024-05-20 Thread Chia-Ping Tsai
Nice KIP. some minor comments/questions are listed below. 1) It seems we can disable the sync of idle consumers by setting `sync.group.offsets.interval.seconds` to -1, so the fail-fast should include sync.group.offsets.interval.seconds too. For another, maybe we should do fail-fast for

[jira] [Resolved] (KAFKA-16692) InvalidRequestException: ADD_PARTITIONS_TO_TXN with version 4 which is not enabled when upgrading from kafka 3.5 to 3.6

2024-05-20 Thread Igor Soarez (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Igor Soarez resolved KAFKA-16692. - Resolution: Fixed > InvalidRequestException: ADD_PARTITIONS_TO_TXN with version 4 which is not

[jira] [Resolved] (KAFKA-16645) CVEs in 3.7.0 docker image

2024-05-20 Thread Igor Soarez (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Igor Soarez resolved KAFKA-16645. - Assignee: Igor Soarez Resolution: Won't Fix The vulnerability has already been addressed

Re: [PR] MINOR - Move CSP header from _header.htm to .htaccess [kafka-site]

2024-05-20 Thread via GitHub
brandboat commented on PR #602: URL: https://github.com/apache/kafka-site/pull/602#issuecomment-2120632215 gentle ping @raboof, would you mind take a look ? I saw you left a comment in https://github.com/apache/kafka-site/pull/597#issuecomment-2075421541, and this pr seems done what you

Re: [VOTE] KIP-1040: Improve handling of nullable values in InsertField, ExtractField, and other transformations

2024-05-20 Thread Chris Egerton
Thanks for the KIP! +1 (binding) On Mon, May 20, 2024 at 4:22 AM Mario Fiore Vitale wrote: > Hi everyone, > > I'd like to call a vote on KIP-1040 which aims to improve handling of > nullable values in InsertField, ExtractField, and other transformations > > KIP - >

[jira] [Resolved] (KAFKA-16603) Data loss when kafka connect sending data to Kafka

2024-05-20 Thread Chris Egerton (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Egerton resolved KAFKA-16603. --- Resolution: Not A Bug > Data loss when kafka connect sending data to Kafka >

[jira] [Resolved] (KAFKA-16656) Using a custom replication.policy.separator with DefaultReplicationPolicy

2024-05-20 Thread Chris Egerton (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Egerton resolved KAFKA-16656. --- Resolution: Not A Bug > Using a custom replication.policy.separator with

Re: [VOTE] KIP-1038: Add Custom Error Handler to Producer

2024-05-20 Thread Walker Carlson
Hey Alieh, Thanks for the KIP. +1 binding Walker On Tue, May 7, 2024 at 10:57 AM Alieh Saeedi wrote: > Hi all, > > It seems that we have no more comments, discussions, or feedback on > KIP-1038; therefore, I’d like to open voting for the KIP: Add Custom Error > Handler to Producer > < >

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #2919

2024-05-20 Thread Apache Jenkins Server
See

Re: [VOTE] KIP-950: Tiered Storage Disablement

2024-05-20 Thread Satish Duggana
+1 Thanks Christo for addressing the review comments. We can update the KIP for any minor comments/clarifications. On Thu, 16 May 2024 at 15:21, Luke Chen wrote: > > Thanks Chia-Ping! > Since ZK is going to be removed, I agree the KRaft part has higher priority. > But if Christo or the

[jira] [Created] (KAFKA-16798) Mirrormaker2 consumer groups sync.group.offsets.interval not working

2024-05-20 Thread Thanos Athanasopoulos (Jira)
Thanos Athanasopoulos created KAFKA-16798: - Summary: Mirrormaker2 consumer groups sync.group.offsets.interval not working Key: KAFKA-16798 URL: https://issues.apache.org/jira/browse/KAFKA-16798

[jira] [Resolved] (KAFKA-16797) A bit cleanup of FeatureControlManager

2024-05-20 Thread Chia-Ping Tsai (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-16797. Fix Version/s: 3.8.0 Resolution: Fixed > A bit cleanup of FeatureControlManager >

[VOTE] KIP-1040: Improve handling of nullable values in InsertField, ExtractField, and other transformations

2024-05-20 Thread Mario Fiore Vitale
Hi everyone, I'd like to call a vote on KIP-1040 which aims to improve handling of nullable values in InsertField, ExtractField, and other transformations KIP - https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=303794677 Discussion thread -