[jira] [Created] (KAFKA-14719) Talk about a problem

2023-02-14 Thread shenxingwuying (Jira)
shenxingwuying created KAFKA-14719: -- Summary: Talk about a problem Key: KAFKA-14719 URL: https://issues.apache.org/jira/browse/KAFKA-14719 Project: Kafka Issue Type: Task

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #1586

2023-02-14 Thread Apache Jenkins Server
See Changes: -- [...truncated 444611 lines...] [2023-02-15T00:14:46.297Z] > Task :storage:api:compileTestJava UP-TO-DATE [2023-02-15T00:14:46.297Z] > Task

Jenkins build is still unstable: Kafka » Kafka Branch Builder » 3.4 #82

2023-02-14 Thread Apache Jenkins Server
See

Re: [DISCUSS] Zookeeper deprecation

2023-02-14 Thread Divij Vaidya
Thank you for clarifying Ismael. On Tue 14. Feb 2023 at 20:07, Ismael Juma wrote: > Hi Divij, > > I think we'll make that call a bit later depending on the progress we make > on things like zk to kraft migration. The deprecation notice is meant to > indicate that we recommend customers use

Re: [DISCUSS] Apache Kafka 3.5.0 release

2023-02-14 Thread Ismael Juma
Thanks! Ismael On Tue, Feb 14, 2023 at 1:07 PM Mickael Maison wrote: > Hi Ismael, > > Good call. I shifted all dates by 2 weeks and moved them to Wednesdays. > > Thanks, > Mickael > > On Tue, Feb 14, 2023 at 6:01 PM Ismael Juma wrote: > > > > Thanks Mickael. A couple of notes: > > > > 1. We

[jira] [Resolved] (KAFKA-12893) MM2 fails to replicate if starting two+ nodes same time

2023-02-14 Thread Chris Egerton (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Egerton resolved KAFKA-12893. --- Resolution: Duplicate > MM2 fails to replicate if starting two+ nodes same time >

[jira] [Resolved] (KAFKA-12150) Consumer group refresh not working with clustered MM2 setup

2023-02-14 Thread Chris Egerton (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Egerton resolved KAFKA-12150. --- Resolution: Duplicate > Consumer group refresh not working with clustered MM2 setup >

[jira] [Resolved] (KAFKA-10857) Mirror Maker 2 - replication not working when deploying multiple instances

2023-02-14 Thread Chris Egerton (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Egerton resolved KAFKA-10857. --- Resolution: Duplicate > Mirror Maker 2 - replication not working when deploying multiple

[jira] [Resolved] (KAFKA-10586) Full support for distributed mode in dedicated MirrorMaker 2.0 clusters

2023-02-14 Thread Chris Egerton (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Egerton resolved KAFKA-10586. --- Resolution: Done > Full support for distributed mode in dedicated MirrorMaker 2.0 clusters

[jira] [Created] (KAFKA-14718) Flaky DedicatedMirrorIntegrationTest test suite

2023-02-14 Thread Chris Egerton (Jira)
Chris Egerton created KAFKA-14718: - Summary: Flaky DedicatedMirrorIntegrationTest test suite Key: KAFKA-14718 URL: https://issues.apache.org/jira/browse/KAFKA-14718 Project: Kafka Issue

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #1585

2023-02-14 Thread Apache Jenkins Server
See

[press] potential RCE patch, comment request

2023-02-14 Thread Charlie Osborne
Good afternoon team, my name is Charlie from The Daily Swig. I'm covering the Apache Kafka bug (CVE-2023-25194) and wanted to reach out with a few follow up questions if i may: -How useful are bug bounty programs like Aiven’s and indeed bug bounty programs in general in fixing flaws in Apache

Re: [DISCUSS] Apache Kafka 3.5.0 release

2023-02-14 Thread Mickael Maison
Hi Ismael, Good call. I shifted all dates by 2 weeks and moved them to Wednesdays. Thanks, Mickael On Tue, Feb 14, 2023 at 6:01 PM Ismael Juma wrote: > > Thanks Mickael. A couple of notes: > > 1. We typically choose a Wednesday for the various freeze dates - there are > often 1-2 day slips and

Build failed in Jenkins: Kafka » Kafka Branch Builder » 3.3 #153

2023-02-14 Thread Apache Jenkins Server
See Changes: -- [...truncated 421103 lines...] [2023-02-14T20:15:03.997Z] [2023-02-14T20:15:03.997Z] org.apache.kafka.streams.integration.StandbyTaskCreationIntegrationTest

[jira] [Created] (KAFKA-14717) KafkaStreams can' get running if the rebalance happens before StreamThread gets shutdown completely

2023-02-14 Thread Chia-Ping Tsai (Jira)
Chia-Ping Tsai created KAFKA-14717: -- Summary: KafkaStreams can' get running if the rebalance happens before StreamThread gets shutdown completely Key: KAFKA-14717 URL:

Re: Re: [DISCUSS] KIP-904 Kafka Streams - Guarantee subtractor is called before adder if key has not changed

2023-02-14 Thread Guozhang Wang
Thanks Farooq, that looks good to me. Guozhang On Sun, Feb 12, 2023 at 9:01 AM Dharin Shah wrote: > > Hello Farooq, > > This is actually a great idea, we have dealt with this by using an array > instead of a set. > +1 to this :) > > Thank you, > Dharin > > On Sun, Feb 12, 2023 at 8:11 PM Fq

Re: [DISCUSS] Zookeeper deprecation

2023-02-14 Thread Ismael Juma
Hi Divij, I think we'll make that call a bit later depending on the progress we make on things like zk to kraft migration. The deprecation notice is meant to indicate that we recommend customers use kraft mode for new clusters and that zk mode will be going away in 4.0. It doesn't change the

Re: [VOTE] KIP-889 Versioned State Stores

2023-02-14 Thread Matthias J. Sax
Thanks Victoria. Makes sense to me. On 2/13/23 5:55 PM, Victoria Xia wrote: Hi everyone, I have just pushed two minor amendments to KIP-889: - Updated the versioned store specification to clarify that the *"history retention" parameter is also used as "grace period,"* which means

Re: [DISCUSS] KIP-793: Sink Connectors: Support topic-mutating SMTs for async connectors (preCommit users)

2023-02-14 Thread Chris Egerton
Hi Yash, I was actually envisioning something like `void open(Collection originalPartitions, Collection transformedPartitions)`, since we already convert and transform each batch of records that we poll from the sink task's consumer en masse, meaning we could discover several new transformed

[jira] [Resolved] (KAFKA-14693) KRaft Controller and ProcessExitingFaultHandler can deadlock shutdown

2023-02-14 Thread Jira
[ https://issues.apache.org/jira/browse/KAFKA-14693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] José Armando García Sancio resolved KAFKA-14693. Resolution: Fixed > KRaft Controller and

[DISCUSS] Zookeeper deprecation

2023-02-14 Thread Divij Vaidya
Hi folks As we begin to prepare a release plan for 3.5, I was wondering if we plan to deprecate Zookeeper support with this release? I am asking this because some prior KIPs ([1] and [2]) mentioned 3.5 as the targeted version when we would mark Zookeeper support as deprecated. Personally, I

Re: [DISCUSS] KIP-900: KRaft kafka-storage.sh API additions to support SCRAM

2023-02-14 Thread Proven Provenzano
The original idea was to pass in the JSON string representing the UserScramCredentialsRecord directly to make this simple and to require no parsing at all. Here is a example of the JSON object:

Re: [DISCUSS] Apache Kafka 3.5.0 release

2023-02-14 Thread Ismael Juma
Thanks Mickael. A couple of notes: 1. We typically choose a Wednesday for the various freeze dates - there are often 1-2 day slips and it's better if that doesn't require people working through the weekend. 2. Looks like we're over a month later compared to the equivalent release last year (

Re: [DISCUSS] Apache Kafka 3.5.0 release

2023-02-14 Thread Josep Prat
Thanks for the work Mickael! On Tue, Feb 14, 2023 at 5:01 PM Mickael Maison wrote: > Hi, > > I've created a release plan for 3.5.0 in the wiki: > https://cwiki.apache.org/confluence/display/KAFKA/Release+Plan+3.5.0 > > Current dates are: > 1) KIP Freeze: 07 Apr 2023 > 2) Feature Freeze: 27 Apr

Re: [DISCUSS] KIP-793: Sink Connectors: Support topic-mutating SMTs for async connectors (preCommit users)

2023-02-14 Thread Yash Mayya
Hi Chris, > Plus, if a connector is intentionally designed to > use pre-transformation topic partitions in its > open/close methods, wouldn't we just be trading > one form of the problem for another by making this > switch? Thanks, this makes sense, and given that the KIP already proposes a way

Re: [DISCUSS] KIP-894: Use incrementalAlterConfigs API for syncing topic configurations

2023-02-14 Thread Chris Egerton
Hi Tina, While I agree that it's reasonable for users to want to favor the source cluster's defaults over the target cluster's, I'm hesitant to change this behavior in an opt-out fashion. IMO it's better to allow users to opt into this (by adding a method to the ConfigPropertyFilter interface,

[jira] [Created] (KAFKA-14716) Connect schema does not allow struct default values

2023-02-14 Thread Daniel Urban (Jira)
Daniel Urban created KAFKA-14716: Summary: Connect schema does not allow struct default values Key: KAFKA-14716 URL: https://issues.apache.org/jira/browse/KAFKA-14716 Project: Kafka Issue

Re: [DISCUSS] Apache Kafka 3.5.0 release

2023-02-14 Thread Mickael Maison
Hi, I've created a release plan for 3.5.0 in the wiki: https://cwiki.apache.org/confluence/display/KAFKA/Release+Plan+3.5.0 Current dates are: 1) KIP Freeze: 07 Apr 2023 2) Feature Freeze: 27 Apr 2023 3) Code Freeze: 11 May 2023 Please take a look at the plan. Let me know if there are other

[jira] [Created] (KAFKA-14715) Reduce Fetcher#parseRecord() memory copy

2023-02-14 Thread Mickael Maison (Jira)
Mickael Maison created KAFKA-14715: -- Summary: Reduce Fetcher#parseRecord() memory copy Key: KAFKA-14715 URL: https://issues.apache.org/jira/browse/KAFKA-14715 Project: Kafka Issue Type:

Re: [DISCUSS] KIP-852 Optimize calculation of size for log in remote tier

2023-02-14 Thread Divij Vaidya
Hey Jun It has been a while since this KIP got some attention. While we wait for Satish to chime in here, perhaps I can answer your question. > Could you explain how you exposed the log size in your KIP-405 implementation? The APIs available in RLMM as per KIP405 are,

[jira] [Resolved] (KAFKA-14696) CVE-2023-25194: Apache Kafka: Possible RCE/Denial of service attack via SASL JAAS JndiLoginModule configuration using Kafka Connect

2023-02-14 Thread Mickael Maison (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mickael Maison resolved KAFKA-14696. Resolution: Fixed > CVE-2023-25194: Apache Kafka: Possible RCE/Denial of service attack

[jira] [Created] (KAFKA-14714) Move/Rewrite RollParams, LogAppendInfo, and LeaderHwChange to storage module.

2023-02-14 Thread Satish Duggana (Jira)
Satish Duggana created KAFKA-14714: -- Summary: Move/Rewrite RollParams, LogAppendInfo, and LeaderHwChange to storage module. Key: KAFKA-14714 URL: https://issues.apache.org/jira/browse/KAFKA-14714

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #1584

2023-02-14 Thread Apache Jenkins Server
See

[jira] [Created] (KAFKA-14713) Kafka Streams global table startup takes too long

2023-02-14 Thread Tamas (Jira)
Tamas created KAFKA-14713: - Summary: Kafka Streams global table startup takes too long Key: KAFKA-14713 URL: https://issues.apache.org/jira/browse/KAFKA-14713 Project: Kafka Issue Type: Bug

Jenkins build is still unstable: Kafka » Kafka Branch Builder » 3.4 #81

2023-02-14 Thread Apache Jenkins Server
See

Build failed in Jenkins: Kafka » Kafka Branch Builder » 3.3 #152

2023-02-14 Thread Apache Jenkins Server
See Changes: -- [...truncated 418986 lines...] [2023-02-14T11:50:05.464Z] > Task :connect:api:compileTestJava UP-TO-DATE [2023-02-14T11:50:05.464Z] > Task

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #1583

2023-02-14 Thread Apache Jenkins Server
See

[jira] [Resolved] (KAFKA-14704) Follower should truncate before incrementing high watermark

2023-02-14 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot resolved KAFKA-14704. - Fix Version/s: 3.5.0 3.4.1 3.3.3 Reviewer: Jason

Re: [VOTE] KIP-903: Replicas with stale broker epoch should not be allowed to join the ISR

2023-02-14 Thread David Jacot
+1 (binding). Thanks for the KIP, Calvin! On Tue, Feb 14, 2023 at 1:10 AM Jun Rao wrote: > Hi, Calvin, > > Thanks for the KIP. +1 > > Jun > > On Fri, Feb 10, 2023 at 11:03 AM Alexandre Dupriez < > alexandre.dupr...@gmail.com> wrote: > > > +1 (non-binding). > > > > Le ven. 10 févr. 2023 à 19:02,

[jira] [Resolved] (KAFKA-14254) Format timestamps in assignor logs as dates instead of integers

2023-02-14 Thread Bruno Cadonna (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruno Cadonna resolved KAFKA-14254. --- Fix Version/s: 3.4.0 Resolution: Fixed > Format timestamps in assignor logs as dates