[jira] [Created] (KAFKA-14196) Flaky OffsetValidationTest seems to indicate potential duplication issue during rebalance

Philip Nee created KAFKA-14196: -- Summary: Flaky OffsetValidationTest seems to indicate potential duplication issue during rebalance Key: KAFKA-14196 URL: https://issues.apache.org/jira/browse/KAFKA-14196

Build failed in Jenkins: Kafka » Kafka Branch Builder » 3.3 #57

See Changes: -- [...truncated 574330 lines...] [2022-09-02T01:50:22.371Z] org.apache.kafka.streams.integration.TableTableJoinIntegrationTest > testInner[caching enabled =

[VOTE] KIP-678: New Kafka Connect SMT for plainText => struct with Regex

Hi all, I'd like to start a vote for KIP-678: New Kafka Connect SMT for plainText => struct with Regex KIP: https://cwiki.apache.org/confluence/display/KAFKA/KIP-678%3A+New+Kafka+Connect+SMT+for+plainText+%3D%3E+Struct%28or+Map%29+with+Regex JIRA: https://github.com/apache/kafka/pull/12219

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #1194

See Changes: -- [...truncated 507984 lines...] [2022-09-02T00:25:49.635Z] [2022-09-02T00:25:49.635Z] IQv2IntegrationTest > shouldFetchFromPartition() STARTED

Problem with Kafka KRaft 3.1.X

Hi all, I've been attempting to benchmark Kafka KRaft version for an ApacheCon talk and have identified 2 problems: 1 - it's still impossible to create large number of partitions/topics - I can create more than the comparable Zookeeper version but still not "millions" - this is with RF=1 (as

Re: [VOTE] KIP-844: Transactional State Stores

Thanks for the KIP, Alex! +1 (binding) from me. -John On Thu, Sep 1, 2022, at 09:51, Guozhang Wang wrote: > +1, thanks Alex! > > On Thu, Sep 1, 2022 at 6:33 AM Bruno Cadonna wrote: > >> Thanks for the KIP! >> >> +1 (binding) >> >> Best, >> Bruno >> >> On 01.09.22 15:26, Colt McNealy wrote: >>

Re: [DISCUSS] KIP-848: The Next Generation of the Consumer Rebalance Protocol

Hi, David, Thanks for the KIP. Overall, the main benefits of the KIP seem to be fewer RPCs during rebalance and more efficient support of wildcard. A few comments below. 30. ConsumerGroupHeartbeatRequest 30.1 ServerAssignor is a singleton. Do we plan to support rolling changing of the partition

[VOTE] Apache Kafka 3.3.0 RC1

Hello Kafka users, developers and client-developers, This is the first candidate for the release of Apache Kafka 3.3.0. There are some issues that we still have to resolve before we can make a final release. Those issues are documented here:

[jira] [Created] (KAFKA-14195) Fix KRaft AlterConfig policy usage for Legacy/Full case

Ron Dagostino created KAFKA-14195: - Summary: Fix KRaft AlterConfig policy usage for Legacy/Full case Key: KAFKA-14195 URL: https://issues.apache.org/jira/browse/KAFKA-14195 Project: Kafka

Re: [DISCUSS] KIP-864: Add End-To-End Latency Metrics to Connectors

Hi Sagar and Yash, Thanks for your feedback! > 1) I am assuming the new metrics would be task level metric. 1.1 Yes, it will be a task level metric, implemented on the Worker[Source/Sink]Task. > Could you specify the way it's done for other sink/source connector? 1.2. Not sure what do you

Re: Re: [DISCUSS] KIP-821: Connect Transforms support for nested structures

Hi Chris, Thanks for your feedback! 1. Yes, it will be context-dependent. I have added rules and scenarios to the nested notation to cover the happy path and edge cases. In short, backticks will be not be considered as part of the field name when they are wrapping a field name: first backtick at

RE: Re: Permission to assign Apache Kafka Jiras to myself

Hi David, Thanks for granting me the requested permission! Could you please also grant me wiki (Confluence) permissions on the same username and email? Thanks, Yash On 2022/08/11 14:34:28 David Jacot wrote: > Hi Yash, > > You are all set. > > Best, > David > > On Thu, Aug 11, 2022 at 3:47 PM

Re: [DISCUSS] KIP-864: Add End-To-End Latency Metrics to Connectors

Hi Jorge, Thanks for the KIP! I have the same confusion with the e2e-latency metrics as Sagar above. "e2e" would seem to indicate the latency between when the record was written to Kafka and when the record was written to the sink system by the connector - however, as per the KIP it looks like it

[jira] [Created] (KAFKA-14194) NPE in Cluster.nodeIfOnline

Andrew Dean created KAFKA-14194: --- Summary: NPE in Cluster.nodeIfOnline Key: KAFKA-14194 URL: https://issues.apache.org/jira/browse/KAFKA-14194 Project: Kafka Issue Type: Bug

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #1193

See Changes: -- [...truncated 422658 lines...] [2022-09-01T15:35:53.146Z] KStreamAggregationIntegrationTest > shouldReduce(TestInfo) STARTED [2022-09-01T15:35:57.137Z]

Re: [DISCUSS] KIP-864: Add End-To-End Latency Metrics to Connectors

Hi Jorge, Thanks for the KIP. It looks like a very good addition. I skimmed through once and had a couple of questions => 1) I am assuming the new metrics would be task level metric. Could you specify the way it's done for other sink/source connector? 2) I am slightly confused about the e2e

RE: Re: Re: KIP 678: New Kafka Connect SMT for plainText => Struct(or Map) with Regex

Hi whsoul, No further comments from me, and sorry for the delay. This looks good! Feel free to open a vote thread and I can kick things off with a +1. Cheers, Chris

Re: [VOTE] KIP-844: Transactional State Stores

+1, thanks Alex! On Thu, Sep 1, 2022 at 6:33 AM Bruno Cadonna wrote: > Thanks for the KIP! > > +1 (binding) > > Best, > Bruno > > On 01.09.22 15:26, Colt McNealy wrote: > > +1 > > > > Hi Alex, > > > > Thank you for your work on the KIP. I'm not a committer so my vote is > > non-binding but I

[GitHub] [kafka-site] sadatrafsan commented on pull request #431: Brain Station 23 adopted Kafka

sadatrafsan commented on PR #431: URL: https://github.com/apache/kafka-site/pull/431#issuecomment-1234341677 solved -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[GitHub] [kafka-site] sadatrafsan closed pull request #431: Brain Station 23 adopted Kafka

sadatrafsan closed pull request #431: Brain Station 23 adopted Kafka URL: https://github.com/apache/kafka-site/pull/431 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

Re: [VOTE] KIP-844: Transactional State Stores

Thanks for the KIP! +1 (binding) Best, Bruno On 01.09.22 15:26, Colt McNealy wrote: +1 Hi Alex, Thank you for your work on the KIP. I'm not a committer so my vote is non-binding but I strongly support this improvement. Thank you, Colt McNealy *Founder, LittleHorse.io* On Thu, Sep 1, 2022

Re: [VOTE] KIP-844: Transactional State Stores

+1 Hi Alex, Thank you for your work on the KIP. I'm not a committer so my vote is non-binding but I strongly support this improvement. Thank you, Colt McNealy *Founder, LittleHorse.io* On Thu, Sep 1, 2022 at 8:20 AM Alexander Sorokoumov wrote: > Hi All, > > I would like to start a voting

[VOTE] KIP-844: Transactional State Stores

Hi All, I would like to start a voting thread on KIP-844, which introduces transactional state stores to avoid wiping local state on crash failure under EOS. KIP: https://cwiki.apache.org/confluence/display/KAFKA/KIP-844%3A+Transactional+State+Stores Discussion thread:

RE: ARM/PowerPC builds

Hi Colin, My concern was to resolve the build failures. I think we should be fine running the builds nightly on PowerPC. I am wondering how to enable that. Do we need to create another Jenkinsfile for nightly build? -Amit Baheti From: Colin McCabe Sent:

Re: [DISCUSS] KIP-844: Transactional State Stores

Hey Guozhang, Sounds good. I annotated all added StateStore methods (commit, recover, transactional) with @Evolving. Best, Alex On Wed, Aug 31, 2022 at 7:32 PM Guozhang Wang wrote: > Hello Alex, > > Thanks for the detailed replies, I think that makes sense, and in the long > run we would

Re: Pricing plan

You can contact Confluent here: https://confluent.io/contact -- Robin Moffatt | Principal Developer Advocate | ro...@confluent.io | @rmoff On Thu, 1 Sept 2022 at 09:44, Uzair Ahmed Mughal wrote: > can you please then provide the pricing plan of Confluent. > Regards Uzair. > > On Thu, Sep

Re: [DISCUSS] KIP-858: Handle JBOD broker disk failure in KRaft

Hi Igor, I think this KIP can solve the current problems, I have some problems relating to the migration section. Since we have bumped broker RPC version and metadata record version, there will be some problems between brokers/controllers of different versions. In ZK mode we use IBP as a flag

Re: Pricing plan

so we can have an estimate. On Thu, Sep 1, 2022 at 1:43 PM Uzair Ahmed Mughal wrote: > can you please then provide the pricing plan of Confluent. > Regards Uzair. > > On Thu, Sep 1, 2022 at 1:40 PM Robin Moffatt > wrote: > >> Apache Kafka is licensed under Apache 2.0 and free to use. >> >>

Re: Pricing plan

can you please then provide the pricing plan of Confluent. Regards Uzair. On Thu, Sep 1, 2022 at 1:40 PM Robin Moffatt wrote: > Apache Kafka is licensed under Apache 2.0 and free to use. > > There are a variety of companies that will sell you a self-hosted platform > built on Kafka, or a

Re: Pricing plan

Apache Kafka is licensed under Apache 2.0 and free to use. There are a variety of companies that will sell you a self-hosted platform built on Kafka, or a Cloud-hosted version of Kafka. These include Confluent (disclaimer: I work for them), Red Hat, AWS, Aiven, Instaclustr, Cloudera, and more.

Pricing plan

Hello, we are looking for a pricing plan for Kafka in detail, can you please help us out? Thanks and regards Uzair Mughal IVACY