Re: [DISCUSS] KIP-820: Extend KStream process with new Processor API

2022-03-03 Thread Matthias J. Sax
John, thanks for verifying source compatibility. My impression was that it should be source compatible, I was just not 100% sure. The question about `processValues()` is really a hard one. Guozhang's point is very good one. Maybe we need to be pragmatic and accept the runtime check (even if I

Re: [DISCUSS] KIP-794: Strictly Uniform Sticky Partitioner

2022-03-03 Thread Artem Livshits
Hi Jun, 2. Removed the option from the KIP. Now the sticky partitioning threshold is hardcoded to batch.size. 20. Added the corresponding wording to the KIP. -Artem On Thu, Mar 3, 2022 at 10:52 AM Jun Rao wrote: > Hi, Artem, > > Thanks for the reply. > > 1. Sounds good. > > 2. If we don't

Jenkins build is unstable: Kafka » Kafka Branch Builder » trunk #736

2022-03-03 Thread Apache Jenkins Server
See

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #735

2022-03-03 Thread Apache Jenkins Server
See Changes: -- [...truncated 510374 lines...] [2022-03-04T00:19:01.616Z] 1 warning [2022-03-04T00:19:01.616Z] [2022-03-04T00:19:01.616Z] > Task

[DISCUSS] KIP-824 Allowing dumping segmentlogs limiting the batches in the output

2022-03-03 Thread Sergio Daniel Troiano
https://cwiki.apache.org/confluence/display/KAFKA/KIP-824%3A+Allowing+dumping+segmentlogs+limiting+the+batches+in+the+output

[DISCUSS] KIP-824 Allowing dumping segmentlogs limiting the batches in the output

2022-03-03 Thread Sergio Daniel Troiano
https://cwiki.apache.org/confluence/display/KAFKA/KIP-824%3A+Allowing+dumping+segmentlogs+limiting+the+batches+in+the+output

[jira] [Created] (KAFKA-13707) Refactor - unify the naming convention of in-flight

2022-03-03 Thread Arvin Zheng (Jira)
Arvin Zheng created KAFKA-13707: --- Summary: Refactor - unify the naming convention of in-flight Key: KAFKA-13707 URL: https://issues.apache.org/jira/browse/KAFKA-13707 Project: Kafka Issue

Re: [DISCUSS] KIP-794: Strictly Uniform Sticky Partitioner

2022-03-03 Thread Jun Rao
Hi, Artem, Thanks for the reply. 1. Sounds good. 2. If we don't expect users to change it, we probably could just leave out the new config. In general, it's easy to add a new config, but hard to remove an existing config. 20. The two new configs enable.adaptive.partitioning and

[jira] [Created] (KAFKA-13706) org.apache.kafka.test.MockSelector doesn't remove closed connections from its 'ready' field

2022-03-03 Thread Vincent Jiang (Jira)
Vincent Jiang created KAFKA-13706: - Summary: org.apache.kafka.test.MockSelector doesn't remove closed connections from its 'ready' field Key: KAFKA-13706 URL: https://issues.apache.org/jira/browse/KAFKA-13706

Re: Spotting stale KIPs with a better "Under Discussion" table

2022-03-03 Thread Kirk True
Since this is on GitHub, you might look into GitHub Actions to implement the cron job to update the table. Thanks! On Wed, Mar 2, 2022, at 10:27 AM, Thomas Cooper wrote: > Hi All, > > I am hoping to get more involved in the upstream Kafka community. To that > end, I was trying to keep up with

Re: Spotting stale KIPs with a better "Under Discussion" table

2022-03-03 Thread Kirk True
Hi Tom, This is great! I've just begun reading through the KIPs and I've noticed the status on the KIP list and on the KIP itself isn't always up-to-date. It would be great to have a "consistency checker" to verify high-level status details are consistent and up-to-date. Great work! Thanks,

[VOTE] 3.0.1 RC0

2022-03-03 Thread Mickael Maison
Hello Kafka users, developers and client-developers, This is the first candidate for release of Apache Kafka 3.0.1. Apache Kafka 3.0.1 is a bugfix release and 29 issues have been fixed since 3.0.0. Release notes for the 3.0.1 release:

Re: [DISCUSS] KIP-794: Strictly Uniform Sticky Partitioner

2022-03-03 Thread Artem Livshits
Hi Jun, Thank you for the suggestions. 1. As we discussed offline, we can hardcode the logic for DefaultPartitioner and UniformStickyPartitioner in the KafkaProducer (i.e. the DefaultPartitioner.partition won't get called, instead KafkaProducer would check if the partitioner is an instance of

Re: Proposal to add IBM Power (ppc64le) to apache kafka jenkins CI

2022-03-03 Thread Mickael Maison
Hi Abhijit, Nobody raised concerns so I went ahead an opened a PR to add ppc64le to the Kafka CI: https://github.com/apache/kafka/pull/11833 As a starter I reused the same settings as the ARM build (only running unitTest) and confirmed it's building fine. We can reconsider later if we also want

Jenkins build is unstable: Kafka » Kafka Branch Builder » 3.1 #82

2022-03-03 Thread Apache Jenkins Server
See

Re: [VOTE] KIP-714: Client Metrics and Observability

2022-03-03 Thread Julien Chanaud
+1 As a member of a team which operates several Kafka clusters, I am unequipped when it comes to troubleshooting issues with project teams that did not understand the importance of configuring client-side monitoring. Kafka represents a fraction of their work and they don't have enough experience,

[jira] [Resolved] (KAFKA-13510) KIP-769: Connect APIs to list all connector plugins and retrieve their configuration definitions

2022-03-03 Thread Mickael Maison (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mickael Maison resolved KAFKA-13510. Resolution: Fixed > KIP-769: Connect APIs to list all connector plugins and retrieve

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #733

2022-03-03 Thread Apache Jenkins Server
See

Re: [VOTE] KIP-792: Add "generation" field into consumer protocol

2022-03-03 Thread Luke Chen
Thanks, Ziming! So, now, this KIP vote passed with 3 binding +1 votes (David, Tom, Guozhang) and 1 non-binding +1 vote (Ziming). The vote will be closed. Thanks again. Luke On Thu, Mar 3, 2022 at 5:00 PM deng ziming wrote: > Thank you Luke for this work, > I’m +1(non-binding) > > -- > Best, >

Re: [VOTE] KIP-792: Add "generation" field into consumer protocol

2022-03-03 Thread deng ziming
Thank you Luke for this work, I’m +1(non-binding) -- Best, Ziming Deng > On Dec 1, 2021, at 8:36 AM, Luke Chen wrote: > > Hi all, > > I'd like to start the vote for KIP-792: Add "generation" field into > consumer protocol. > > The goal of this KIP is to allow the assignor/consumer

[jira] [Created] (KAFKA-13705) CoreUtils.swallow uses CoreUtils.logger but not logging parameter

2022-03-03 Thread Kezhu Wang (Jira)
Kezhu Wang created KAFKA-13705: -- Summary: CoreUtils.swallow uses CoreUtils.logger but not logging parameter Key: KAFKA-13705 URL: https://issues.apache.org/jira/browse/KAFKA-13705 Project: Kafka

Re: [VOTE] KIP-792: Add "generation" field into consumer protocol

2022-03-03 Thread Luke Chen
Thanks David! So, with 3 binding +1 votes (David, Tom, Guozhang), the vote passes. Thanks everyone! Luke On Thu, Mar 3, 2022 at 4:34 PM David Jacot wrote: > +1 (binding). Thanks for the KIP! > > On Fri, Jan 28, 2022 at 6:13 PM Tom Bentley wrote: > > > > Hi Luke, > > > > Thanks for the KIP,

Re: [VOTE] KIP-792: Add "generation" field into consumer protocol

2022-03-03 Thread David Jacot
+1 (binding). Thanks for the KIP! On Fri, Jan 28, 2022 at 6:13 PM Tom Bentley wrote: > > Hi Luke, > > Thanks for the KIP, +1 (binding). > > Kind regards, > > Tom > > On Wed, 19 Jan 2022 at 13:16, Luke Chen wrote: > > > Hi all, > > > > Bump this thread to see if there are other comments to this