Re: [DISCUSS] Apache Kafka 3.0.1

Hi, I've created the release plan on the wiki: https://cwiki.apache.org/confluence/display/KAFKA/Release+Plan+3.0.1 Thanks, Mickael On Mon, Feb 7, 2022 at 6:51 PM Guozhang Wang wrote: > > +1, thanks Mickael! > > On Mon, Feb 7, 2022 at 9:27 AM Bruno Cadonna wrote: > > > +1 Thank you! > > > >

Re: [DISCUSS] Apache Kafka 3.0.1

Excellent Mickael. Sounds like a plan +1 On Tue, Feb 8, 2022 at 4:12 AM Mickael Maison wrote: > Hi, > > I've created the release plan on the wiki: > https://cwiki.apache.org/confluence/display/KAFKA/Release+Plan+3.0.1 > > Thanks, > Mickael > > On Mon, Feb 7, 2022 at 6:51 PM Guozhang Wang

Re: Kafka <= 3.1 upgrade RocksDB to v6.27.3?

Thank you Jonathan! Now I understand the situation better. I agree with Guozhang about the waiting times for 3.2.0, 3.0.1, and 3.1.1. Obviously that does not satisfy the organizational requirements you mentioned. Best, Bruno On 07.02.22 23:24, Guozhang Wang wrote: Thanks for the

[jira] [Created] (KAFKA-13654) Extend KStream process with new Processor API

Jorge Esteban Quilcate Otoya created KAFKA-13654: Summary: Extend KStream process with new Processor API Key: KAFKA-13654 URL: https://issues.apache.org/jira/browse/KAFKA-13654

[DISCUSS] KIP-820: Extend KStream process with new Processor API

Hi Dev team, I'd like to start a new discussion thread on Kafka Streams KIP-820: https://cwiki.apache.org/confluence/display/KAFKA/KIP-820%3A+Extend+KStream+process+with+new+Processor+API This KIP is aimed to extend the current `KStream#process` API to return output values that could be chained

[jira] [Created] (KAFKA-13655) Cannot edit clients page

Mario Mastrodicasa created KAFKA-13655: -- Summary: Cannot edit clients page Key: KAFKA-13655 URL: https://issues.apache.org/jira/browse/KAFKA-13655 Project: Kafka Issue Type: Bug

Re: [DISCUSS] KIP-813 Shared State Stores

I just updated the KIP to reflect the things discussed in this thread. As for your questions Guozhang: > 1) How do we handle if the num.partitions of app A's store changelog is > different from the num.tasks of app B's sub-topology with that read-only > store? Or are we going to let each task of

Re: [VOTE] KIP-799: Align behaviour for producer callbacks with documented behaviour

Hi Kirk, Thanks for bringing this to my attention! I hadn't found KAFKA-12841 previously, and so I had created KAFKA-13448 (a duplicate issue) and an associated PR back in November. I was told to create a KIP as it was a change in behaviour, and that's the reason for this KIP. PR #11689

Re: Kafka <= 3.1 upgrade RocksDB to v6.27.3?

No problem, glad that was more clear and thanks for considering it. I totally understand if this is not the type of change to put into a point release. I'd like to understand the release schedule a bit more. Is 3.2 probably coming out in May? Thanks, Jon "Bruno Cadonna" wrote on 2022-02-08

[DISCUSS] KIP-821: Connect Transforms support for nested structures

Hi Dev team, I'd like to start a new discussion thread on Kafka Connect KIP-821: https://cwiki.apache.org/confluence/display/KAFKA/KIP-821%3A+Connect+Transforms+support+for+nested+structures This KIP is aimed to include support for nested structures on the existing SMTs — where this make sense.

Re: [VOTE] KIP-704: Send a hint to partition leader to recover the partition

Hi José, Thanks for the KIP. +1 (binding). best, Colin On Mon, Feb 7, 2022, at 19:03, Luke Chen wrote: > I'm +1 (non-binding) > > Thanks for the KIP! > > Luke > > On Tue, Feb 8, 2022 at 7:42 AM Raman Verma > wrote: > >> +1, thanks Jose. >> >> On Mon, Feb 7, 2022 at 8:56 AM David Jacot wrote:

[jira] [Created] (KAFKA-13656) Connect Transforms support for nested structures

Jorge Esteban Quilcate Otoya created KAFKA-13656: Summary: Connect Transforms support for nested structures Key: KAFKA-13656 URL: https://issues.apache.org/jira/browse/KAFKA-13656

Re: [VOTE] KIP-769: Connect APIs to list all connector plugins and retrieve their configuration definitions

Bumping this vote. We have 1 binding and 4 non-binding votes so far. Let me know if you have any feedback. Thanks, Mickael On Wed, Feb 2, 2022 at 10:13 AM Julien Chanaud wrote: > > Hi Michael, > > I'm very interested in seeing this feature implemented. > > +1 (non-binding) > > Julien > > Le

Re: [VOTE] KIP-769: Connect APIs to list all connector plugins and retrieve their configuration definitions

Hi Mikael, I believe I've seen committers vote on their own threads before; are you allowed to +1 this yourself and bring it to +2 binding? Cheers, Chris On Tue, Feb 8, 2022 at 12:07 PM Mickael Maison wrote: > Bumping this vote. > > We have 1 binding and 4 non-binding votes so far. > Let me

Re: Kafka <= 3.1 upgrade RocksDB to v6.27.3?

We have a 4-month major release cadence in Apache Kafka, and given that 3.1.0 is just released, a tentative estimate for 3.2.0 would be around early June. Guozhang On Tue, Feb 8, 2022 at 8:19 AM Jonathan Albrecht wrote: > > > > No problem, glad that was more clear and thanks for considering

Re: [DISCUSS] KIP-634: Complementary support for headers in Kafka Streams DSL

Hi Dev team, I'd like to revamp the KIP again: https://cwiki.apache.org/confluence/display/KAFKA/KIP-634%3A+Complementary+support+for+headers+and+record+metadata+in+Kafka+Streams+DSL - Reference implementation is now using the latest `Processor` API from KIP-478:

[jira] [Created] (KAFKA-13657) StandardAuthorizer should implement the early start listener logic described in KIP-801

Colin McCabe created KAFKA-13657: Summary: StandardAuthorizer should implement the early start listener logic described in KIP-801 Key: KAFKA-13657 URL: https://issues.apache.org/jira/browse/KAFKA-13657

Re: [DISCUSS] KIP-820: Extend KStream process with new Processor API

Hello Jorge, Thanks for bringing this KIP! I think this is a nice idea to consider using a single overloaded function name for #process, just a couple quick questions after reading the proposal: 1) Does `ValueProcessorContext` have to be a public API? It seems to me that this can be completely

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #669

See Changes: -- [...truncated 367001 lines...] [2022-02-08T19:45:03.184Z] org.apache.kafka.streams.integration.StoreUpgradeIntegrationTest >

Re: [DISCUSS] KIP-813 Shared State Stores

Daan, Thanks for the replies, those make sense to me. On Tue, Feb 8, 2022 at 7:24 AM Daan Gertis wrote: > I just updated the KIP to reflect the things discussed in this thread. > > As for your questions Guozhang: > > > 1) How do we handle if the num.partitions of app A's store changelog is > >

Re: [DISCUSS] KIP-792: Add "generation" field into consumer protocol

Hello Luke, Thanks for the updated KIP, I've taken a look at it and still LGTM. Just a couple minor comments in the wiki: * Both `StickyAssignor` and `CooperativeStickyAssignor` that there's already generation is encoded in user-data bytes, the difference is that the `StickyAssignor`'s user

[jira] [Resolved] (KAFKA-13310) KafkaConsumer cannot jump out of the poll method, and the consumer is blocked in the ConsumerCoordinator method maybeAutoCommitOffsetsSync(Timer timer). Cpu and traffic

[ https://issues.apache.org/jira/browse/KAFKA-13310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-13310. --- Fix Version/s: 3.2.0 Resolution: Fixed > KafkaConsumer cannot jump out of the poll

Build failed in Jenkins: Kafka » Kafka Branch Builder » 3.1 #75

See Changes: -- [...truncated 496604 lines...] [2022-02-08T21:26:44.864Z] ZooKeeperClientTest > testPipelinedGetData() PASSED [2022-02-08T21:26:44.864Z]

Jenkins build is unstable: Kafka » Kafka Branch Builder » trunk #671

See

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #670

See Changes: -- [...truncated 366589 lines...] [Pipeline] } [Pipeline] // timestamps [Pipeline] } [Pipeline] // timeout [Pipeline] } [Pipeline] // stage [Pipeline] }

[jira] [Created] (KAFKA-13658) Upgrade vulnerable dependencies jan 2022

Shivakumar created KAFKA-13658: -- Summary: Upgrade vulnerable dependencies jan 2022 Key: KAFKA-13658 URL: https://issues.apache.org/jira/browse/KAFKA-13658 Project: Kafka Issue Type: Bug

[jira] [Resolved] (KAFKA-13400) offset() is not supported in standby tasks.

[ https://issues.apache.org/jira/browse/KAFKA-13400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-13400. - Resolution: Not A Bug Based on the information provided, the conclusion seems to be