[VOTE] KIP-792: Add "generation" field into consumer protocol

2021-11-30 Thread Luke Chen
Hi all, I'd like to start the vote for KIP-792: Add "generation" field into consumer protocol. The goal of this KIP is to allow the assignor/consumer coordinator to have a way to identify the out-of-date members/assignments, to avoid rebalance stuck issues in current protocol. Detailed

Jenkins build is back to normal : Kafka » Kafka Branch Builder » 3.0 #159

2021-11-30 Thread Apache Jenkins Server
See

Re: [DISCUSS] KIP-778 KRaft Upgrades

2021-11-30 Thread Jun Rao
Hi, David, Thanks for the reply. No more questions from me. Jun On Tue, Nov 30, 2021 at 1:52 PM David Arthur wrote: > Thanks Jun, > > 30: I clarified the description of the "upgrade" command to: > > The FEATURE and VERSION arguments can be repeated to indicate an upgrade of > > multiple

Re: [DISCUSS] KIP-778 KRaft Upgrades

2021-11-30 Thread David Arthur
Thanks Jun, 30: I clarified the description of the "upgrade" command to: The FEATURE and VERSION arguments can be repeated to indicate an upgrade of > multiple features in one request. Alternatively, the RELEASE flag can be > given to upgrade to the default versions of the specified release.

Jenkins build is unstable: Kafka » Kafka Branch Builder » 3.1 #27

2021-11-30 Thread Apache Jenkins Server
See

[VOTE] KIP-805: Add range and scan query support in IQ v2

2021-11-30 Thread Vasiliki Papavasileiou
Hello everyone, I would like to start a vote for KIP-805 that adds range and scan KeyValue queries in IQ2. The KIP can be found here: https://cwiki.apache.org/confluence/display/KAFKA/KIP-805%3A+Add+range+and+scan+query+support+in+IQ+v2 Cheers! Vicky

Re: [DISCUSS] KIP-805: Add range and scan query support in IQ v2

2021-11-30 Thread Vasiliki Papavasileiou
Thank you John! Yes, that was a typo from copying and I fixed it. Since there have been no more comments, I will start the vote. Best, Vicky On Tue, Nov 30, 2021 at 5:22 AM John Roesler wrote: > Thanks for the KIP, Vicky! > > This KIP will help fill in the parity gap between IQ and > IQv2. >

Re: Filtering support on Fetch API

2021-11-30 Thread Talat Uyarer
Hi Eric, Thanks for your comments. My goal is apply filter without any serialization. I will generate headers distinct values on Record Batch in producer. Broker will build an index for header values like as timeindex. When consumer apply filter broker will filter only record batch level. Filter

Build failed in Jenkins: Kafka » Kafka Branch Builder » 3.0 #158

2021-11-30 Thread Apache Jenkins Server
See Changes: -- [...truncated 281183 lines...] [2021-11-30T19:58:11.007Z] LogOffsetTest > testGetOffsetsForUnknownTopic() PASSED [2021-11-30T19:58:11.007Z]

[jira] [Created] (KAFKA-13492) IQ Parity: queries for key/value store range and scan

2021-11-30 Thread John Roesler (Jira)
John Roesler created KAFKA-13492: Summary: IQ Parity: queries for key/value store range and scan Key: KAFKA-13492 URL: https://issues.apache.org/jira/browse/KAFKA-13492 Project: Kafka Issue

[jira] [Created] (KAFKA-13491) Implement IQv2 Framework

2021-11-30 Thread John Roesler (Jira)
John Roesler created KAFKA-13491: Summary: Implement IQv2 Framework Key: KAFKA-13491 URL: https://issues.apache.org/jira/browse/KAFKA-13491 Project: Kafka Issue Type: Sub-task

Re: [DISCUSS] KIP-778 KRaft Upgrades

2021-11-30 Thread Jun Rao
Hi, David, Thanks for the reply. Just one more minor comment. 30. ./kafka-features.sh upgrade: It seems that the release param is optional. Could you describe the semantic when release is not specified? Jun On Mon, Nov 29, 2021 at 5:06 PM David Arthur wrote: > Jun, I updated the KIP with the

Build failed in Jenkins: Kafka » Kafka Branch Builder » 3.1 #26

2021-11-30 Thread Apache Jenkins Server
See Changes: -- [...truncated 290027 lines...] [2021-11-30T19:06:36.407Z] AdminZkClientTest > testGetBrokerMetadatas() PASSED [2021-11-30T19:06:36.407Z]

[jira] [Created] (KAFKA-13490) Fix some problems with KRaft createTopics and incrementalAlterConfigs

2021-11-30 Thread Colin McCabe (Jira)
Colin McCabe created KAFKA-13490: Summary: Fix some problems with KRaft createTopics and incrementalAlterConfigs Key: KAFKA-13490 URL: https://issues.apache.org/jira/browse/KAFKA-13490 Project: Kafka

[jira] [Created] (KAFKA-13489) Support different compression type for snapshots

2021-11-30 Thread Jose Armando Garcia Sancio (Jira)
Jose Armando Garcia Sancio created KAFKA-13489: -- Summary: Support different compression type for snapshots Key: KAFKA-13489 URL: https://issues.apache.org/jira/browse/KAFKA-13489 Project:

[jira] [Resolved] (KAFKA-12932) Interfaces for SnapshotReader and SnapshotWriter

2021-11-30 Thread Jose Armando Garcia Sancio (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jose Armando Garcia Sancio resolved KAFKA-12932. Resolution: Fixed > Interfaces for SnapshotReader and

Re: Filtering support on Fetch API

2021-11-30 Thread Eric Azama
Something to keep in mind with your proposal is that you're moving the Decompression and Filtering costs into the Brokers. It probably also adds a new Compression cost if you want the Broker to send compressed data over the network. Centralizing that cost on the cluster may not be desirable and

Re: [VOTE] KIP-799: Align behaviour for producer callbacks with documented behaviour

2021-11-30 Thread Luke Chen
Hi Séamus, Thanks for the KIP! We definitely want to keep the producer callback consistent for all types of errors. Just one comment for the KIP: In the "Proposed Changes" section, could you please "explicitly" describe what placeholder you'll return, in addition to adding a hyperlink to other

Re: [VOTE] KIP-779: Allow Source Tasks to Handle Producer Exceptions

2021-11-30 Thread Tom Bentley
Hi Knowles, No, just the update to the KIP page itself and the KIP index. Cheers, Tom On Mon, Nov 29, 2021 at 6:26 PM Knowles Atchison Jr wrote: > Thank you all for voting! > > KIP-779 has been approved: > > 3 binding votes (John, Mickael, Tom) > 4 non-binding votes (Knowles, Chris S., Chris