Re: [VOTE] KIP-797: Accept duplicate listener on port for IPv4/IPv6

2021-11-22 Thread Josep Prat
Hi Matthew, Thank you for the PR. +1 (non binding) from my side. Best, ——— Josep Prat Aiven Deutschland GmbH Immanuelkirchstraße 26, 10405 Berlin Amtsgericht Charlottenburg, HRB 209739 B Geschäftsführer: Oskari Saarenmaa & Hannu Valtonen m: +491715557497 w: aiven.io e:

Re: [VOTE] KIP-797: Accept duplicate listener on port for IPv4/IPv6

2021-11-22 Thread Ivan Yurchenko
Hi, Thank you for the KIP. +1 (non-binding) Ivan On Tue, 23 Nov 2021 at 04:18, Luke Chen wrote: > Hi Matthew, > Thanks for the KIP. > It makes sense to allow IPv4 and IPv6 listening on the same port for the > listener config. > > +1 (non-binding) > > Thank you. > Luke > > On Mon, Nov 22,

Re: [VOTE] KIP-798 Add possibility to write kafka headers in Kafka Console Producer

2021-11-22 Thread Luke Chen
Hi Florin, Thanks for the update! +1 (non-binding) Thank you. Luke On Tue, Nov 23, 2021 at 2:00 AM Florin Akermann wrote: > Hi Bill and David, > > Thank you both for the vote. > @David: KIP is updated. > > Florin > > On Mon, 22 Nov 2021 at 18:28, David Jacot > wrote: > > > Hi Florin, > > > >

Re: [VOTE} KIP-796: Interactive Query v2

2021-11-22 Thread John Roesler
Thanks for voting and for the discussion, all! The vote on KIP-796 passes with: 3 binding +1 (Bruno, Bill, and myself) 2 non-binding +1 (Patrick and Vasiliki) no vetoes The vote is now closed. If anyone has objections later on, please raise them, though! We will proceed with a series of pull

Re: [VOTE] KIP-797: Accept duplicate listener on port for IPv4/IPv6

2021-11-22 Thread Luke Chen
Hi Matthew, Thanks for the KIP. It makes sense to allow IPv4 and IPv6 listening on the same port for the listener config. +1 (non-binding) Thank you. Luke On Mon, Nov 22, 2021 at 6:28 PM Matthew de Detrich wrote: > Hello everyone, > > I would like to start a vote for KIP-797: Accept duplicate

Re: Request for permission to contribute to Apache Kafka

2021-11-22 Thread Matthias J. Sax
Done. On 11/22/21 11:33 AM, Sarah Story wrote: Hello! I'd like to be added to the contributors list so that I can add a KIP. Jira ID: sarah-story Wiki ID: sarah-story Thank you!

Re: [DISCUSS] KIP-782: Expandable batch size in producer

2021-11-22 Thread Artem Livshits
> I think this KIP would change the behaviour of producers when there are multiple partitions ready to be sent This is correct, the pattern changes and becomes more coarse-grained. But I don't think it changes fairness over the long run. I think it's a good idea to change drainIndex to be

Re: [DISCUSS] Apache Kafka 3.1.0 release

2021-11-22 Thread Chris Egerton
Hi David, I have another blocker to propose. KAFKA-13472 ( https://issues.apache.org/jira/browse/KAFKA-13472) is another regression in Connect caused by recently-merged changes for KAFKA-12487 ( https://issues.apache.org/jira/browse/KAFKA-12487) which can lead to data loss in sink connectors in

[jira] [Created] (KAFKA-13472) Connect can lose track of last committed offsets for topic partitions after partial consumer revocation

2021-11-22 Thread Chris Egerton (Jira)
Chris Egerton created KAFKA-13472: - Summary: Connect can lose track of last committed offsets for topic partitions after partial consumer revocation Key: KAFKA-13472 URL:

[jira] [Created] (KAFKA-13471) Test rolling change of KRaft controller endpoints

2021-11-22 Thread Colin McCabe (Jira)
Colin McCabe created KAFKA-13471: Summary: Test rolling change of KRaft controller endpoints Key: KAFKA-13471 URL: https://issues.apache.org/jira/browse/KAFKA-13471 Project: Kafka Issue

Request for permission to contribute to Apache Kafka

2021-11-22 Thread Sarah Story
Hello! I'd like to be added to the contributors list so that I can add a KIP. Jira ID: sarah-story Wiki ID: sarah-story Thank you!

[jira] [Created] (KAFKA-13470) Fix the handling of secure controller ports

2021-11-22 Thread Colin McCabe (Jira)
Colin McCabe created KAFKA-13470: Summary: Fix the handling of secure controller ports Key: KAFKA-13470 URL: https://issues.apache.org/jira/browse/KAFKA-13470 Project: Kafka Issue Type: Bug

Re: [VOTE] KIP-798 Add possibility to write kafka headers in Kafka Console Producer

2021-11-22 Thread Florin Akermann
Hi Bill and David, Thank you both for the vote. @David: KIP is updated. Florin On Mon, 22 Nov 2021 at 18:28, David Jacot wrote: > Hi Florin, > > Thanks for the KIP. I am +1 (binding). > > There is a small typo in the Proposed Changes section: > `parse.header` should be `parse.headers`. > >

Re: [VOTE] KIP-798 Add possibility to write kafka headers in Kafka Console Producer

2021-11-22 Thread David Jacot
Hi Florin, Thanks for the KIP. I am +1 (binding). There is a small typo in the Proposed Changes section: `parse.header` should be `parse.headers`. Best, David On Mon, Nov 22, 2021 at 6:20 PM Bill Bejeck wrote: > > Hi Florin, > > Thanks for the KIP, this seems like a very useful addition. > >

Re: [VOTE] KIP-798 Add possibility to write kafka headers in Kafka Console Producer

2021-11-22 Thread Bill Bejeck
Hi Florin, Thanks for the KIP, this seems like a very useful addition. +1(binding). -Bill On Mon, Nov 22, 2021 at 12:00 PM Florin Akermann wrote: > Hi Luke and Tom > > @Tom: Thanks for the vote. > > @Luke: Thanks for the feedback. > > I have updated the KIP accordingly with regards to your

Re: [VOTE} KIP-796: Interactive Query v2

2021-11-22 Thread Bill Bejeck
Thanks for the well-detailed KIP, John. It's a +1 (binding) from me. I want to point out one thing which I think is an oversight. The "Example Raw Query" scan includes a line using the `kafkaStreams.serdesForStore` method, but it's listed in the "Rejected Alternatives" section. Thanks, Bill On

Re: [Vote] KIP-787 - MM2 Interface to manage Kafka resources Kafka/KIPs

2021-11-22 Thread Omnia Ibrahim
Hi All, Just thought of bumping this voting thread again to see if we can form a consensus around this. Thanks On Tue, Nov 16, 2021 at 2:16 PM Omnia Ibrahim wrote: > Hi, > I'd like to start a vote on KIP-787 >

Re: [VOTE] KIP-798 Add possibility to write kafka headers in Kafka Console Producer

2021-11-22 Thread Florin Akermann
Hi Luke and Tom @Tom: Thanks for the vote. @Luke: Thanks for the feedback. I have updated the KIP accordingly with regards to your comments on the remaining case (false,false) and the motivation. Regarding the "not only UTF-8": As far as I understand John it is fine to limit the scope for this

Re: [DISCUSS] Apache Kafka 3.1.0 release

2021-11-22 Thread Chris Egerton
Hi David, I'd like to propose KAFKA-13469 ( https://issues.apache.org/jira/browse/KAFKA-13469) as a blocker. It is a regression in Connect caused by recently-merged changes for KAFKA-12226 ( https://issues.apache.org/jira/browse/KAFKA-12226) which leads to duplicate records for source tasks. I

[jira] [Created] (KAFKA-13469) End-of-life offset commit for source task can take place before all records are flushed

2021-11-22 Thread Chris Egerton (Jira)
Chris Egerton created KAFKA-13469: - Summary: End-of-life offset commit for source task can take place before all records are flushed Key: KAFKA-13469 URL: https://issues.apache.org/jira/browse/KAFKA-13469

Re: [VOTE} KIP-796: Interactive Query v2

2021-11-22 Thread Bruno Cadonna
Thanks for the KIP, John! +1 (binding) Best, Bruno On 19.11.21 18:04, Vasiliki Papavasileiou wrote: I think this KIP will greatly improve how we handle IQ in streams so +1 (non-binding) from me. Thank you John! On Thu, Nov 18, 2021 at 9:45 PM Patrick Stuedi wrote: +1 (non-binding),

[jira] [Resolved] (KAFKA-13455) The Apache Kafka quickstart guide does not contain any steps for running Kafka Connect

2021-11-22 Thread Mickael Maison (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mickael Maison resolved KAFKA-13455. Fix Version/s: 3.2.0 Resolution: Fixed > The Apache Kafka quickstart guide does

Build failed in Jenkins: Kafka » kafka-2.6-jdk8 #143

2021-11-22 Thread Apache Jenkins Server
See Changes: [github] MINOR: Bump 2.6 to use 2.6.3 (#11495) -- [...truncated 3.18 MB...] org.apache.kafka.streams.test.ConsumerRecordFactoryTest >

[GitHub] [kafka-site] tombentley merged pull request #385: MINOR: Add Tom Bentley as PMC member

2021-11-22 Thread GitBox
tombentley merged pull request #385: URL: https://github.com/apache/kafka-site/pull/385 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[ANNOUNCE] Apache Kafka 2.7.2

2021-11-22 Thread Mickael Maison
The Apache Kafka community is pleased to announce the release for Apache Kafka 2.7.2 This is a bug fix release and it includes fixes and improvements from 26 JIRAs, including a fix for CVE-2021-38153. All of the changes in this release can be found in the release notes:

[GitHub] [kafka-site] mimaison merged pull request #383: MINOR: Updates for 2.7.2

2021-11-22 Thread GitBox
mimaison merged pull request #383: URL: https://github.com/apache/kafka-site/pull/383 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[ANNOUNCE] Apache Kafka 2.6.3

2021-11-22 Thread Mickael Maison
The Apache Kafka community is pleased to announce the release for Apache Kafka 2.6.3 This is a bug fix release and it includes fixes and improvements from 11 JIRAs, including a fix for CVE-2021-38153. All of the changes in this release can be found in the release notes:

[GitHub] [kafka-site] mimaison merged pull request #382: MINOR: Updates for 2.6.3

2021-11-22 Thread GitBox
mimaison merged pull request #382: URL: https://github.com/apache/kafka-site/pull/382 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [DISCUSS] KIP-682: Connect TimestampConverter support for multiple fields and multiple input formats

2021-11-22 Thread Joshua Grisham
Hi Randall, thanks again for the great feedback! Sorry it took me a minute to get back on this one--I have been a bit full up over the last few months--but now I will try to brush it off and see if we can figure out if it makes sense to move forward and possibly close this one out. Regarding

Re: [DISCUSS] KIP-782: Expandable batch size in producer

2021-11-22 Thread Tom Bentley
Hi Luke, Thanks for the KIP! Currently because buffers are allocated using batch.size it means we can handle records that are that large (e.g. one big record per batch). Doesn't the introduction of smaller buffer sizes (batch.initial.size) mean a corresponding decrease in the maximum record size

[VOTE] KIP-797: Accept duplicate listener on port for IPv4/IPv6

2021-11-22 Thread Matthew de Detrich
Hello everyone, I would like to start a vote for KIP-797: Accept duplicate listener on port for IPv4/IPv6 https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=195726330 The purpose of the KIP is to loosen current validation for non advertised listeners so that you can have an IPv4

Re: [DISCUSS] KIP-714: Client metrics and observability

2021-11-22 Thread Viktor Somogyi-Vass
Hi Magnus, I think this is a very useful addition. We also have a similar (but much more simplistic) implementation of this. Maybe I missed it in the KIP but what about adding metrics about the subscription cache itself? That I think would improve its usability and debuggability as we'd be able

Re: [DISCUSS] KIP-784: Add top-level error code field to DescribeLogDirsResponse

2021-11-22 Thread Magnus Edenhill
Hey Mickael and thanks for the KIP. I'm a bit late to the game, but one small nit for consistency: The global response error codes are typically at the start of the response, usually right after the ThrottleTime. This also makes it easier for the response parser to assign the global error for

Re: [VOTE] KIP-798 Add possibility to write kafka headers in Kafka Console Producer

2021-11-22 Thread Tom Bentley
Hi Florin, Thanks for the KIP! +1 (binding), Kind regards, Tom On Mon, Nov 22, 2021 at 6:51 AM Luke Chen wrote: > Hi Florin, > Thanks for the KIP. > > This KIP makes sense to me. Just a comment that the motivation section is > not clearly explain why this KIP is important. > I think John

Re: [VOTE] KIP-784: Add top-level error code field to DescribeLogDirsResponse

2021-11-22 Thread Tom Bentley
Hi Mickael, It's pretty low value, but I think consistency is a useful trait, and it's easily achievable here. +1 (binding). Kind regards, Tom On Thu, Nov 18, 2021 at 2:56 PM Mickael Maison wrote: > Bumping this thread. > > Let me know if you have any feedback. > > Thanks, > Mickael > > On

Re: [DISCUSS] KIP-792: Add "generation" field into consumer protocol

2021-11-22 Thread Luke Chen
Hello David, For (3): * I suppose that we could add a `generation` field to the JoinGroupRequest instead to do the fencing that you describe while handling the sentinel in the assignor directly. If we would add the `generation` to the request itself, would we need the `generation` in the