Re: [VOTE} KIP-733: change Kafka Streams default replication factor config

2021-04-23 Thread Sophie Blee-Goldman
That's a good summary of the situation in my mind. Definitely +1 to highlighting each of these specifically in the KIP On Fri, Apr 23, 2021 at 6:19 PM Ismael Juma wrote: > Thanks for the comments. Is the following fair? > > 1. It's good that upgrades are not affected under normal circumstances

Re: [VOTE} KIP-733: change Kafka Streams default replication factor config

2021-04-23 Thread Ismael Juma
Thanks for the comments. Is the following fair? 1. It's good that upgrades are not affected under normal circumstances and it mitigates the compatibility impact greatly. 2. We're saying that the previous behavior of defaulting to 1 is dangerous and we don't want to fallback to that. 3. The main

Re: [DISCUSS] KIP-735: Increase default consumer session timeout

2021-04-23 Thread Ismael Juma
Thanks for the KIP, +1. Ismael On Fri, Apr 23, 2021 at 9:29 AM Jason Gustafson wrote: > Hi All, > > I've created a KIP to change the default consumer session timeout as well > as some related behavior: > >

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #66

2021-04-23 Thread Apache Jenkins Server
See

Re: [DISCUSS] KIP-725: Streamlining configurations for TimeWindowedDeserializer.

2021-04-23 Thread Sophie Blee-Goldman
Thanks Sagar, these changes make sense to me. I don't think we need to call for a new vote unless there are any concerns raised, but I feel this is probably not too controversial. Thanks for the update On Fri, Apr 23, 2021 at 3:17 AM Sagar wrote: > Hi All, > > After working on the changes

Re: [DISCUSS] KIP-735: Increase default consumer session timeout

2021-04-23 Thread Bill Bejeck
Hi Jason, Thanks for the well-written KIP. >From the reasons outlined in the KIP, I think this a great change. -Bill On Fri, Apr 23, 2021 at 2:52 PM Sophie Blee-Goldman wrote: > Hey Jason, > > Thanks for the KIP, I think increasing the default session timeout would be > great. The choice of

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #65

2021-04-23 Thread Apache Jenkins Server
See

Re: [DISCUSS] KIP-735: Increase default consumer session timeout

2021-04-23 Thread Sophie Blee-Goldman
Hey Jason, Thanks for the KIP, I think increasing the default session timeout would be great. The choice of 45s sounds reasonable to me. -Sophie On Fri, Apr 23, 2021 at 9:29 AM Jason Gustafson wrote: > Hi All, > > I've created a KIP to change the default consumer session timeout as well > as

RE: Re: [DISCUSS] KIP-679 Producer will enable the strongest delivery guarantee by default

2021-04-23 Thread Soumyajit Sahu
I would like to raise an issue with making enable.idempotence=true by default. This has the ability to crash a broker with OutOfMemory exception whenever there are too many producerIds. This can take many current deployments by surprise. I would suggest to hold on to this change until we have

[jira] [Created] (KAFKA-12712) KRaft: Missing controller.quorom.voters config not properly handled

2021-04-23 Thread Magnus Edenhill (Jira)
Magnus Edenhill created KAFKA-12712: --- Summary: KRaft: Missing controller.quorom.voters config not properly handled Key: KAFKA-12712 URL: https://issues.apache.org/jira/browse/KAFKA-12712 Project:

[DISCUSS] KIP-735: Increase default consumer session timeout

2021-04-23 Thread Jason Gustafson
Hi All, I've created a KIP to change the default consumer session timeout as well as some related behavior: https://cwiki.apache.org/confluence/display/KAFKA/KIP-735%3A+Increase+default+consumer+session+timeout. Have a look and let me know what you think. -Jason

[jira] [Created] (KAFKA-12711) Add a back off option to Replace thread

2021-04-23 Thread Walker Carlson (Jira)
Walker Carlson created KAFKA-12711: -- Summary: Add a back off option to Replace thread Key: KAFKA-12711 URL: https://issues.apache.org/jira/browse/KAFKA-12711 Project: Kafka Issue Type:

CFP for ApacheCon 2021 closes in ONE WEEK

2021-04-23 Thread Rich Bowen
[You are receiving this because you're subscribed to one or more dev@ mailing lists for an Apache project, or the ApacheCon Announce list.] Time is running out to submit your talk for ApacheCon 2021. The Call for Presentations for ApacheCon @Home 2021, focused on Europe and North America time

[GitHub] [kafka-site] cadonna merged pull request #353: Add Bruno Cadonna to committers

2021-04-23 Thread GitBox
cadonna merged pull request #353: URL: https://github.com/apache/kafka-site/pull/353 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service,

[VOTE] KIP-734: Improve AdminClient.listOffsets to return timestamp and offset for the record with the largest timestamp

2021-04-23 Thread Thomas Scott
Hey all, I'm starting the voting on KIP-734. https://cwiki.apache.org/confluence/display/KAFKA/KIP-734%3A+Improve+AdminClient.listOffsets+to+return+timestamp+and+offset+for+the+record+with+the+largest+timestamp Thanks Tom

Re: [DISCUSS] KIP-725: Streamlining configurations for TimeWindowedDeserializer.

2021-04-23 Thread Sagar
Hi All, After working on the changes proposed in the KIP, it was pointed out by Sophie that the KIP needs to be upgraded to include Serialisers as well. In line with this, I. have updated the KIP with the following changes: 1) Renamed the newly proposed config window.inner.class.deserialiser to

[DISCUSS] KIP-334 Include partitions in exceptions during consumer record deserialization/validation (Round 2)

2021-04-23 Thread Sarwar Bhuiyan
Hi all, I'm reviving this discussion after perusing the vote thread created by Stan. I believe the KIP is already revised to include Jason and Colin's suggestion of using a RecordDeserializationException. It signals to the user that something needs to be done (whether skipping the record as shown

[GitHub] [kafka-site] cadonna opened a new pull request #353: Add Bruno Cadonna to committers

2021-04-23 Thread GitBox
cadonna opened a new pull request #353: URL: https://github.com/apache/kafka-site/pull/353 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this

Re: [VOTE] KIP-334 Include partitions in exceptions raised during consumer record deserialization/validation

2021-04-23 Thread Sarwar Bhuiyan
Thanks Colin, I'll open a new discussion thread. It does look like the KIP has been updated with your and Jason's suggestions but not Mathias' which is a different direction (splitting into separate exceptions for "corrupt" records and auto-skipping those). On Thu, Apr 22, 2021 at 10:30 PM