Re: [DISCUSS] KIP-580: Exponential Backoff for Kafka Clients

Thanks for the KIP Sanjana. I think the motivation is good, but lack of more quantitative analysis. For instance: 1. How much retries we are saving by applying the exponential retry vs static retry? There should be some mathematical relations between the static retry ms, the initial exponential re

[DISCUSS] KIP-580: Exponential Backoff for Kafka Clients

Hi Everyone, I’ve written a KIP about introducing exponential backoff for Kafka clients. Would appreciate any feedback on this. https://cwiki.apache.org/confluence/display/KAFKA/KIP-580%3A+Exponential+Backoff+for+Kafka+Clients Thanks, Sanjana

[jira] [Created] (KAFKA-9720) Update gradle to 6.0+

David Arthur created KAFKA-9720: --- Summary: Update gradle to 6.0+ Key: KAFKA-9720 URL: https://issues.apache.org/jira/browse/KAFKA-9720 Project: Kafka Issue Type: Improvement Componen

Build failed in Jenkins: kafka-trunk-jdk11 #1237

See Changes: [github] KAFKA-9714; Eliminate unused reference to IBP in -- [...truncated 2.91 MB...] org.apache.kafka.streams.TopologyTestDriverTest > shouldPunctuateOnS

Re: [DISCUSS] KIP-577: Allow HTTP Response Headers Configured for Kafka Connect

Hi Aneel, It is great idea. I will update KIP based on your suggestion. Jeff. On 2020/03/13 18:58:23, Aneel Nazareth wrote: > If we're including and excluding paths, it seems like it might make > sense to allow for the configuration of multiple filters. > > We could do this with a pattern si

Build failed in Jenkins: kafka-trunk-jdk11 #1236

See Changes: [github] KAFKA-8768: DeleteRecords request/response automated protocol (#7957) [github] KAFKA-9718; Don't log passwords for AlterConfigs in request logs (#8294) -

[jira] [Resolved] (KAFKA-9715) TransactionStateManager: Eliminate unused reference to interBrokerProtocolVersion

[ https://issues.apache.org/jira/browse/KAFKA-9715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson resolved KAFKA-9715. Resolution: Fixed > TransactionStateManager: Eliminate unused reference to > interBrokerPr

Re: [DISCUSS] KIP-577: Allow HTTP Response Headers Configured for Kafka Connect

If we're including and excluding paths, it seems like it might make sense to allow for the configuration of multiple filters. We could do this with a pattern similar to how Kafka listeners are configured. Something like: response.http.header.filters = myfilter1,myfilter2 response.http.header.myfi

[jira] [Resolved] (KAFKA-9718) Don't log passwords for AlterConfigs requests in request logs

[ https://issues.apache.org/jira/browse/KAFKA-9718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajini Sivaram resolved KAFKA-9718. --- Reviewer: Manikumar Resolution: Fixed > Don't log passwords for AlterConfigs requests i

Re: [DISCUSS] KIP-579: new exception on min.insync.replicas > replication.factor

Hi Mickael, Thanks for your interest in this. The main motivation to NOT make topic creation fail when this mismatch happens is because at the moment it is possible to produce/consume on topics if acks is not set to all. I'm not sure we want to disable this behavior (as we would by failing at topi

Build failed in Jenkins: kafka-trunk-jdk11 #1235

See Changes: [manikumar] KAFKA-9685: Solve Set concatenation perf issue in AclAuthorizer -- [...truncated 2.91 MB...] org.apache.kafka.streams.TopologyTestDriverTest >

Re: [DISCUSS] KIP-579: new exception on min.insync.replicas > replication.factor

Hi Paolo, Thanks for looking at this issue. This can indeed be a source of confusion. I'm wondering if we should prevent the creation of topics with min.insync.replicas > replication.factor? You listed that as a rejected alternative because it requires more changes. However, I can't think of any

Re: 回复：回复：回复：[Vote] KIP-571: Add option to force remove members in StreamsResetter

Thanks Matthias and Guozhang for the feedback. I'm not worrying too much about the member.id exposure as we have done so in a couple of areas. As for the recommended admin client change, I think it makes sense in an encapsulation perspective. Maybe I'm still a bit hesitant as we are losing the flex

[jira] [Created] (KAFKA-9719) Add Integration Test For ensuring the EOS-beta app would crash with broker downgrade

Boyang Chen created KAFKA-9719: -- Summary: Add Integration Test For ensuring the EOS-beta app would crash with broker downgrade Key: KAFKA-9719 URL: https://issues.apache.org/jira/browse/KAFKA-9719 Projec

[jira] [Resolved] (KAFKA-9657) Add configurable throw on unsupported protocol

[ https://issues.apache.org/jira/browse/KAFKA-9657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boyang Chen resolved KAFKA-9657. Resolution: Fixed > Add configurable throw on unsupported protocol > --

Re: [DISCUSS] KIP-577: Allow HTTP Response Headers Configured for Kafka Connect

Hi Aneel, That is really great point. I will update KIP. We need add following properties combining with header configs: includedPaths - CSV of path specs to include excludedPaths - CSV of path specs to exclude includedMimeTypes - CSV of mime types to include excludedMimeTypes - CSV of mime types

NetworkException: The server disconnected before a response was received

Hi we have Brokers: 3 Zookeepers: 3 Servers: 3 Kafka: 0.10.0.1 Zookeeeper: 3.4.3 Very rarely we get NetworkException: Server disconnected before response received. Cluster consists of 3 brokers and 3 zookeepers. Producer server and Kafka cluster are in same network. below are configuration sp

[DISCUSS] KIP-579: new exception on min.insync.replicas > replication.factor

Hi, Following this Jira ticket (https://issues.apache.org/jira/browse/KAFKA-4680), I've created a proposal ( https://cwiki.apache.org/confluence/display/KAFKA/KIP-579%3A+new+exception+on+min.insync.replicas+%3E+replication.factor) to add a new exception/error to be used on min.insync.replicas > re

[jira] [Resolved] (KAFKA-9685) Solve Set concatenation perf issue in AclAuthorizer

[ https://issues.apache.org/jira/browse/KAFKA-9685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikumar resolved KAFKA-9685. -- Fix Version/s: 2.6.0 Resolution: Fixed Issue resolved by pull request 8261 [https://github.com/a

Re: [ANNOUNCE] Apache Kafka 2.4.1

Thanks a lot for running this release Bill! Regards, --Vahid On Fri, Mar 13, 2020 at 2:56 AM Mickael Maison wrote: > Thanks Bill for managing this release! > > On Fri, Mar 13, 2020 at 5:58 AM Guozhang Wang wrote: > > > > Thanks Bill for driving this. And Many thanks to all who've contributed >

Re: [DISCUSS] KIP-577: Allow HTTP Response Headers Configured for Kafka Connect

Hi Jeff, Thanks for the KIP. Will users always want to set identical headers on all responses? Does it make sense to also allow configuration of the HeaderFilter init parameters like "includedPaths", "excludedHttpMethods", etc.? Does it make sense to allow multiple configurations (so that eg. dif

[jira] [Resolved] (KAFKA-7908) retention.ms and message.timestamp.difference.max.ms are tied

[ https://issues.apache.org/jira/browse/KAFKA-7908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andras Katona resolved KAFKA-7908. -- Resolution: Fixed > retention.ms and message.timestamp.difference.max.ms are tied > ---

Re: [VOTE] KIP-518: Allow listing consumer groups per state

+1 (binding) Thanks for the KIP, Mickael! Regards, Rajini On Thu, Mar 12, 2020 at 11:06 PM Colin McCabe wrote: > Thanks, Mickael. +1 (binding) > > best, > Colin > > On Fri, Mar 6, 2020, at 02:05, Mickael Maison wrote: > > Thanks David and Gwen for the votes > > Colin, I believe I've answere

[jira] [Created] (KAFKA-9718) Don't log passwords for AlterConfigs requests in request logs

Rajini Sivaram created KAFKA-9718: - Summary: Don't log passwords for AlterConfigs requests in request logs Key: KAFKA-9718 URL: https://issues.apache.org/jira/browse/KAFKA-9718 Project: Kafka

[jira] [Created] (KAFKA-9717) KafkaStreams#metrics() method randomly throws NullPointerException

Zygimantas created KAFKA-9717: - Summary: KafkaStreams#metrics() method randomly throws NullPointerException Key: KAFKA-9717 URL: https://issues.apache.org/jira/browse/KAFKA-9717 Project: Kafka I

[jira] [Created] (KAFKA-9716) Values of compression-rate and compression-rate-avg are misleading

Christian Kosmowski created KAFKA-9716: -- Summary: Values of compression-rate and compression-rate-avg are misleading Key: KAFKA-9716 URL: https://issues.apache.org/jira/browse/KAFKA-9716 Project:

Re: Add a customized logo for Kafka Streams

Great idea, I would definitely buy the book with that on the cover :-) best regards Patrik On Fri, 13 Mar 2020 at 09:57, Becket Qin wrote: > I also like this one! > > Jiangjie (Becket) Qin > > On Fri, Mar 13, 2020 at 9:07 AM Matthias J. Sax wrote: > > > I personally love it! > > > > -Matthias >

Build failed in Jenkins: kafka-trunk-jdk11 #1234

See Changes: [github] KAFKA-9657: Throw upon offset fetch unsupported stable flag protocol -- [...truncated 2.10 MB...] org.apache.kafka.streams.integration.KTableKTab

Re: [ANNOUNCE] Apache Kafka 2.4.1

Thanks Bill for managing this release! On Fri, Mar 13, 2020 at 5:58 AM Guozhang Wang wrote: > > Thanks Bill for driving this. And Many thanks to all who've contributed to > this release! > > > Guozhang > > On Thu, Mar 12, 2020 at 3:00 PM Matthias J. Sax wrote: > > > Thanks for driving the releas

Re: Add a customized logo for Kafka Streams

I also like this one! Jiangjie (Becket) Qin On Fri, Mar 13, 2020 at 9:07 AM Matthias J. Sax wrote: > I personally love it! > > -Matthias > > On 3/12/20 11:31 AM, Sophie Blee-Goldman wrote: > > How reasonable of it. Let's try this again: > > Streams Logo option 2 > > > < > https://docs.google.co

Jenkins build is back to normal : kafka-trunk-jdk11 #1233

See