Re: [DISCUSS] KIP-565: Using AclCommand,avoid call the global method loadcache in SimpleAclAuthorizer

2020-02-27 Thread Steven Lu
Thanks for your replay, this switch same not the best.I have changed another way to solve this problom,can you help me review the pr: https://github.com/apache/kafka/pull/7706/files On 2020/01/21 09:48:00, Rajini Sivaram wrote: > Hi Steven, > > Thanks for the KIP. A few questions/comments:

Build failed in Jenkins: kafka-2.4-jdk8 #158

2020-02-27 Thread Apache Jenkins Server
See Changes: [bill] throttle consumer timeout increase (#8188) [github] MINOR: Update upgrade guide for ZK (#8182) -- [...truncated 5.57 MB...]

[jira] [Reopened] (KAFKA-8460) Flaky Test PlaintextConsumerTest#testLowMaxFetchSizeForRequestAndPartition

2020-02-27 Thread Boyang Chen (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-8460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boyang Chen reopened KAFKA-8460: > Flaky Test PlaintextConsumerTest#testLowMaxFetchSizeForRequestAndPartition >

Jenkins build is back to normal : kafka-trunk-jdk8 #4281

2020-02-27 Thread Apache Jenkins Server
See

Build failed in Jenkins: kafka-trunk-jdk11 #1200

2020-02-27 Thread Apache Jenkins Server
See Changes: [github] throttle consumer timeout increase (#8188) -- [...truncated 2.89 MB...] org.apache.kafka.streams.test.ConsumerRecordFactoryTest >

Re: [KAFKA-557] Add emit on change support for Kafka Streams

2020-02-27 Thread Richard Yu
Hi all, @John Will add some notes accordingly. To all: Thanks for all your input! It looks like we can wrap up this discussion thread then. I've started a vote thread, so please feel free to cast your vote there! We should be pretty close. :) Cheers, Richard On Thu, Feb 27, 2020 at 2:34 PM

Re: 回复:[Vote] KIP-571: Add option to force remove members in StreamsResetter

2020-02-27 Thread Sophie Blee-Goldman
Thanks for the KIP, +1 (non-binding) On Thu, Feb 27, 2020 at 12:40 PM Boyang Chen wrote: > Thanks Feyman, +1 (non-binding) > > On Thu, Feb 27, 2020 at 9:25 AM John Roesler wrote: > > > Thanks for the proposal! > > > > I'm +1 (binding) > > -John > > > > On Wed, Feb 26, 2020, at 19:41,

Build failed in Jenkins: kafka-2.5-jdk8 #48

2020-02-27 Thread Apache Jenkins Server
See Changes: [wangguoz] Adapt docs about metrics of Streams according to KIP-444 (#8171) [ismael] MINOR: Revert Jetty to 9.4.25 (#8183) [bill] throttle consumer timeout increase (#8188)

[jira] [Created] (KAFKA-9623) Streams will attempt to commit during shutdown if rebalance is in progress

2020-02-27 Thread Guozhang Wang (Jira)
Guozhang Wang created KAFKA-9623: Summary: Streams will attempt to commit during shutdown if rebalance is in progress Key: KAFKA-9623 URL: https://issues.apache.org/jira/browse/KAFKA-9623 Project:

Build failed in Jenkins: kafka-trunk-jdk11 #1199

2020-02-27 Thread Apache Jenkins Server
See Changes: [github] Adapt docs about metrics of Streams according to KIP-444 (#8171) [github] MINOR: Revert Jetty to 9.4.25 (#8183) -- [...truncated 5.85 MB...]

Build failed in Jenkins: kafka-trunk-jdk8 #4280

2020-02-27 Thread Apache Jenkins Server
See Changes: [github] Adapt docs about metrics of Streams according to KIP-444 (#8171) -- [...truncated 5.82 MB...] org.apache.kafka.streams.TopologyTestDriverTest >

Build failed in Jenkins: kafka-2.5-jdk8 #47

2020-02-27 Thread Apache Jenkins Server
See Changes: [mumrah] Update year in NOTICE [wangguoz] MINOR: Remove tag from metric to measure process-rate on source nodes -- [...truncated 5.86 MB...]

Re: [KAFKA-557] Add emit on change support for Kafka Streams

2020-02-27 Thread John Roesler
Hi Richard, Thanks for the update! I read it over, and overall it looks good! I have only a minor concern about the rate metric definition: > The rate option indicates the ratio of records dropped to actual volume of > records passing through the task That's not the definition of a "rate". It

Re: [DISCUSS] KIP-574: CLI Dynamic Configuration with file input

2020-02-27 Thread Aneel Nazareth
I've created a PR for a potential implementation of this: https://github.com/apache/kafka/pull/8184 if we decide to go ahead with this KIP. On Wed, Feb 26, 2020 at 12:36 PM Aneel Nazareth wrote: > Hi, > > I'd like to discuss adding a new argument to kafka-configs.sh > (ConfigCommand.scala). > >

[jira] [Created] (KAFKA-9622) Improve tests to detect post-processing failures in Jetty request handling.

2020-02-27 Thread Rigel Bezerra de Melo (Jira)
Rigel Bezerra de Melo created KAFKA-9622: Summary: Improve tests to detect post-processing failures in Jetty request handling. Key: KAFKA-9622 URL: https://issues.apache.org/jira/browse/KAFKA-9622

[jira] [Created] (KAFKA-9621) AdminClient listOffsets operation does not respect retries and backoff

2020-02-27 Thread Sanjana Kaundinya (Jira)
Sanjana Kaundinya created KAFKA-9621: Summary: AdminClient listOffsets operation does not respect retries and backoff Key: KAFKA-9621 URL: https://issues.apache.org/jira/browse/KAFKA-9621

[jira] [Resolved] (KAFKA-7932) Streams needs to handle new Producer exceptions

2020-02-27 Thread John Roesler (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-7932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Roesler resolved KAFKA-7932. - Resolution: Duplicate Subsumed by https://issues.apache.org/jira/browse/KAFKA-9274 > Streams

[jira] [Resolved] (KAFKA-9091) KIP-538: Add a metric tracking the number of open connections with a given SSL cipher type

2020-02-27 Thread David Arthur (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Arthur resolved KAFKA-9091. - Resolution: Fixed > KIP-538: Add a metric tracking the number of open connections with a given

Re: [DISCUSS] KIP-572: Improve timeouts and retires in Kafka Streams

2020-02-27 Thread Guozhang Wang
Hello John, I'll make note that you owe me a beer now :) I think I'm leaning towards your approach as well based on my observations on previously reported timeout exceptions in the past. I once left some thoughts on Matthias' PR here

Jenkins build is back to normal : kafka-trunk-jdk11 #1198

2020-02-27 Thread Apache Jenkins Server
See

Jenkins build is back to normal : kafka-trunk-jdk8 #4279

2020-02-27 Thread Apache Jenkins Server
See

[jira] [Created] (KAFKA-9620) Task revocation failure could introduce remaining unclean tasks

2020-02-27 Thread Boyang Chen (Jira)
Boyang Chen created KAFKA-9620: -- Summary: Task revocation failure could introduce remaining unclean tasks Key: KAFKA-9620 URL: https://issues.apache.org/jira/browse/KAFKA-9620 Project: Kafka

[VOTE] KIP-557: Add emit on change support for Kafka Streams

2020-02-27 Thread Richard Yu
Hi all, I am proposing a new optimization to Kafka Streams which would greatly reduce the number of idempotent updates (or no-ops) in the Kafka Streams DAG. A number of users have been interested in this feature, so it would be nice to pass this one in. For information, the KIP is described

Re: [KAFKA-557] Add emit on change support for Kafka Streams

2020-02-27 Thread Richard Yu
Hi all, I might've made a minor mistake. The processor node level is level 3, not level 1. I will correct the KIP accordingly. After looking over things, I decided to start the voting thread this afternoon. Cheers, Richard On Thu, Feb 27, 2020 at 12:29 PM Richard Yu wrote: > Hi Bruno, Hi

Re: [KAFKA-557] Add emit on change support for Kafka Streams

2020-02-27 Thread Richard Yu
Hi Bruno, Hi John, Thanks for your comments! I updated the KIP accordingly, and it looks like for quite a few points. I was doing some beating around the bush which could've been avoided. Looks like we can reduce the metric to Level 1 (per processor node) then. I've cleaned up most of the

Re: [DISCUSS] KIP-569: DescribeConfigsResponse - Update the schema to include datatype of the field

2020-02-27 Thread Shailesh Panwar
Thanks Colin for the inputs. Regarding *I think most users of the DescribeConfigs API do not want to get help text or configuration schema information. * There is already a precedence of including this information as part of Connect Config - both type and documentation - and we have found it

[DISCUSS] KAFKA-4680: min.insync.replica can be set > replication factor

2020-02-27 Thread Paolo Moriello
Hello, I'd like to take up this Jira ticket . This is an old ticket, marked as a Kafka bug. Before moving forward, I'd like to open a discussion on what would be the best approach to take on when doing the validation, as well as discuss about

Re: [DISCUSS] KIP-572: Improve timeouts and retires in Kafka Streams

2020-02-27 Thread John Roesler
Hi Matthias, Thanks for the proposal! I think this will be a wonderful improvement to Streams. In particular, thanks for the motivation. It would indeed be nice not to have to set long timeout configs and block individual client requests in order to cope with transient slow responses. I'm very

[jira] [Created] (KAFKA-9619) Receiving duplicates when application is configured for exactly once

2020-02-27 Thread Cristian Manoliu (Jira)
Cristian Manoliu created KAFKA-9619: --- Summary: Receiving duplicates when application is configured for exactly once Key: KAFKA-9619 URL: https://issues.apache.org/jira/browse/KAFKA-9619 Project:

Re: 回复:[Vote] KIP-571: Add option to force remove members in StreamsResetter

2020-02-27 Thread Boyang Chen
Thanks Feyman, +1 (non-binding) On Thu, Feb 27, 2020 at 9:25 AM John Roesler wrote: > Thanks for the proposal! > > I'm +1 (binding) > -John > > On Wed, Feb 26, 2020, at 19:41, feyman2009 wrote: > > Updated with the KIP link: > > >

[jira] [Created] (KAFKA-9618) Failed state store deletion could lead to task file not found

2020-02-27 Thread Boyang Chen (Jira)
Boyang Chen created KAFKA-9618: -- Summary: Failed state store deletion could lead to task file not found Key: KAFKA-9618 URL: https://issues.apache.org/jira/browse/KAFKA-9618 Project: Kafka

Re: 回复:[Vote] KIP-571: Add option to force remove members in StreamsResetter

2020-02-27 Thread John Roesler
Thanks for the proposal! I'm +1 (binding) -John On Wed, Feb 26, 2020, at 19:41, feyman2009 wrote: > Updated with the KIP link: > https://cwiki.apache.org/confluence/display/KAFKA/KIP-571%3A+Add+option+to+force+remove+members+in+StreamsResetter > > >

Re: 回复:[Discuss] KIP-571: Add option to force remove members in StreamsResetter

2020-02-27 Thread John Roesler
Hey Feyman, Thanks for starting the vote. While reviewing the discussion I saw one thing that should be in the KIP: > If it is used upon the older clusters like 2.3, UnsupportedVersionException > will be thrown. I'll cast my vote now. Thanks, -John On Wed, Feb 26, 2020, at 19:40, feyman2009

Re: [ANNOUNCE] New committer: Konstantine Karantasis

2020-02-27 Thread Konstantine Karantasis
Thank you all! It's an honor and a great responsibility. Really looking forward to being helpful to the Apache Kafka community on this new role. Warm regards! Konstantine On Thu, Feb 27, 2020 at 8:03 AM Dongjin Lee wrote: > Congratulations, Konstantine! > > Cheers, > Dongjin > > On Thu, Feb

Re: Jira access

2020-02-27 Thread Guozhang Wang
Hello Paolo, I've added you to Kafka JIRA. Guozhang On Thu, Feb 27, 2020 at 6:29 AM Paolo Moriello wrote: > Hello, > > Can you please add me as a contributor to Jira? > > My Jira username: paolomoriello > > Thanks, > Paolo > -- -- Guozhang

Re: [DISCUSS] KIP-508: Make Suppression State Queriable - rebooted.

2020-02-27 Thread John Roesler
Hi Dongjin, No problem; glad we got it sorted out. Thanks again for picking this up! -John On Wed, Feb 26, 2020, at 09:24, Dongjin Lee wrote: > > I was under the impression that you wanted to expand the scope of the KIP > to additionally allow querying the internal buffer, not just the result.

subscribe kafka dev mail

2020-02-27 Thread Walker Xia
subscribe kafka dev mail

Re: [ANNOUNCE] New committer: Konstantine Karantasis

2020-02-27 Thread Dongjin Lee
Congratulations, Konstantine! Cheers, Dongjin On Thu, Feb 27, 2020 at 8:26 PM Bruno Cadonna wrote: > Congrats, Konstantine! Excellent! > > Best, > Bruno > > On Thu, Feb 27, 2020 at 11:28 AM Rajini Sivaram > wrote: > > > > Congratulations Konstantine! > > > > On Thu, Feb 27, 2020 at 9:57 AM

[jira] [Created] (KAFKA-9617) Replica Fetcher can mark partition as failed when max.message.bytes is changed

2020-02-27 Thread Stanislav Kozlovski (Jira)
Stanislav Kozlovski created KAFKA-9617: -- Summary: Replica Fetcher can mark partition as failed when max.message.bytes is changed Key: KAFKA-9617 URL: https://issues.apache.org/jira/browse/KAFKA-9617

Jira access

2020-02-27 Thread Paolo Moriello
Hello, Can you please add me as a contributor to Jira? My Jira username: paolomoriello Thanks, Paolo

Re: [KAFKA-557] Add emit on change support for Kafka Streams

2020-02-27 Thread Bruno Cadonna
Hi John, I agree with you. It is better to measure the metric on processor node level. The users can do the rollup to task-level by themselves. Best, Bruno On Thu, Feb 27, 2020 at 12:09 AM John Roesler wrote: > > Hi Richard, > > I've been making a final pass over the KIP. > > Re: Proposed

Build failed in Jenkins: kafka-trunk-jdk11 #1197

2020-02-27 Thread Apache Jenkins Server
See Changes: [github] KAFKA-9607: Do not clear partition queues during close (#8168) [github] HOTFIX: fix failing test -- [...truncated 5.85 MB...]

Re: [ANNOUNCE] New committer: Konstantine Karantasis

2020-02-27 Thread Bruno Cadonna
Congrats, Konstantine! Excellent! Best, Bruno On Thu, Feb 27, 2020 at 11:28 AM Rajini Sivaram wrote: > > Congratulations Konstantine! > > On Thu, Feb 27, 2020 at 9:57 AM Mickael Maison > wrote: > > > Congratulations Konstantine! Well deserved > > > > On Thu, Feb 27, 2020 at 7:11 AM Satish

Re: [ANNOUNCE] New committer: Konstantine Karantasis

2020-02-27 Thread Rajini Sivaram
Congratulations Konstantine! On Thu, Feb 27, 2020 at 9:57 AM Mickael Maison wrote: > Congratulations Konstantine! Well deserved > > On Thu, Feb 27, 2020 at 7:11 AM Satish Duggana > wrote: > > > > Congrats Konstantine!! > > > > On Thu, Feb 27, 2020 at 12:35 PM Tom Bentley > wrote: > > > > > >

Re: [ANNOUNCE] New committer: Konstantine Karantasis

2020-02-27 Thread Mickael Maison
Congratulations Konstantine! Well deserved On Thu, Feb 27, 2020 at 7:11 AM Satish Duggana wrote: > > Congrats Konstantine!! > > On Thu, Feb 27, 2020 at 12:35 PM Tom Bentley wrote: > > > > Congratulations! > > > > On Thu, Feb 27, 2020 at 6:43 AM David Jacot wrote: > > > > > Congrats! > > > > >

[jira] [Resolved] (KAFKA-9609) Memory Leak in Kafka Producer

2020-02-27 Thread Jira
[ https://issues.apache.org/jira/browse/KAFKA-9609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sönke Liebau resolved KAFKA-9609. - Assignee: Sönke Liebau Resolution: Not A Bug As discussed in the comments I do not believe

Build failed in Jenkins: kafka-trunk-jdk8 #4278

2020-02-27 Thread Apache Jenkins Server
See Changes: [github] HOTFIX: fix failing test -- [...truncated 5.82 MB...] org.apache.kafka.streams.test.OutputVerifierTest >

Build failed in Jenkins: kafka-2.5-jdk8 #46

2020-02-27 Thread Apache Jenkins Server
See Changes: [rhauch] KAFKA-9601: Stop logging raw connector config values (#8165) -- [...truncated 5.86 MB...] org.apache.kafka.streams.TopologyTestDriverTest >

Build failed in Jenkins: kafka-trunk-jdk11 #1196

2020-02-27 Thread Apache Jenkins Server
See Changes: [github] MINOR: Remove tag from metric to measure process-rate on source nodes -- [...truncated 1.71 MB...] kafka.controller.ControllerChannelManagerTest >