Build failed in Jenkins: kafka-trunk-jdk10 #506

2018-09-19 Thread Apache Jenkins Server
See Changes: [wangguoz] MINOR: Remove ignored tests that hang, added new versions for EOS tests [wangguoz] MINOR: increase number of unique keys for Streams EOS system test

Jenkins build is back to normal : kafka-trunk-jdk10 #505

2018-09-19 Thread Apache Jenkins Server
See

Re: [VOTE] KIP-291: Have separate queues for control requests and data requests

2018-09-19 Thread Lucas Wang
Hi Jun, Thanks a lot for the detailed explanation. I've restored the wiki to a previous version that does not require config changes, and keeps the current behavior with the proposed changes turned off by default. I'd appreciate it if you can review it again. Thanks! Lucas On Tue, Sep 18, 2018

Jenkins build is back to normal : kafka-0.11.0-jdk7 #401

2018-09-19 Thread Apache Jenkins Server
See

Re: [DISCUSS] KIP-347: Enable batching in FindCoordinatorRequest

2018-09-19 Thread Guozhang Wang
Hello Yishun, I looked further into the change needed on NetworkClient, comparing them with the changes on AdminClient / ConsumerNetworkClient, and I think it is indeed a quite large change needed on the latter two classes if we do not want to touch on NetworkClient. Colin's argument against

Re: [DISCUSS] KIP-362: Dynamic Session Window Support

2018-09-19 Thread Lei Chen
Thanks Matthias. That makes sense. You're right that symmetric merge is necessary to ensure consistency. On the other hand, I kinda feel it defeats the purpose of dynamic gap, which is to update the gap from old value to new value. The symmetric merge always honor the larger gap in both

[jira] [Resolved] (KAFKA-6594) 第二次启动kafka是报错00000000000000000000.timeindex: 另一个程序正在使用此文件,进程无法访问。

2018-09-19 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-6594. -- Resolution: Not A Problem > 第二次启动kafka是报错.timeindex: 另一个程序正在使用此文件,进程无法访问。

Re: [ANNOUNCE] New Kafka PMC member: Dong Lin

2018-09-19 Thread Viktor Somogyi-Vass
Congrats Dong! On Sun, Sep 16, 2018 at 2:44 PM Matt Farmer wrote: > Congrats Dong! > > On Sat, Sep 15, 2018 at 4:40 PM Bill Bejeck wrote: > > > Congrats! > > > > On Sat, Sep 15, 2018 at 1:27 PM Jorge Esteban Quilcate Otoya < > > quilcate.jo...@gmail.com> wrote: > > > > > Congratulations!! > >

***UNCHECKED*** RE: [VOTE] KIP-302 - Enable Kafka clients to use all DNS resolved IP addresses

2018-09-19 Thread Skrzypek, Jonathan
I'm assuming this needs KIP-235 to be merged. Unfortunately I've tripped over some merge issues with git and struggled to fix. Hopefully this is fixed but any help appreciated : https://github.com/apache/kafka/pull/4485 Jonathan Skrzypek -Original Message- From: Eno Thereska

Re: [DISCUSS]: KIP-339: Create a new ModifyConfigs API

2018-09-19 Thread Viktor Somogyi-Vass
I think so, I'm +1 on this. On Sat, Sep 15, 2018 at 8:14 AM Colin McCabe wrote: > On Wed, Aug 15, 2018, at 05:04, Viktor Somogyi wrote: > > Hi, > > > > To weigh-in, I agree with Colin on the API naming, overloads shouldn't > > change behavior. I think all of the Java APIs I've used so far

Re: [VOTE] KIP 368: Allow SASL Connections to Periodically Re-Authenticate

2018-09-19 Thread Rajini Sivaram
Hi Ron, Thanks for the KIP! +1 (binding) On Tue, Sep 18, 2018 at 6:24 PM, Konstantin Chukhlomin wrote: > +1 (non binding) > > > On Sep 18, 2018, at 1:18 PM, michael.kamin...@nytimes.com wrote: > > > > > > > > On 2018/09/18 14:59:09, Ron Dagostino wrote: > >> Hi everyone. I would like to

Re: [VOTE] KIP-367 Introduce close(Duration) to Producer and AdminClient instead of close(long, TimeUnit)

2018-09-19 Thread Jason Gustafson
+1 Thanks for the KIP On Fri, Sep 14, 2018 at 10:24 PM, Colin McCabe wrote: > +1 (non-binding). > > Thanks, Chia-Ping. > > best, > > > On Fri, Sep 14, 2018, at 21:01, Chia-Ping Tsai wrote: > > hi Colin > > > > > I like the idea of having a close(Duration) call. I would rather keep > the

[jira] [Resolved] (KAFKA-7399) FunctionConversions in Streams-Scala should be private

2018-09-19 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-7399. -- Resolution: Fixed > FunctionConversions in Streams-Scala should be private >

***UNCHECKED*** Re: [VOTE] KIP-361: Add Consumer Configuration to Disable Auto Topic Creation

2018-09-19 Thread Jason Gustafson
A bit late here, but I'm +1 as well. Thanks for the KIP. On Mon, Sep 17, 2018 at 8:20 AM, Dhruvil Shah wrote: > Thank you for the votes and discussion, everyone. The KIP has passed with 3 > binding votes (Ismael, Gwen, Matthias) and 5 non-binding votes (Brandon, > Bill, Manikumar, Colin,

Re: Kafka Contributor access

2018-09-19 Thread Srinivas Reddy
Thank you - Srinivas - Typed on tiny keys. pls ignore typos.{mobile app} On Thu 20 Sep, 2018, 01:57 Guozhang Wang, wrote: > Hello Srinivas, > > I've added you to the contributor list and assigned the ticket to you. > Thanks for your interest contributing to Kafka!! > > Guozhang > > On Wed,

Apache Kafka Authentication

2018-09-19 Thread Rasheed Siddiqui
Dear Team, I want to know the detail document and discussion regarding the Kafka Authentication. We are building the Consumer on .Net Platform. We have difficulty in communication with Producer as we have developed Unsecure Consumer. So Please suggest to resolve this issue. Thanks in

***UNCHECKED*** "Create KIP" permissions

2018-09-19 Thread Vasily . Sulatskov
Hi, I'd like to create a KIP, but lack necessary permissions. Can please someone, who controls the permissions, grant me KIP creation rights? My wiki ID is "vasily.sulatskov". -- Best regards, Vasily Sulatskov

[VOTE] KIP-371: Add a configuration to build custom SSL principal name

2018-09-19 Thread Manikumar
Hi All, I would like to start voting on KIP-371, which adds a configuration option for building custom SSL principal names. KIP: https://cwiki.apache.org/confluence/display/KAFKA/KIP-371%3A+Add+a+configuration+to+build+custom+SSL+principal+name Discussion Thread:

Re: [DISCUSS] KIP 368: Allow SASL Connections to Periodically Re-Authenticate

2018-09-19 Thread Ron Dagostino
Thanks, Rajini -- I updated the KIP to fix this. Ron On Wed, Sep 19, 2018 at 4:54 AM Rajini Sivaram wrote: > I should have said `security configs` instead of `channel configs`. > > The KIP says: > >- The configuration option this KIP proposes to add to enable >server-side

Re: [VOTE] KIP 368: Allow SASL Connections to Periodically Re-Authenticate

2018-09-19 Thread Harsha
KIP looks good. +1 (binding) Thanks, Harsha On Wed, Sep 19, 2018, at 7:44 AM, Rajini Sivaram wrote: > Hi Ron, > > Thanks for the KIP! > > +1 (binding) > > On Tue, Sep 18, 2018 at 6:24 PM, Konstantin Chukhlomin > wrote: > > > +1 (non binding) > > > > > On Sep 18, 2018, at 1:18 PM,

Re: Kafka Contributor access

2018-09-19 Thread Srinivas Reddy
My Apache JIRA id is : mrsrinivas -- Srinivas Reddy http://mrsrinivas.com/ (Sent via gmail web) On Wed, 19 Sep 2018 at 18:23, Srinivas Reddy wrote: > Hi, > > I would like to work on KAFKA-7418 as it is not assigned to anyone. > > "Assign to me" option is not available to me. Can someone

Contributor access

2018-09-19 Thread Srinivas Reddy
Hi, I would like to work on KAFKA-7418 as it is not assigned to anyone. "Assign to me" option is not available to me. Can someone help me with that ? Thank you in advance. - Srinivas - Typed on tiny keys. pls ignore typos.{mobile app}

Re: [DISCUSS] KIP 368: Allow SASL Connections to Periodically Re-Authenticate

2018-09-19 Thread Ron Dagostino
Hi Tyler. This KIP is written such that the sever (broker) specifies a session lifetime to the client, and then the client will re-authenticate at a time consistent with that with whatever credentials it has when the re-authentication kicks off. You could specify a low max session lifetime on

Build failed in Jenkins: kafka-trunk-jdk10 #502

2018-09-19 Thread Apache Jenkins Server
See -- Started by an SCM change [EnvInject] - Loading node environment variables. Building remotely on H27 (ubuntu xenial) in workspace

Re: [DISCUSS] KIP 368: Allow SASL Connections to Periodically Re-Authenticate

2018-09-19 Thread Tyler Monahan
Hello, I have a rather odd issue that I think this KIP might fix but wanted to check. I have a kafka setup using SASL/Kerberos and when a broker dies in aws a new one is created using the same name/id. The Kerberos credentials however are different on the new instances and existing

Re: [VOTE] KIP-354 Time-based log compaction policy

2018-09-19 Thread xiongqi wu
Any other votes or comments? Xiongqi (Wesley) Wu On Tue, Sep 11, 2018 at 11:45 AM xiongqi wu wrote: > Yes, more votes and code review. > > Xiongqi (Wesley) Wu > > > On Mon, Sep 10, 2018 at 11:37 PM Brett Rann > wrote: > >> +1 (non binding) from on 0 then, and on the KIP. >> >> Where do we go

Re: [DISCUSS] KIP-370: Remove Orphan Partitions

2018-09-19 Thread xiongqi wu
Any comments? Xiongqi (Wesley) Wu On Mon, Sep 10, 2018 at 3:04 PM xiongqi wu wrote: > Here is the implementation for the KIP 370. > > > https://github.com/xiowu0/kafka/commit/f1bd3085639f41a7af02567550a8e3018cfac3e9 > > > The purpose is to do one time cleanup (after a configured delay) of

Re: Kafka Contributor access

2018-09-19 Thread Guozhang Wang
Hello Srinivas, I've added you to the contributor list and assigned the ticket to you. Thanks for your interest contributing to Kafka!! Guozhang On Wed, Sep 19, 2018 at 6:08 AM, Srinivas Reddy wrote: > My Apache JIRA id is : mrsrinivas > > > > -- > Srinivas Reddy > > http://mrsrinivas.com/ >

Build failed in Jenkins: kafka-trunk-jdk10 #503

2018-09-19 Thread Apache Jenkins Server
See -- Started by an SCM change [EnvInject] - Loading node environment variables. Building remotely on H27 (ubuntu xenial) in workspace

Re: ***UNCHECKED*** "Create KIP" permissions

2018-09-19 Thread Matthias J. Sax
Done. On 9/19/18 4:59 AM, vasily.sulats...@cfm.fr wrote: > Hi, > > I'd like to create a KIP, but lack necessary permissions. Can please > someone, who controls the permissions, grant me KIP creation rights? My > wiki ID is "vasily.sulatskov". > signature.asc Description: OpenPGP digital

Re: Request for contributor permissions

2018-09-19 Thread Matthias J. Sax
Added wiki permission to user doniel0614 (There is two "Daniel Huang" -- hope I picked the correct ID). Also added you as contributor to Jira. -Matthias On 9/18/18 9:09 PM, DANIEL HUANG wrote: > as title > > JIRA ID: doniel0...@gmail.com > Cwiki ID: DANIEL HUANG > > Thanks! >

Build failed in Jenkins: kafka-trunk-jdk10 #504

2018-09-19 Thread Apache Jenkins Server
See -- Started by an SCM change [EnvInject] - Loading node environment variables. Building remotely on H23 (ubuntu xenial) in workspace

[jira] [Created] (KAFKA-7423) Kafka compact topic data missing.

2018-09-19 Thread Hanlin Liu (JIRA)
Hanlin Liu created KAFKA-7423: - Summary: Kafka compact topic data missing. Key: KAFKA-7423 URL: https://issues.apache.org/jira/browse/KAFKA-7423 Project: Kafka Issue Type: Bug

Re: [DISCUSS] KIP 368: Allow SASL Connections to Periodically Re-Authenticate

2018-09-19 Thread Rajini Sivaram
I should have said `security configs` instead of `channel configs`. The KIP says: - The configuration option this KIP proposes to add to enable server-side expired-connection-kill is '*connections.max.reauth.ms *' (not prefixed with listener prefix

[jira] [Created] (KAFKA-7422) Huge memory consumption (leak?) by Kafka Producer

2018-09-19 Thread Shantanu Deshmukh (JIRA)
Shantanu Deshmukh created KAFKA-7422: Summary: Huge memory consumption (leak?) by Kafka Producer Key: KAFKA-7422 URL: https://issues.apache.org/jira/browse/KAFKA-7422 Project: Kafka

***UNCHECKED*** [jira] [Created] (KAFKA-7421) Deadlock in Kafka Connect

2018-09-19 Thread JIRA
Maciej Bryński created KAFKA-7421: - Summary: Deadlock in Kafka Connect Key: KAFKA-7421 URL: https://issues.apache.org/jira/browse/KAFKA-7421 Project: Kafka Issue Type: Improvement

***UNCHECKED*** Re: [DISCUSS] KIP-371: Add a configuration to build custom SSL principal name

2018-09-19 Thread Rajini Sivaram
Hi Manikumar, Unless there is a downside to option 2 (e.g will it impose character limits in the DN), it may be better to go with option 2 for consistency and flexibility. On Wed, Sep 19, 2018 at 5:11 AM, Harsha wrote: > Thanks. I am also leaning towards option 2, as it will help the >

Re: [VOTE] KIP-302 - Enable Kafka clients to use all DNS resolved IP addresses

2018-09-19 Thread Rajini Sivaram
Hi Edo, Thanks for the KIP! +1 (binding) On Tue, Sep 18, 2018 at 3:51 PM, Edoardo Comar wrote: > Hi All, > > I'd like to start the vote on KIP-302: > > https://cwiki.apache.org/confluence/display/KAFKA/KIP- > 302+-+Enable+Kafka+clients+to+use+all+DNS+resolved+IP+addresses > > We'd love to get

Re: [DISCUSS] KIP-371: Add a configuration to build custom SSL principal name

2018-09-19 Thread Manikumar
Thanks for the reviews. Makes sense. I don't see any downsides. Updated the KIP, to go with Option 2. I will be starting the vote thread soon. Thanks, On Wed, Sep 19, 2018 at 2:17 PM Rajini Sivaram wrote: > Hi Manikumar, > > Unless there is a downside to option 2 (e.g will it impose

Re: [VOTE] KIP-302 - Enable Kafka clients to use all DNS resolved IP addresses

2018-09-19 Thread Eno Thereska
+1 (non-binding). Thanks Eno On Wed, Sep 19, 2018 at 10:09 AM, Rajini Sivaram wrote: > Hi Edo, > > Thanks for the KIP! > > +1 (binding) > > On Tue, Sep 18, 2018 at 3:51 PM, Edoardo Comar wrote: > > > Hi All, > > > > I'd like to start the vote on KIP-302: > > > >

[DISCUSS] KIP-373: Add '--help' option to all available Kafka CLI commands

2018-09-19 Thread Attila Sasvári
Hi all, I have just created a KIP to add '--help' option to all available Kafka CLI commands: https://cwiki.apache.org/confluence/display/KAFKA/KIP-373%3A+Add+%27--help%27+option+to+all+available+Kafka+CLI+commands Tracking JIRA: https://issues.apache.org/jira/browse/KAFKA-7418 Regards, -