Re: [VOTE] KIP-331 Add default implementation to close() and configure() for Serializer, Deserializer and Serde

2018-09-20 Thread Chia-Ping Tsai
KIP-336[1] has been merged so it is time to activate this thread (KIP-331[2]). Last discussion is about "Should we add FunctionalInterface annotation to Serializer and Deserializer". In discussion of KIP-336 we mentioned that we probably add the default implementation for headless method later.

Build failed in Jenkins: kafka-trunk-jdk10 #510

2018-09-20 Thread Apache Jenkins Server
See Changes: [jason] KAFKA-6923; Refactor Serializer/Deserializer for KIP-336 (#5494) -- [...truncated 1.40 MB...] org.apache.kafka.connect.transforms.ExtractFieldTest >

Build failed in Jenkins: kafka-trunk-jdk8 #2978

2018-09-20 Thread Apache Jenkins Server
See Changes: [jason] KAFKA-6923; Refactor Serializer/Deserializer for KIP-336 (#5494) -- [...truncated 2.33 MB...] org.apache.kafka.streams.test.OutputVerifierTest >

Re: [DISCUSS] KIP-370: Remove Orphan Partitions

2018-09-20 Thread xiongqi wu
Colin, Thanks for the comment. 1) auto.orphan.partition.removal.delay.ms refers to timeout since the first leader and ISR request was received. The idea is we want to wait enough time to receive up-to-dated leaderandISR request and any old or new partitions reassignment requests. 2) Is there

Build failed in Jenkins: kafka-trunk-jdk10 #509

2018-09-20 Thread Apache Jenkins Server
See -- Started by an SCM change [EnvInject] - Loading node environment variables. Building remotely on H23 (ubuntu xenial) in workspace

Re: [DISCUSS] KIP-370: Remove Orphan Partitions

2018-09-20 Thread Colin McCabe
Hi Xiongqi, Thanks for the KIP. Can you be a bit more clear what the timeout auto.orphan.partition.removal.delay.ms refers to? Is the timeout measured since the partition was supposed to be on the broker? Or is the timeout measured since the broker started up? Is there any logic to remove

[jira] [Created] (KAFKA-7428) ConnectionStressSpec: add "action", allow multiple clients

2018-09-20 Thread Colin P. McCabe (JIRA)
Colin P. McCabe created KAFKA-7428: -- Summary: ConnectionStressSpec: add "action", allow multiple clients Key: KAFKA-7428 URL: https://issues.apache.org/jira/browse/KAFKA-7428 Project: Kafka

Build failed in Jenkins: kafka-trunk-jdk10 #508

2018-09-20 Thread Apache Jenkins Server
See -- Started by an SCM change [EnvInject] - Loading node environment variables. Building remotely on H23 (ubuntu xenial) in workspace

Build failed in Jenkins: kafka-trunk-jdk8 #2977

2018-09-20 Thread Apache Jenkins Server
See Changes: [wangguoz] [KAFKA-7379] [streams] send.buffer.bytes should be allowed to set -1 in -- [...truncated 2.68 MB...]

[jira] [Resolved] (KAFKA-6923) Consolidate ExtendedSerializer/Serializer and ExtendedDeserializer/Deserializer

2018-09-20 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson resolved KAFKA-6923. Resolution: Fixed > Consolidate ExtendedSerializer/Serializer and >

Re: [VOTE] KIP-328: Ability to suppress updates for KTables

2018-09-20 Thread John Roesler
Hello all, During review of https://github.com/apache/kafka/pull/5567 for KIP-328, the reviewers raised many good suggestions for the API. The basic design of the suppress operation remains the same, but the config object is (in my opinion) far more ergonomic with their suggestions. I have

Re: [DISCUSS] KIP-362: Dynamic Session Window Support

2018-09-20 Thread Matthias J. Sax
Thanks for following up. Very nice examples! I think, that the window definition for Flink is semantically questionable. If there is only a single record, why is the window defined as [ts, ts+gap]? To me, this definition is not sound and seems to be arbitrary. To define the windows as

[jira] [Created] (KAFKA-7427) kafka.server mBean sometimes reports meaningless rate metrics

2018-09-20 Thread Michael Kairys (JIRA)
Michael Kairys created KAFKA-7427: - Summary: kafka.server mBean sometimes reports meaningless rate metrics Key: KAFKA-7427 URL: https://issues.apache.org/jira/browse/KAFKA-7427 Project: Kafka

Build failed in Jenkins: kafka-trunk-jdk10 #507

2018-09-20 Thread Apache Jenkins Server
See Changes: [wangguoz] [KAFKA-7379] [streams] send.buffer.bytes should be allowed to set -1 in -- [...truncated 2.21 MB...]

Re: [VOTE] KIP-372: Naming Repartition Topics for Joins and Grouping

2018-09-20 Thread Bill Bejeck
Hi All, KIP-372 is now accepted with: - 3 Binding +1 (Damian, Guozhang, Matthias) - 3 Non-binding +1 (Dongjin, John, Bill) Thanks to everyone for the votes. -Bill On Thu, Sep 20, 2018 at 7:30 AM Damian Guy wrote: > +1 (binding) > > On Tue, 18 Sep 2018 at 16:33 Bill Bejeck wrote: > > > All,

[jira] [Resolved] (KAFKA-7379) send.buffer.bytes should be allowed to set -1 in KafkaStreams

2018-09-20 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-7379. -- Resolution: Fixed Fix Version/s: 2.1.0 > send.buffer.bytes should be allowed to set -1

Re: [VOTE] KIP-371: Add a configuration to build custom SSL principal name

2018-09-20 Thread Priyank Shah
+1(non-binding) On 9/20/18, 9:18 AM, "Harsha Chintalapani" wrote: +1 (binding). Thanks, Harsha On September 19, 2018 at 5:19:51 AM, Manikumar (manikumar.re...@gmail.com) wrote: Hi All, I would like to start voting on KIP-371, which adds a

[jira] [Created] (KAFKA-7426) Kafka Compatibility Matrix is missing Kafka 2.0 broker information

2018-09-20 Thread Christophe Jolif (JIRA)
Christophe Jolif created KAFKA-7426: --- Summary: Kafka Compatibility Matrix is missing Kafka 2.0 broker information Key: KAFKA-7426 URL: https://issues.apache.org/jira/browse/KAFKA-7426 Project:

[jira] [Created] (KAFKA-7425) Kafka Broker -Unable to start

2018-09-20 Thread Sathish Yanamala (JIRA)
Sathish Yanamala created KAFKA-7425: --- Summary: Kafka Broker -Unable to start Key: KAFKA-7425 URL: https://issues.apache.org/jira/browse/KAFKA-7425 Project: Kafka Issue Type: Bug

Re: Confluence Wiki access

2018-09-20 Thread Matthias J. Sax
Done :) On 9/20/18 9:53 AM, Srinivas Reddy wrote: > My bad, the username is: mrsrinivas > > > > -- > Srinivas Reddy > > http://mrsrinivas.com/ > > > (Sent via gmail web) > > > On Fri, 21 Sep 2018 at 00:46, Matthias J. Sax wrote: > >> Could not find this user ID. Can you double check?

Re: Confluence Wiki access

2018-09-20 Thread Srinivas Reddy
My bad, the username is: mrsrinivas -- Srinivas Reddy http://mrsrinivas.com/ (Sent via gmail web) On Fri, 21 Sep 2018 at 00:46, Matthias J. Sax wrote: > Could not find this user ID. Can you double check? Also, it the > email-address really your ID? > > I also tried `srinivas96alluri` --

Re: Issue in Creating the Kafka Consumer

2018-09-20 Thread Harsha
It looks like you are trying to connect to SASL Kafka broker? If that's the case make sure you follow the dochttp://kafka.apache.org/documentation.html#security_jaas_client to pass in JAAS config with the KafkaClient section to your consumer. -Harsha On Thu, Sep 20, 2018, at 8:31 AM, Sravanthi

Re: Confluence Wiki access

2018-09-20 Thread Patrick Williams
HI Matthias, Can you help me unsubscribe from all these Kafka and Apache channels please? Tried to follow previous directions but still getting loads of spam Thanks Best, Patrick Williams Head of Sales, UK & Ireland +44 (0)7549 676279 patrick.willi...@storageos.com 20 Midtown 20 Proctor

Re: Confluence Wiki access

2018-09-20 Thread Matthias J. Sax
Could not find this user ID. Can you double check? Also, it the email-address really your ID? I also tried `srinivas96alluri` -- not found either. Note, that JIRA and Wiki is two different account (in case this is your JIRA id). -Matthias On 9/20/18 3:45 AM, Srinivas Reddy wrote: > Greetings,

Issue in Creating the Kafka Consumer

2018-09-20 Thread Sravanthi Gottam
Hi Team, I am facing the issue in creating the Kafka consumer. I am giving the jaas config file in the build path 10:14:00,765 WARN [org.springframework.web.context.support.AnnotationConfigWebApplicationContext] (ServerService Thread Pool -- 84) Exception encountered during context

Re: [VOTE] KIP-371: Add a configuration to build custom SSL principal name

2018-09-20 Thread Harsha Chintalapani
+1 (binding). Thanks, Harsha On September 19, 2018 at 5:19:51 AM, Manikumar (manikumar.re...@gmail.com) wrote: Hi All, I would like to start voting on KIP-371, which adds a configuration option for building custom SSL principal names. KIP:

[jira] [Resolved] (KAFKA-7419) Rolling sum for high frequency sream

2018-09-20 Thread Stanislav Bausov (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stanislav Bausov resolved KAFKA-7419. - Resolution: Fixed > Rolling sum for high frequency sream >

RE: [VOTE] KIP-302 - Enable Kafka clients to use all DNS resolved IP addresses

2018-09-20 Thread Skrzypek, Jonathan
Ok thanks. +1 (non-binding) The only thing I'm not too sure about is the naming around configuration entries for this, both for KIP-235 and KIP-302. KIP-235 expands DNS A records for bootstrap : resolve.canonical.bootstrap.servers.only KIP-302 expands DNS A records for advertised.listeners :

Re: Apache Kafka Authentication

2018-09-20 Thread Vahid Hashemian
Hi Rasheed, This article https://developer.ibm.com/code/howtos/kafka-authn-authz explains how to enable authentication and authorization in a Kafka cluster. Note: it does not cover encryption. Regards. --Vahid On Wed, Sep 19, 2018 at 10:33 PM Rasheed Siddiqui wrote: > Dear Team, > > > > I

Re: [DISCUSS] KIP-373: Add '--help' option to all available Kafka CLI commands

2018-09-20 Thread Attila Sasvári
Hi all, This is just to inform you that this KIP was taken over by Srinivas Reddy. Good luck Srinivas! Regards, - Attila On Wed, Sep 19, 2018 at 1:30 PM Attila Sasvári wrote: > Hi all, > > I have just created a KIP to add '--help' option to all available Kafka > CLI commands: >

Re: [VOTE] KIP-372: Naming Repartition Topics for Joins and Grouping

2018-09-20 Thread Damian Guy
+1 (binding) On Tue, 18 Sep 2018 at 16:33 Bill Bejeck wrote: > All, > > In starting work on the PR for KIP-372, the Grouped interface needed some > method renaming to be more consistent with the other configuration classes > (Joined, Produced, etc.). As such I've updated the Grouped code

Confluence Wiki access

2018-09-20 Thread Srinivas Reddy
Greetings, I need to edit KIP-373, can anyone help me with an access to this wiki id srinivas96all...@gmail.com Thank you in advance. - Srinivas - Typed on tiny keys. pls ignore typos.{mobile app}

[jira] [Created] (KAFKA-7424) State stores restoring from changelog topic not the source topic

2018-09-20 Thread James Hay (JIRA)
James Hay created KAFKA-7424: Summary: State stores restoring from changelog topic not the source topic Key: KAFKA-7424 URL: https://issues.apache.org/jira/browse/KAFKA-7424 Project: Kafka

RE: [VOTE] KIP-302 - Enable Kafka clients to use all DNS resolved IP addresses

2018-09-20 Thread Edoardo Comar
Hi Jonathan we'll update the PR for KIP-302 soon. We do not need KIP-235 actually, they only share the name of the configuration entry. thanks Edo PS - we need votes :-) -- Edoardo Comar IBM Message Hub IBM UK Ltd, Hursley Park, SO21 2JN

Re: [VOTE] KIP-367 Introduce close(Duration) to Producer and AdminClient instead of close(long, TimeUnit)

2018-09-20 Thread Chia-Ping Tsai
Thanks for all votes. KIP-367 has passed!!! binding votes (3) : Matthias J. Sax Harsha Jason Gustafson non-binding votes (6): Dongjin Lee Manikumar Mickael Maison vito jeng Colin McCabe Bill Bejeck Cheers, Chia-Ping On 2018/09/08 18:27:59, Chia-Ping Tsai wrote: > Hi All, > > I'd like to put