[jira] [Resolved] (KAFKA-6879) Controller deadlock following session expiration

2018-05-08 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma resolved KAFKA-6879. Resolution: Fixed > Controller deadlock following session expiration > -

Build failed in Jenkins: kafka-trunk-jdk8 #2629

2018-05-08 Thread Apache Jenkins Server
See Changes: [jqin] KAFKA-6877; Remove completedFetch upon a failed parse if it contains no -- [...truncated 419.82 KB...] kafka.admin.ResetConsumerGroupOffsetTest > testR

[jira] [Created] (KAFKA-6887) Error in I/O with host (java.io.EOFException) raised in producer

2018-05-08 Thread Mohammad Tanvir Tasnim (JIRA)
Mohammad Tanvir Tasnim created KAFKA-6887: - Summary: Error in I/O with host (java.io.EOFException) raised in producer Key: KAFKA-6887 URL: https://issues.apache.org/jira/browse/KAFKA-6887 Proj

[jira] [Resolved] (KAFKA-6390) Update ZooKeeper to 3.4.11, Gradle and other minor updates

2018-05-08 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma resolved KAFKA-6390. Resolution: Fixed > Update ZooKeeper to 3.4.11, Gradle and other minor updates > ---

Jenkins build is back to normal : kafka-trunk-jdk8 #2628

2018-05-08 Thread Apache Jenkins Server
See

Re: [DISCUSS] KIP-285: Connect Rest Extension Plugin

2018-05-08 Thread Magesh Nandakumar
Hi All, I have updated the KIP to reflect changes based on the PR https://github.com/apache/kafka/pull/4931. Its mostly has minor changes to the interfaces and includes details on packages for the interfaces and the classes. Let me know your thoughts. Thanks Magesh On Fri, Apr 27, 2018 at 12:03

Re: [DISCUSS] KIP-297: Externalizing Secrets for Connect Configurations

2018-05-08 Thread Magesh Nandakumar
Hi Robert, Thanks for the KIP. I think, this will be a great addition to the framework. I think, will be great if the KIP can elaborate a little bit more on how implementations would look like with an example. Also, would be good to provide a reference implementation as well. The other questions

Is Connector#initialize(ConnectorContext, List>) a TODO method?

2018-05-08 Thread Chia-Ping Tsai
hi Kafka, I'm reading the connector flow. And I noticed the methods "initialize(ConnectorContext, List>)" and "reconfigure" are not used in production code. Hence, are they still in TODO state? Or they are designed to use rather than to override? Best Regards, Chia-Ping

Jenkins build is back to normal : kafka-trunk-jdk7 #3408

2018-05-08 Thread Apache Jenkins Server
See

Re: [DISCUSS] KIP-295: Add Streams Configuration Allowing for Optional Topology Optimization

2018-05-08 Thread Bill Bejeck
Thanks, Guozhang and Matthias for the comments. I was thinking of changing the config type back to a String and enforcing the values to be "true" or "false", but "none" or "all" is just as good. Since those values seem to work, I'll update the KIP accordingly. Thanks, Bill On Tue, May 8, 2018 a

Re: [DISCUSS] KIP-295: Add Streams Configuration Allowing for Optional Topology Optimization

2018-05-08 Thread Matthias J. Sax
Sounds good to me. On 5/8/18 5:47 PM, Guozhang Wang wrote: > Thanks Matthias. > > I was also thinking about whether in the future we'd want to enable > optimizations at different levels that may or may not impact compatibility. > That's why I asked if we have thought about "allowing part of the >

Jenkins build is back to normal : kafka-trunk-jdk10 #85

2018-05-08 Thread Apache Jenkins Server
See

Build failed in Jenkins: kafka-trunk-jdk8 #2627

2018-05-08 Thread Apache Jenkins Server
See Changes: [ismael] KAFKA-6879; Invoke session init callbacks outside lock to avoid [mjsax] MINOR: add equals()/hashCode() for Produced/Consumed (#4979) -- [...truncate

Re: [DISCUSS] KIP-292: Add transformValues() method to KTable

2018-05-08 Thread Guozhang Wang
To follow on Matthias and Damian's comments here: If we are going to add the overload functions as ``` KTable transformValues(final ValueTransformerSupplier valueTransformerSupplier, final String... stateStoreNames, final Mate

Re: [DISCUSS] KIP-295: Add Streams Configuration Allowing for Optional Topology Optimization

2018-05-08 Thread Guozhang Wang
Thanks Matthias. I was also thinking about whether in the future we'd want to enable optimizations at different levels that may or may not impact compatibility. That's why I asked if we have thought about "allowing part of the optimizations in the future". With that in mind, I'd change my prefere

[jira] [Resolved] (KAFKA-6292) KafkaConsumer ran into Unknown error fetching data for topic-partition caused by integer overflow in FileLogInputStream

2018-05-08 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson resolved KAFKA-6292. Resolution: Fixed > KafkaConsumer ran into Unknown error fetching data for topic-partition c

Re: [DISCUSS] KIP-295: Add Streams Configuration Allowing for Optional Topology Optimization

2018-05-08 Thread Matthias J. Sax
One thought I want to bring up about switching optimization on/off: While for the initial release, a boolean flag seems to be sufficient, I could imagine that we apply different and potentially upgrade-incompatible optimizations in future releases. Thus, to me it would make sense to use a String t

CFP: Kafka Summit San Francisco, 2018

2018-05-08 Thread Jun Rao
Hi, Everyone, Just want to let you know that Kafka Summit San Francisco, 2018 is open for submissions. The deadline for submission is Jun. 16. The conference itself will be held on Oct. 16 - Oct. 17. More details can be found at https://kafka-summit.org/kafka-summit-san-francisco-2018/speakers/

Re: [DISCUSS] KIP-295: Add Streams Configuration Allowing for Optional Topology Optimization

2018-05-08 Thread Ted Yu
Bill:That makes sense. Using boolean should suffice. Original message From: Bill Bejeck Date: 5/8/18 2:48 PM (GMT-08:00) To: dev@kafka.apache.org Subject: Re: [DISCUSS] KIP-295: Add Streams Configuration Allowing for Optional Topology Optimization Thanks for the comments Guoz

Re: [DISCUSS] KIP-295: Add Streams Configuration Allowing for Optional Topology Optimization

2018-05-08 Thread Bill Bejeck
Thanks for the comments Guozhang and Ted. Guozhang: 1) I'll update the KIP in the "Compatibility, Deprecation and Migration Plan" with the expected impact of turning on optimization. But at this point, I have not identified a migration plan that doesn't involve having to stop all instances and

Jenkins build is back to normal : kafka-trunk-jdk8 #2626

2018-05-08 Thread Apache Jenkins Server
See

[DISCUSS] KIP-297: Externalizing Secrets for Connect Configurations

2018-05-08 Thread Robert Yokota
Hi, I would like to start a discussion for KIP-297 to externalize secrets from Kafka Connect configurations. Any feedback is appreciated. < https://cwiki.apache.org/confluence/display/KAFKA/KIP-297%3A+Externalizing+Secrets+for+Connect+Configurations > JIRA:

[jira] [Created] (KAFKA-6886) Externalize Secrets for Kafka Connect Configurations

2018-05-08 Thread Robert Yokota (JIRA)
Robert Yokota created KAFKA-6886: Summary: Externalize Secrets for Kafka Connect Configurations Key: KAFKA-6886 URL: https://issues.apache.org/jira/browse/KAFKA-6886 Project: Kafka Issue Type

[jira] [Created] (KAFKA-6885) DescribeConfigs synonyms are are identical to parent entry for BROKER resources

2018-05-08 Thread Magnus Edenhill (JIRA)
Magnus Edenhill created KAFKA-6885: -- Summary: DescribeConfigs synonyms are are identical to parent entry for BROKER resources Key: KAFKA-6885 URL: https://issues.apache.org/jira/browse/KAFKA-6885 Pro

Build failed in Jenkins: kafka-trunk-jdk10 #84

2018-05-08 Thread Apache Jenkins Server
See Changes: [wangguoz] MINOR: Make Serdes less confusing in Scala (#4963) -- Started by an SCM change [EnvInject] - Loading node environment variables. Building remotely o

Build failed in Jenkins: kafka-trunk-jdk7 #3407

2018-05-08 Thread Apache Jenkins Server
See Changes: [wangguoz] MINOR: Make Serdes less confusing in Scala (#4963) -- Started by an SCM change [EnvInject] - Loading node environment variables. Building remotely

[jira] [Created] (KAFKA-6884) ConsumerGroupCommand should use new AdminClient

2018-05-08 Thread Jason Gustafson (JIRA)
Jason Gustafson created KAFKA-6884: -- Summary: ConsumerGroupCommand should use new AdminClient Key: KAFKA-6884 URL: https://issues.apache.org/jira/browse/KAFKA-6884 Project: Kafka Issue Type:

Re: please subscribe me to dev list

2018-05-08 Thread Matthias J. Sax
It's self-service: https://kafka.apache.org/contact -Matthias On 5/7/18 5:13 PM, Ravi Chinoy wrote: signature.asc Description: OpenPGP digital signature

Kafka system tests contribution

2018-05-08 Thread Andriy Sorokhtey
Hello Kafka team I’d like to contribute to the Kafka system tests. I’ve tried to execute system tests locally and I have some issues. Can anyone give me a hand to figure out what’s wrong? So, I see that multiple system tests are failing when I try to run it with the docker or with vagrant. Maybe

Re: [VOTE] KIP-277 - Fine Grained ACL for CreateTopics API

2018-05-08 Thread Edoardo Comar
Hi, bumping the thread as the current vote count for this KIP is 2 binding +1 5 non-binding +1 so still missing a binding vote please thanks, Edo On 30 April 2018 at 12:49, Manikumar wrote: > +1 (non-binding) > > Thanks > > On Thu, Apr 26, 2018 at 9:59 PM, Colin McCabe wrote: > > > +1 (non-b

Re: [VOTE] KIP-282: Add the listener name to the authentication context

2018-05-08 Thread Mickael Maison
Bumping as it still needs a few votes =) On Wed, Apr 25, 2018 at 8:24 PM, Mickael Maison wrote: > I've updated the KIP to simply expose the String value instead of the > full ListenerName object. > > On Wed, Apr 25, 2018 at 8:10 PM, Mickael Maison > wrote: >> Thanks for the heads up Ismael. In t

Re: [DISCUSS] KIP-292: Add transformValues() method to KTable

2018-05-08 Thread Damian Guy
Initially i thought materializing a store would be overkill, but from a consistency point of view it makes sense to add an overload that takes a `Materialized` and only create the store if that is supplied. On Sun, 6 May 2018 at 17:52 Matthias J. Sax wrote: > Andy, > > thanks for the KIP. I don'

Re: [VOTE] KIP-255: OAuth Authentication via SASL/OAUTHBEARER

2018-05-08 Thread Ron Dagostino
HI everyone. Can we get 2 more binding votes on this KIP (and non-binding votes, too)? Ron On Fri, May 4, 2018 at 11:53 AM, Rajini Sivaram wrote: > Hi Ron, > > +1 (binding) > > Thanks for the KIP! > > Regards, > > Rajini > > On Fri, May 4, 2018 at 4:55 AM, Ron Dagostino wrote: > > > Hi everyo

[jira] [Created] (KAFKA-6883) KafkaShortnamer should allow to convert Kerberos principal name to upper case user name

2018-05-08 Thread Attila Sasvari (JIRA)
Attila Sasvari created KAFKA-6883: - Summary: KafkaShortnamer should allow to convert Kerberos principal name to upper case user name Key: KAFKA-6883 URL: https://issues.apache.org/jira/browse/KAFKA-6883

Re: [DISCUSS] KIP-294 - Enable TLS hostname verification by default

2018-05-08 Thread Rajini Sivaram
Anyone have any concerns on this change? If there are no other comments till tomorrow, I will start vote since it is a straightforward KIP. On Fri, May 4, 2018 at 11:10 PM, Rajini Sivaram wrote: > Hi all, > > I have submitted KIP-294 to make the default value of the config ` > ssl.endpoint.ident

Re: [VOTE] KIP-266: Add TimeoutException for KafkaConsumer#position

2018-05-08 Thread khaireddine Rezgui
+1 2018-05-07 20:35 GMT+01:00 Bill Bejeck : > +1 > > Thanks, > Bill > > On Fri, May 4, 2018 at 7:21 PM, Richard Yu > wrote: > > > Hi all, I would like to bump this thread since discussion in the KIP > > appears to be reaching its conclusion. > > > > > > > > On Thu, Mar 15, 2018 at 3:30 PM, Richa