[jira] [Updated] (KAFKA-5165) Kafka Logs Cleanup Not happening, Huge File Growth - Windows

2017-05-04 Thread Manikandan P (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikandan P updated KAFKA-5165: Affects Version/s: 0.9.0.1 > Kafka Logs Cleanup Not happening, Huge File Growth - Windows >

Build failed in Jenkins: kafka-trunk-jdk7 #2147

2017-05-04 Thread Apache Jenkins Server
See Changes: [wangguoz] HOTFIX: fix potentially hanging test -- [...truncated 1.64 MB...] kafka.integration.SaslSslTopicMetadataTest > testAutoCreateTopicWithCollision

[jira] [Assigned] (KAFKA-4801) Transient test failure (part 2): ConsumerBounceTest.testConsumptionWithBrokerFailures

2017-05-04 Thread Armin Braun (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Armin Braun reassigned KAFKA-4801: -- Assignee: Armin Braun (was: Jason Gustafson) > Transient test failure (part 2): >

[jira] [Commented] (KAFKA-4801) Transient test failure (part 2): ConsumerBounceTest.testConsumptionWithBrokerFailures

2017-05-04 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15996438#comment-15996438 ] Ismael Juma commented on KAFKA-4801: [~original-brownbear], feel free to try to reproduce this. Given

Permission request to create a KIP

2017-05-04 Thread UMESH CHAUDHARY
Hello Mates, I need to start a KIP for KAFKA-5057 under this wiki page but looks like I don't have sufficient permissions to create a child page under "Apache Kafka"

Re: Request to add to the contributor list

2017-05-04 Thread Amit Daga
Thank you Guozhang. On Thu, May 4, 2017 at 2:00 AM, Guozhang Wang wrote: > Hi Amit, > > I have added you to the contributor list and assigned 4996 to you. Cheers. > > Will also review your PR soon. > > > Guozhang > > > On Tue, May 2, 2017 at 5:43 AM, Amit Daga

[GitHub] kafka pull request #2783: HOTFIX: fix potentially hanging test shouldAddStat...

2017-05-04 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/2783 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Commented] (KAFKA-4801) Transient test failure (part 2): ConsumerBounceTest.testConsumptionWithBrokerFailures

2017-05-04 Thread Armin Braun (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15996442#comment-15996442 ] Armin Braun commented on KAFKA-4801: [~ijuma] will take a look very soon then (~2h :)) > Transient

Re: [DISCUSS] KIP-147: Add missing type parameters to StateStoreSupplier factories and KGroupedStream/Table methods

2017-05-04 Thread Michal Borowiecki
Hello, I've updated the KIP with missing information. I would especially appreciate some comments on the compatibility aspects of this as the proposed change is not fully backwards-compatible. In the absence of comments I shall call for a vote in the next few days. Thanks, Michal On

Re: [VOTE] KIP-140: Add administrative RPCs for adding, deleting, and listing ACLs

2017-05-04 Thread Guozhang Wang
Colin, Thanks for the KIP. A general question I have is whether we can support "wildcard" resource names as well? For example, if we want to create / delete ACLs for all topic names following a wildcard regex? I read though the principle wildcards description but I am not sure if it is designed

[jira] [Commented] (KAFKA-5166) Add option "dry run" to Streams application reset tool

2017-05-04 Thread Matthias J. Sax (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15997793#comment-15997793 ] Matthias J. Sax commented on KAFKA-5166: No problem. (1) Internal topics: we need to reset the

[jira] [Commented] (KAFKA-5161) reassign-partitions to check if broker of ID exists in cluster

2017-05-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15997808#comment-15997808 ] ASF GitHub Bot commented on KAFKA-5161: --- Github user asfgit closed the pull request at:

[jira] [Commented] (KAFKA-5153) KAFKA Cluster : 0.10.2.0 : Servers Getting disconnected : Service Impacting

2017-05-04 Thread Arpan (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15996597#comment-15996597 ] Arpan commented on KAFKA-5153: -- Hi @huxi - I did not set anything specifically in server.properties for any

Re: [DISCUSS] KIP-150 - Kafka-Streams Cogroup

2017-05-04 Thread Kyle Winkelman
I am replying to this in hopes it will draw some attention to my KIP as I haven't heard from anyone in a couple days. This is my first KIP and my first large contribution to the project so I'm sure I did something wrong. ;) On May 1, 2017 4:18 PM, "Kyle Winkelman"

Re: [DISCUSS] KIP-152 - Improve diagnostics for SASL authentication failures

2017-05-04 Thread Ismael Juma
Thanks Rajini. This is a good improvement. One question, the proposal states: Producer waitForMetadata and consumer ensureCoordinatorReady will be > updated to throw AuthenticationFailedException if connections to all > available brokers fail authentication. Can you elaborate on the reason why

Re: [DISCUSS] KIP-143: Controller Health Metrics

2017-05-04 Thread Ismael Juma
Hi Joel, Thanks for the feedback. Comments inline. On Wed, May 3, 2017 at 7:52 PM, Joel Koshy wrote: > Yes - that is roughly what I was thinking (although deletes are no longer > long running). Also, what is the "steady-state" controller state? Idle? > Yes. > What about

Build failed in Jenkins: kafka-trunk-jdk8 #1480

2017-05-04 Thread Apache Jenkins Server
See Changes: [wangguoz] HOTFIX: fix potentially hanging test -- [...truncated 704.58 KB...] kafka.server.epoch.LeaderEpochFileCacheTest >

Re: [DISCUSS] KIP-143: Controller Health Metrics

2017-05-04 Thread Ismael Juma
Hi Onur, Comments inline. On Wed, May 3, 2017 at 6:54 PM, Onur Karaman wrote: > Regarding the ControllerState and the potential for overlap, I think it > depends on our definition of controller state. While KAFKA-5028 allows only > a single ControllerEvent to be

[GitHub] kafka pull request #2969: doc typo

2017-05-04 Thread smferguson
GitHub user smferguson reopened a pull request: https://github.com/apache/kafka/pull/2969 doc typo You can merge this pull request into a Git repository by running: $ git pull https://github.com/smferguson/kafka doc_typo Alternatively you can review and apply these changes

[GitHub] kafka pull request #2969: doc typo

2017-05-04 Thread smferguson
Github user smferguson closed the pull request at: https://github.com/apache/kafka/pull/2969 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Commented] (KAFKA-5004) poll() timeout not enforced when connecting to 0.10.0 broker

2017-05-04 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15996706#comment-15996706 ] Ismael Juma commented on KAFKA-5004: To be clear, this is only an issue if a client dies _and_ it

Re: [DISCUSS] KIP-152 - Improve diagnostics for SASL authentication failures

2017-05-04 Thread Rajini Sivaram
Hi Ismael, Thank you for reviewing the KIP. An authenticated client that is not authorized to access a topic is never told that the operation was not authorized. This is to prevent the client from finding out if the topic exists by sending an unauthorized request. So in this case, the client

[jira] [Commented] (KAFKA-5162) Add a reference to AdminClient to docs/api.html

2017-05-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15997779#comment-15997779 ] ASF GitHub Bot commented on KAFKA-5162: --- Github user asfgit closed the pull request at:

[jira] [Commented] (KAFKA-4996) Fix findbugs multithreaded correctness warnings for streams

2017-05-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15997772#comment-15997772 ] ASF GitHub Bot commented on KAFKA-4996: --- Github user asfgit closed the pull request at:

Re: Permission request to create a KIP

2017-05-04 Thread UMESH CHAUDHARY
Thank you Ewen! Now, I can create child page under "Apache Kafka". Regards, Umesh On Fri, 5 May 2017 at 10:52 Ewen Cheslack-Postava wrote: > Umesh, > > I've given you permissions on the wiki. Let me know if you run into any > issues. > > -Ewen > > On Thu, May 4, 2017 at

Re: [DISCUSS] KIP 141 - ProducerRecordBuilder Interface

2017-05-04 Thread Michael André Pearce
My vote would be with 2, then 3 then 1. Could I suggest maybe an option 4. that is option 2 but with a note that there is an intent in 1/2 years time to deprecate the old way (under another kip). This way books materials can be updated over a period, code won't be making compile warnings

Build failed in Jenkins: kafka-trunk-jdk7 #2150

2017-05-04 Thread Apache Jenkins Server
See Changes: [ismael] MINOR: Temporarily disable a few flaky tests -- [...truncated 844.95 KB...] kafka.integration.SaslPlaintextTopicMetadataTest >

Re: Permission request to create a KIP

2017-05-04 Thread Ewen Cheslack-Postava
Umesh, I've given you permissions on the wiki. Let me know if you run into any issues. -Ewen On Thu, May 4, 2017 at 12:04 AM, UMESH CHAUDHARY wrote: > Hello Mates, > I need to start a KIP for KAFKA-5057 > under this wiki

[jira] [Resolved] (KAFKA-5137) Controlled shutdown timeout message improvement

2017-05-04 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma resolved KAFKA-5137. Resolution: Fixed Fix Version/s: 0.11.0.0 Issue resolved by pull request 2932

Re: [VOTE] KIP-126 - Allow KafkaProducer to split and resend oversized batches.

2017-05-04 Thread Michael Pearce
+1 From: Joel Koshy Sent: Friday, May 5, 2017 4:32:42 AM To: dev@kafka.apache.org Subject: Re: [VOTE] KIP-126 - Allow KafkaProducer to split and resend oversized batches. +1 On Thu, May 4, 2017 at 7:00 PM Becket Qin

[GitHub] kafka pull request #2932: KAFKA-5137 : Controlled shutdown timeout message i...

2017-05-04 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/2932 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Resolved] (KAFKA-5161) reassign-partitions to check if broker of ID exists in cluster

2017-05-04 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-5161. -- Resolution: Fixed Fix Version/s: 0.11.0.0 Issue resolved by pull request 2962

Build failed in Jenkins: kafka-trunk-jdk8 #1484

2017-05-04 Thread Apache Jenkins Server
See Changes: [ismael] MINOR: Temporarily disable a few flaky tests -- [...truncated 843.92 KB...] kafka.integration.SaslPlaintextTopicMetadataTest >

[GitHub] kafka pull request #2962: KAFKA-5161: add code in reassign-partitions to che...

2017-05-04 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/2962 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

Re: [VOTE] KIP-143: Controller Health Metrics

2017-05-04 Thread Michael André Pearce
+1 , really good to see better operational visibility being added to the broker. Sent from my iPhone > On 5 May 2017, at 03:34, Ismael Juma wrote: > > Hi everyone, > > It seems like the discussion has converged, so I would like to initiate the > voting process for KIP-143:

[jira] [Resolved] (KAFKA-5162) Add a reference to AdminClient to docs/api.html

2017-05-04 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma resolved KAFKA-5162. Resolution: Fixed Issue resolved by pull request 2958 [https://github.com/apache/kafka/pull/2958]

[GitHub] kafka pull request #2958: KAFKA-5162: Add a reference to AdminClient to docs...

2017-05-04 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/2958 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Commented] (KAFKA-5137) Controlled shutdown timeout message improvement

2017-05-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15997782#comment-15997782 ] ASF GitHub Bot commented on KAFKA-5137: --- Github user asfgit closed the pull request at:

Build failed in Jenkins: kafka-trunk-jdk8 #1481

2017-05-04 Thread Apache Jenkins Server
See Changes: [wangguoz] KAFKA-4925: delay initial rebalance of consumer group -- [...truncated 844.34 KB...] kafka.integration.SaslPlaintextTopicMetadataTest >

[jira] [Resolved] (KAFKA-5104) DumpLogSegments should not open index files with `rw`

2017-05-04 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-5104. -- Resolution: Fixed Fix Version/s: 0.11.0.0 Issue resolved by pull request 2905

Build failed in Jenkins: kafka-trunk-jdk7 #2148

2017-05-04 Thread Apache Jenkins Server
See Changes: [wangguoz] KAFKA-4925: delay initial rebalance of consumer group -- [...truncated 844.64 KB...] kafka.tools.ConsoleConsumerTest >

Build failed in Jenkins: kafka-trunk-jdk8 #1482

2017-05-04 Thread Apache Jenkins Server
See Changes: [wangguoz] KAFKA-5118: Improve message for Kafka failed startup with non-Kafka data -- [...truncated 844.67 KB...] kafka.utils.CommandLineUtilsTest >

Re: [VOTE] KIP-140: Add administrative RPCs for adding, deleting, and listing ACLs

2017-05-04 Thread Colin McCabe
Hi Guozhang, Thanks for taking a look. On Thu, May 4, 2017, at 00:43, Guozhang Wang wrote: > Colin, > > Thanks for the KIP. A general question I have is whether we can support > "wildcard" resource names as well? For example, if we want to create / > delete ACLs for all topic names following a

Re: [DISCUSS] KIP-140: Add administrative RPCs for adding, deleting, and listing ACLs

2017-05-04 Thread Magnus Edenhill
Hey Colin, good KIP! Some comments: 1a. For operation, permission_type and resource_type: is there any reason for having the any and unknown enums as negative values? Since neither of these fields has an integer significance (unlike for example offsets which use negative offsets for logical

Re: [DISCUSS] KIP-152 - Improve diagnostics for SASL authentication failures

2017-05-04 Thread Magnus Edenhill
Hi Rajini, great KIP! This solution was proposed on the original KIP-43 thread but voted down, so let's hope it does better this time :) /Magnus 2017-05-04 13:37 GMT+02:00 Rajini Sivaram : > Hi all, > > I have created a KIP to improve diagnostics for SASL

[jira] [Commented] (KAFKA-5166) Add option "dry run" to Streams application reset tool

2017-05-04 Thread Matthias J. Sax (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15997427#comment-15997427 ] Matthias J. Sax commented on KAFKA-5166: Thanks for picking this up [~bharatviswa]! Are you

Re: [DISCUSS] KIP-152 - Improve diagnostics for SASL authentication failures

2017-05-04 Thread Ismael Juma
Hi Rajini, I think we were talking about slightly different things. I was just referring to the fact that there are cases where we throw an AuthorizationException back to the user without retrying from various methods (poll, commitSync, etc). As you said, my initial preference was for not

[jira] [Commented] (KAFKA-5166) Add option "dry run" to Streams application reset tool

2017-05-04 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15997464#comment-15997464 ] Bharat Viswanadham commented on KAFKA-5166: --- Hi Matthias, I have not written KIPS. I will look

[jira] [Commented] (KAFKA-4764) Improve diagnostics for SASL authentication failures

2017-05-04 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15997510#comment-15997510 ] Jun Rao commented on KAFKA-4764: [~rsivaram], thanks for the explanation. I looked at KIP-152. It looks

Re: [DISCUSS] KIP-140: Add administrative RPCs for adding, deleting, and listing ACLs

2017-05-04 Thread dan
what about the configs for: `allow.everyone.if.no.acl.found` and ` super.users`? i understand they are an implementation detail of `SimpleAclAuthorizer` configs, but without these its difficult to make sense of what permissions a `ListAclsResponse` actually represents. maybe something for

Re: [DISCUSS] KIP-146: Classloading Isolation in Connect

2017-05-04 Thread Gwen Shapira
On Wed, May 3, 2017 at 11:17 AM, Konstantine Karantasis < konstant...@confluent.io> wrote: > Thanks Ewen. I'm replying inline as well. > > On Tue, May 2, 2017 at 11:24 AM, Ewen Cheslack-Postava > wrote: > > > Thanks for the KIP. > > > > A few responses inline, followed by

Build failed in Jenkins: kafka-trunk-jdk8 #1483

2017-05-04 Thread Apache Jenkins Server
See Changes: [wangguoz] KAFKA-5104: DumpLogSegments should not open index files with `rw` -- [...truncated 1.49 MB...] kafka.server.epoch.LeaderEpochFileCacheTest >

[jira] [Created] (KAFKA-5176) AdminClient: add controller and clusterId methods to DescribeClusterResults

2017-05-04 Thread Colin P. McCabe (JIRA)
Colin P. McCabe created KAFKA-5176: -- Summary: AdminClient: add controller and clusterId methods to DescribeClusterResults Key: KAFKA-5176 URL: https://issues.apache.org/jira/browse/KAFKA-5176

Re: [DISCUSS] KIP-150 - Kafka-Streams Cogroup

2017-05-04 Thread Kyle Winkelman
I sure can. I have added the following description to my KIP. If this doesn't help let me know and I will take some more time to build a diagram and make more of a step by step description: Example with Current API: KTable table1 =

[GitHub] kafka pull request #2977: KAFKA-5176: AdminClient: add controller and cluste...

2017-05-04 Thread cmccabe
GitHub user cmccabe opened a pull request: https://github.com/apache/kafka/pull/2977 KAFKA-5176: AdminClient: add controller and clusterId methods to Desc… …ribeClusterResults You can merge this pull request into a Git repository by running: $ git pull

[jira] [Created] (KAFKA-5175) Transient failure: ControllerIntegrationTest.testPreferredReplicaLeaderElection

2017-05-04 Thread Ismael Juma (JIRA)
Ismael Juma created KAFKA-5175: -- Summary: Transient failure: ControllerIntegrationTest.testPreferredReplicaLeaderElection Key: KAFKA-5175 URL: https://issues.apache.org/jira/browse/KAFKA-5175 Project:

[jira] [Commented] (KAFKA-5175) Transient failure: ControllerIntegrationTest.testPreferredReplicaLeaderElection

2017-05-04 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15997497#comment-15997497 ] Ismael Juma commented on KAFKA-5175: [~onurkaraman], can you please take a look? > Transient failure:

Re: [DISCUSS]: KIP-149: Enabling key access in ValueTransformer, ValueMapper, and ValueJoiner

2017-05-04 Thread Matthias J. Sax
One follow up. There was this email on the user list: http://search-hadoop.com/m/Kafka/uyzND17KhCaBzPSZ1?subj=Shouldn+t+the+initializer+of+a+stream+aggregate+accept+the+key+ It might make sense so include Initializer, Adder, and Substractor inferface, too. And we should double check if there

Re: [DISCUSS] KIP-146: Classloading Isolation in Connect

2017-05-04 Thread Gwen Shapira
Hi, What about Transformations? Are they going to be isolated too? If they are, what do we do with the built-in ones? On Sat, Apr 29, 2017 at 9:16 AM, Konstantine Karantasis < konstant...@confluent.io> wrote: > * Because of KIP number collision, please disregard my previous KIP > announcement

Build failed in Jenkins: kafka-trunk-jdk7 #2149

2017-05-04 Thread Apache Jenkins Server
See Changes: [wangguoz] KAFKA-5118: Improve message for Kafka failed startup with non-Kafka data [wangguoz] KAFKA-5104: DumpLogSegments should not open index files with `rw`

Re: [DISCUSS] KIP-140: Add administrative RPCs for adding, deleting, and listing ACLs

2017-05-04 Thread Colin McCabe
On Thu, May 4, 2017, at 13:46, Magnus Edenhill wrote: > Hey Colin, > > good KIP! > > Some comments: > > 1a. For operation, permission_type and resource_type: is there any reason > for having the any and unknown enums as negative values? > Since neither of these fields has an integer

[jira] [Assigned] (KAFKA-5175) Transient failure: ControllerIntegrationTest.testPreferredReplicaLeaderElection

2017-05-04 Thread Onur Karaman (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Onur Karaman reassigned KAFKA-5175: --- Assignee: Onur Karaman > Transient failure: >

[jira] [Commented] (KAFKA-5173) SASL tests failing with Could not find a 'KafkaServer' or 'sasl_plaintext.KafkaServer' entry in the JAAS configuration

2017-05-04 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15997529#comment-15997529 ] Ismael Juma commented on KAFKA-5173: Another one that is slightly different, but looks to be the same

[jira] [Commented] (KAFKA-5176) AdminClient: add controller and clusterId methods to DescribeClusterResults

2017-05-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15997528#comment-15997528 ] ASF GitHub Bot commented on KAFKA-5176: --- GitHub user cmccabe opened a pull request:

[jira] [Assigned] (KAFKA-5176) AdminClient: add controller and clusterId methods to DescribeClusterResults

2017-05-04 Thread Colin P. McCabe (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin P. McCabe reassigned KAFKA-5176: -- Assignee: Colin P. McCabe > AdminClient: add controller and clusterId methods to

[jira] [Assigned] (KAFKA-5174) RocksDb might stall in environments with 1 core only

2017-05-04 Thread Eno Thereska (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eno Thereska reassigned KAFKA-5174: --- Assignee: Eno Thereska > RocksDb might stall in environments with 1 core only >

[jira] [Created] (KAFKA-5174) RocksDb might stall in environments with 1 core only

2017-05-04 Thread Eno Thereska (JIRA)
Eno Thereska created KAFKA-5174: --- Summary: RocksDb might stall in environments with 1 core only Key: KAFKA-5174 URL: https://issues.apache.org/jira/browse/KAFKA-5174 Project: Kafka Issue Type:

[GitHub] kafka pull request #2905: kafka-5104: DumpLogSegments should not open index ...

2017-05-04 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/2905 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] kafka pull request #2976: KAFKA-5170. KafkaAdminClientIntegration test shoul...

2017-05-04 Thread cmccabe
GitHub user cmccabe opened a pull request: https://github.com/apache/kafka/pull/2976 KAFKA-5170. KafkaAdminClientIntegration test should wait until metada… …ta is propagated to all brokers You can merge this pull request into a Git repository by running: $ git pull

Re: [DISCUSS] KIP-138: Change punctuate semantics

2017-05-04 Thread Matthias J. Sax
Hi, thanks for updating the KIP. Looks good to me overall. I think adding `Cancellable` (or should it be `Cancelable` to follow American English?) is a clean solution, in contrast to the proposed alternative. One minor comment: can you add `ValueTransformer#punctuate()` to the list of

Re: [DISCUSS]: KIP-149: Enabling key access in ValueTransformer, ValueMapper, and ValueJoiner

2017-05-04 Thread Matthias J. Sax
Thanks for updating the KIP. Deep copying the key will work for sure, but I am actually a little bit worried about performance impact... We might want to do some test to quantify this impact. Btw: this remind me about the idea of `RichFunction` interface that would allow users to access record

Re: [DISCUSS] KIP-150 - Kafka-Streams Cogroup

2017-05-04 Thread Matthias J. Sax
Kyle, thanks a lot for the KIP. Maybe I am a little slow, but I could not follow completely. Could you maybe add a more concrete example, like 3 streams with 3 records each (plus expected result), and show the difference between current way to to implement it and the proposed API? This could also

Re: [DISCUSS] KIP-147: Add missing type parameters to StateStoreSupplier factories and KGroupedStream/Table methods

2017-05-04 Thread Matthias J. Sax
I had a quick look into this. With regard to backward compatibility, I think it would be required do introduce a new type `TypesStateStoreSupplier` (that extends `StateStoreSupplier`) and to overload all methods that take a `StateStoreSupplier` that accept the new type instead of the current one.

[jira] [Commented] (KAFKA-5166) Add option "dry run" to Streams application reset tool

2017-05-04 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15997426#comment-15997426 ] Bharat Viswanadham commented on KAFKA-5166: --- Hi Matthias, I will look into this, and come up

Re: [DISCUSS] KIP 141 - ProducerRecordBuilder Interface

2017-05-04 Thread Matthias J. Sax
We can go either way. I just pointed out, what I would prefer -- it's also quite subjective. The least invasive change would be to add new constructors and update the JavaDocs to point out the semantics of `partition` parameter. However, I still like the builder pattern: ProducerRecord has 6

[jira] [Commented] (KAFKA-4764) Improve diagnostics for SASL authentication failures

2017-05-04 Thread Rajini Sivaram (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15997421#comment-15997421 ] Rajini Sivaram commented on KAFKA-4764: --- [~junrao] Yes, Zookeeper does the same as Kafka does today.

[jira] [Assigned] (KAFKA-5166) Add option "dry run" to Streams application reset tool

2017-05-04 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham reassigned KAFKA-5166: - Assignee: Bharat Viswanadham > Add option "dry run" to Streams application reset

[jira] [Commented] (KAFKA-5170) KafkaAdminClientIntegration test should wait until metadata is propagated to all brokers

2017-05-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15997329#comment-15997329 ] ASF GitHub Bot commented on KAFKA-5170: --- GitHub user cmccabe opened a pull request:

Re: Contributing to Kafka

2017-05-04 Thread Matthias J. Sax
Hi Rajan, thanks for your plan to contribute back! First, I would recommend to check out the wiki: https://cwiki.apache.org/confluence/display/KAFKA/Contributing+Code+Changes Also check out the JIRA boards: https://issues.apache.org/jira/browse/KAFKA-1 You can just filter for components you

Error: Executing consumer group command failed due to Request GROUP_COORDINATOR failed on brokers List(localhost:9092 (id: -1 rack: null))

2017-05-04 Thread Abhimanyu Nagrath
Hi, I am using single node Kafka cluster(version 0.10.2) and single node zookeeper (3.4.9). I am having approx 310 topics with Avg 100 partitions per topic. On Kafka broker when I am running the command to check consumer status in a group > ./kafka-consumer-groups.sh --bootstrap-server

[jira] [Comment Edited] (KAFKA-5154) Kafka Streams throws NPE during rebalance

2017-05-04 Thread Lukas Gemela (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15996995#comment-15996995 ] Lukas Gemela edited comment on KAFKA-5154 at 5/4/17 4:26 PM: - I wasnt able to

[jira] [Commented] (KAFKA-5154) Kafka Streams throws NPE during rebalance

2017-05-04 Thread Lukas Gemela (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15996995#comment-15996995 ] Lukas Gemela commented on KAFKA-5154: - I wasnt able to reproduce the issue yet, but I just found in

[jira] [Updated] (KAFKA-5173) SASL tests failing with Could not find a 'KafkaServer' or 'sasl_plaintext.KafkaServer' entry in the JAAS configuration

2017-05-04 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-5173: --- Fix Version/s: 0.11.0.0 > SASL tests failing with Could not find a 'KafkaServer' or >

[jira] [Created] (KAFKA-5173) SASL tests failing with Could not find a 'KafkaServer' or 'sasl_plaintext.KafkaServer' entry in the JAAS configuration

2017-05-04 Thread Ismael Juma (JIRA)
Ismael Juma created KAFKA-5173: -- Summary: SASL tests failing with Could not find a 'KafkaServer' or 'sasl_plaintext.KafkaServer' entry in the JAAS configuration Key: KAFKA-5173 URL:

Contributing to Kafka

2017-05-04 Thread Rajan Gupta
Hello I have being leading teams using Kafka for processing high volume audit and user behavior data and would like to give back to the Kafka community in anyway that Dev likes. I can start by testing, write performance tests, execute performance tests, monitor tests, fix bugs, write unit test

[GitHub] kafka pull request #2969: doc typo

2017-05-04 Thread smferguson
Github user smferguson closed the pull request at: https://github.com/apache/kafka/pull/2969 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] kafka pull request #2969: doc typo

2017-05-04 Thread smferguson
GitHub user smferguson reopened a pull request: https://github.com/apache/kafka/pull/2969 doc typo You can merge this pull request into a Git repository by running: $ git pull https://github.com/smferguson/kafka doc_typo Alternatively you can review and apply these changes

Re: [DISCUSS] KIP-152 - Improve diagnostics for SASL authentication failures

2017-05-04 Thread Rajini Sivaram
Hi Ismael, I thought the blocking waits in the producer and consumer are always related to retrying for metadata. So an authorization exception that impacts this wait can only be due to Describe authorization failure - that always retries? I agree that connecting to different brokers when

[jira] [Commented] (KAFKA-5173) SASL tests failing with Could not find a 'KafkaServer' or 'sasl_plaintext.KafkaServer' entry in the JAAS configuration

2017-05-04 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15996879#comment-15996879 ] Ismael Juma commented on KAFKA-5173: It seems like this started recently, could it be related to

[jira] [Work started] (KAFKA-5170) KafkaAdminClientIntegration test should wait until metadata is propagated to all brokers

2017-05-04 Thread Colin P. McCabe (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on KAFKA-5170 started by Colin P. McCabe. -- > KafkaAdminClientIntegration test should wait until metadata is propagated

[jira] [Work started] (KAFKA-5159) Update Kafka documentation to mention AdminClient

2017-05-04 Thread Colin P. McCabe (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on KAFKA-5159 started by Colin P. McCabe. -- > Update Kafka documentation to mention AdminClient >

Re: [DISCUSS] KIP-140: Add administrative RPCs for adding, deleting, and listing ACLs

2017-05-04 Thread Colin McCabe
That's a good point. It's worth mentioning that there is a KIP in progress, KIP-133: List and Alter Configs Admin APIs, that should help with those. In the long term, it would be nice if we could deprecate 'allow.everyone.if.no.acl.found', along with topic auto-creation. It should be possible

[jira] [Commented] (KAFKA-5154) Kafka Streams throws NPE during rebalance

2017-05-04 Thread Matthias J. Sax (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15997655#comment-15997655 ] Matthias J. Sax commented on KAFKA-5154: With regard to the exception you mentioned, there is one

Re: [VOTE] KIP-126 - Allow KafkaProducer to split and resend oversized batches.

2017-05-04 Thread Becket Qin
Bump. On Tue, Apr 25, 2017 at 3:17 PM, Bill Bejeck wrote: > +1 > > On Tue, Apr 25, 2017 at 4:43 PM, Dong Lin wrote: > > > +1 (non-binding) > > > > On Tue, Apr 25, 2017 at 12:33 PM, Becket Qin > wrote: > > > > > Hi, > > > > > > I

[jira] [Commented] (KAFKA-4764) Improve diagnostics for SASL authentication failures

2017-05-04 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15997107#comment-15997107 ] Jun Rao commented on KAFKA-4764: [~rsivaram], thanks for creating the jira. It seems that it's a bit weird

[jira] [Commented] (KAFKA-5154) Kafka Streams throws NPE during rebalance

2017-05-04 Thread Lukas Gemela (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15997141#comment-15997141 ] Lukas Gemela commented on KAFKA-5154: - I just found the exception from my previous comment in one of

[jira] [Updated] (KAFKA-5154) Kafka Streams throws NPE during rebalance

2017-05-04 Thread Lukas Gemela (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukas Gemela updated KAFKA-5154: Attachment: clio.txt.gz > Kafka Streams throws NPE during rebalance >

Re: [DISCUSS] KIP-150 - Kafka-Streams Cogroup

2017-05-04 Thread Kyle Winkelman
I have made a pull request. It can be found here. https://github.com/apache/kafka/pull/2975 I plan to write some more unit tests for my classes and get around to writing documentation for the public api additions. One thing I was curious about is during the KCogroupedStreamImpl#aggregate method

[jira] [Commented] (KAFKA-4987) Topic creation allows invalid config values on running brokers

2017-05-04 Thread Artiom Darie (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15997105#comment-15997105 ] Artiom Darie commented on KAFKA-4987: - Hi [~norwood], I fixed this issue by removing broker

Re: [DISCUSS] KIP-150 - Kafka-Streams Cogroup

2017-05-04 Thread Damian Guy
Hi Kyle, Thanks for the KIP. I apologize that i haven't had the chance to look at the KIP yet, but will schedule some time to look into it tomorrow. For the implementation, can you raise a PR against kafka trunk and mark it as WIP? It will be easier to review what you have done. Thanks, Damian

  1   2   >