[jira] [Updated] (KAFKA-3478) Finer Stream Flow Control

2016-07-15 Thread Matthias J. Sax (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-3478: --- Description: Today we have a event-time based flow control mechanism in order to synchronize

Re: [VOTE] KIP-67: Queryable state for Kafka Streams

2016-07-15 Thread Jay Kreps
My interpretation was that you need an implementation of QueryableStoreType which anyone can do and QueryableStoreTypes is just a place to put the type objects for the types we ship with Kafka. -Jay On Fri, Jul 15, 2016 at 4:04 PM, Sriram Subramanian wrote: > So, it looks

Re: [VOTE] KIP-67: Queryable state for Kafka Streams

2016-07-15 Thread Sriram Subramanian
So, it looks like QueryableStoreTypes would be part of the streams library, right? If a developer needs to support a new store, would they need to change code in streams? On Fri, Jul 15, 2016 at 3:15 PM, Jay Kreps wrote: > Cool, I'm +1 after the updates. > > -Jay > > On Fri,

[jira] [Commented] (KAFKA-3888) Allow consumer to send heartbeats in background thread (KIP-62)

2016-07-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15380270#comment-15380270 ] ASF GitHub Bot commented on KAFKA-3888: --- GitHub user hachikuji opened a pull request:

[GitHub] kafka pull request #1627: KAFKA-3888: send consumer heartbeats from a backgr...

2016-07-15 Thread hachikuji
GitHub user hachikuji opened a pull request: https://github.com/apache/kafka/pull/1627 KAFKA-3888: send consumer heartbeats from a background thread (KIP-62) You can merge this pull request into a Git repository by running: $ git pull https://github.com/hachikuji/kafka

Re: [VOTE] KIP-67: Queryable state for Kafka Streams

2016-07-15 Thread Jay Kreps
Cool, I'm +1 after the updates. -Jay On Fri, Jul 15, 2016 at 1:50 PM, Damian Guy wrote: > Hi Guozhang, KIP updated. > > Thanks, > Damian > > On Fri, 15 Jul 2016 at 13:15 Guozhang Wang wrote: > > > Hi Damian, > > > > Since the StateStoreProvider is

Re: [VOTE] KIP-67: Queryable state for Kafka Streams

2016-07-15 Thread Damian Guy
Hi Guozhang, KIP updated. Thanks, Damian On Fri, 15 Jul 2016 at 13:15 Guozhang Wang wrote: > Hi Damian, > > Since the StateStoreProvider is moved into internal packages, how about > just keeping the ReadOnlyXXStores interface for the queryAPI, and > "QueryableStoreType" in

Re: [VOTE] KIP-67: Queryable state for Kafka Streams

2016-07-15 Thread Guozhang Wang
Hi Damian, Since the StateStoreProvider is moved into internal packages, how about just keeping the ReadOnlyXXStores interface for the queryAPI, and "QueryableStoreType" in the discoverAPI, and move the StateStoreProvider / QueryableStoreTypeMatcher and different implementations of the matcher

Build failed in Jenkins: kafka-trunk-jdk8 #753

2016-07-15 Thread Apache Jenkins Server
See Changes: [wangguoz] KAFKA-3952: Consumer rebalance verifier never succeed due to type -- [...truncated 6736 lines...] kafka.message.ByteBufferMessageSetTest > testValidBytes PASSED

Re: [DISCUSS] KIP-4 ACL Admin Schema

2016-07-15 Thread Gwen Shapira
> My goal in the protocol design was to keep the request simple and be able > to answer what I think are the 3 most common questions/requests > >- What ACLs are on the cluster? >- What access do I/they have? >- Who has access to this resource? Thanks for clarifying. I think this is

Re: Using KIP Process in Apache Flink

2016-07-15 Thread Gwen Shapira
I'm very curious how the process will work for your community. If you will be able to drop by with feedback in few month, I will greatly appreciate. Processes can always be improved and a fresh set of eyes on the KIP process can be useful Gwen On Fri, Jul 8, 2016 at 1:01 AM, Aljoscha Krettek

[jira] [Commented] (KAFKA-3729) Auto-configure non-default SerDes passed alongside the topology builder

2016-07-15 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15379721#comment-15379721 ] Guozhang Wang commented on KAFKA-3729: -- Currently there are two ways to specify serde classes in

[jira] [Updated] (KAFKA-3952) VerifyConsumerRebalance cannot succeed when checking partition owner

2016-07-15 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-3952: - Assignee: Simon Wan Wenli > VerifyConsumerRebalance cannot succeed when checking partition owner

[jira] [Updated] (KAFKA-3952) VerifyConsumerRebalance cannot succeed when checking partition owner

2016-07-15 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-3952: - Resolution: Fixed Status: Resolved (was: Patch Available) > VerifyConsumerRebalance

[jira] [Updated] (KAFKA-3952) VerifyConsumerRebalance cannot succeed when checking partition owner

2016-07-15 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-3952: - Fix Version/s: 0.8.2.2 0.9.0.2 0.10.0.1 >

[jira] [Commented] (KAFKA-3952) VerifyConsumerRebalance cannot succeed when checking partition owner

2016-07-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15379695#comment-15379695 ] ASF GitHub Bot commented on KAFKA-3952: --- Github user asfgit closed the pull request at:

[GitHub] kafka pull request #1612: KAFKA-3952: Consumer rebalance verifier never succ...

2016-07-15 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1612 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

Re: [VOTE] KIP-67: Queryable state for Kafka Streams

2016-07-15 Thread Damian Guy
Hi All, I've updated the KIP with changes as discussed in this Thread. Thanks, Damian On Wed, 13 Jul 2016 at 16:51 Ismael Juma wrote: > I think it's important to distinguish the use cases of defining new stores > (somewhat rare) versus using the `store` method (very

[jira] [Commented] (KAFKA-3739) Add no-arg constructor for library provided serdes

2016-07-15 Thread Philipe Alves de Oliveira e Silva (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15379643#comment-15379643 ] Philipe Alves de Oliveira e Silva commented on KAFKA-3739: -- I can take this one!

[GitHub] kafka pull request #1626: [KAFKA-3968] Call fsync for parent directory first...

2016-07-15 Thread nepal
GitHub user nepal opened a pull request: https://github.com/apache/kafka/pull/1626 [KAFKA-3968] Call fsync for parent directory first time when we flush… … message set You can merge this pull request into a Git repository by running: $ git pull

[jira] [Comment Edited] (KAFKA-1194) The kafka broker cannot delete the old log files after the configured time

2016-07-15 Thread Harald Kirsch (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15379380#comment-15379380 ] Harald Kirsch edited comment on KAFKA-1194 at 7/15/16 1:41 PM: --- It seems we

[jira] [Commented] (KAFKA-1194) The kafka broker cannot delete the old log files after the configured time

2016-07-15 Thread Harald Kirsch (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15379380#comment-15379380 ] Harald Kirsch commented on KAFKA-1194: -- It seems we are one step further but not yet there. I just

[jira] [Created] (KAFKA-3967) Excessive Network IO between Kafka brokers

2016-07-15 Thread Krishna (JIRA)
Krishna created KAFKA-3967: -- Summary: Excessive Network IO between Kafka brokers Key: KAFKA-3967 URL: https://issues.apache.org/jira/browse/KAFKA-3967 Project: Kafka Issue Type: Bug Affects

Re: [DISCUSS] KIP-4 ACL Admin Schema

2016-07-15 Thread Ismael Juma
On Fri, Jul 15, 2016 at 6:45 AM, Gwen Shapira wrote: > > >> - I suggest this be addressed in KIP-50 as well, though it has > >> some compatibility concerns. > > Isn't KIP-50 itself one gigantic compatibility concern? I don't see > how your suggestions make it

[GitHub] kafka pull request #1625: MINOR: fix extra broker setup

2016-07-15 Thread mweirauch
GitHub user mweirauch opened a pull request: https://github.com/apache/kafka/pull/1625 MINOR: fix extra broker setup Quickstart setup for brokers 1 and 2 need "zookeeper.connect" setting. Otherwise you are greeted with: org.apache.kafka.common.config.ConfigException:

[jira] [Commented] (KAFKA-3102) Kafka server unable to connect to zookeeper

2016-07-15 Thread Manikumar Reddy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15379198#comment-15379198 ] Manikumar Reddy commented on KAFKA-3102: Subscribe to user mailing list. Details are here:

[jira] [Commented] (KAFKA-3102) Kafka server unable to connect to zookeeper

2016-07-15 Thread Sam Liu (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15379188#comment-15379188 ] Sam Liu commented on KAFKA-3102: Thanks for replying. How can i post issues on kafka user mailing list. I

[jira] [Assigned] (KAFKA-3915) LogCleaner IO buffers do not account for potential size difference due to message format change

2016-07-15 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma reassigned KAFKA-3915: -- Assignee: Ismael Juma > LogCleaner IO buffers do not account for potential size difference due

[jira] [Comment Edited] (KAFKA-3090) Zookeeper disconnects with "can't find default realm" message

2016-07-15 Thread Sam Liu (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15379152#comment-15379152 ] Sam Liu edited comment on KAFKA-3090 at 7/15/16 10:09 AM: -- Hi Mohit, what was

[jira] [Commented] (KAFKA-3090) Zookeeper disconnects with "can't find default realm" message

2016-07-15 Thread Sam Liu (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15379152#comment-15379152 ] Sam Liu commented on KAFKA-3090: Hi Mohit, what's the issue with the krb5.conf file?I am facing a similar

[jira] [Updated] (KAFKA-2213) Log cleaner should write compacted messages using configured compression type

2016-07-15 Thread Manikumar Reddy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikumar Reddy updated KAFKA-2213: --- Resolution: Duplicate Status: Resolved (was: Patch Available) This duplicate of

[jira] [Issue Comment Deleted] (KAFKA-3090) Zookeeper disconnects with "can't find default realm" message

2016-07-15 Thread Sam Liu (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sam Liu updated KAFKA-3090: --- Comment: was deleted (was: Hi there could you pls tell me which version get this issue fixed?) > Zookeeper

[jira] [Commented] (KAFKA-3102) Kafka server unable to connect to zookeeper

2016-07-15 Thread Manikumar Reddy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15379135#comment-15379135 ] Manikumar Reddy commented on KAFKA-3102: [~liuxinjian] There is no kafka issue. This looks like

[jira] [Commented] (KAFKA-3102) Kafka server unable to connect to zookeeper

2016-07-15 Thread Sam Liu (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15379120#comment-15379120 ] Sam Liu commented on KAFKA-3102: Hi, could you pls tell me the version get this fixed? > Kafka server

[jira] [Commented] (KAFKA-3090) Zookeeper disconnects with "can't find default realm" message

2016-07-15 Thread Sam Liu (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15379044#comment-15379044 ] Sam Liu commented on KAFKA-3090: Hi there could you pls tell me which version get this issue fixed? >

[GitHub] kafka pull request #1606: KAFKA-3947: Add dumping current assignment capabil...

2016-07-15 Thread kawamuray
GitHub user kawamuray reopened a pull request: https://github.com/apache/kafka/pull/1606 KAFKA-3947: Add dumping current assignment capability to kafka-reassign-partitions.sh Issue: https://issues.apache.org/jira/browse/KAFKA-3947 You can merge this pull request into a Git

[GitHub] kafka pull request #1607: MINOR: Doc of 'retries' config should mention abou...

2016-07-15 Thread kawamuray
Github user kawamuray closed the pull request at: https://github.com/apache/kafka/pull/1607 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] kafka pull request #1606: KAFKA-3947: Add dumping current assignment capabil...

2016-07-15 Thread kawamuray
Github user kawamuray closed the pull request at: https://github.com/apache/kafka/pull/1606 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Commented] (KAFKA-3947) kafka-reassign-partitions.sh should support dumping current assignment

2016-07-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15378966#comment-15378966 ] ASF GitHub Bot commented on KAFKA-3947: --- GitHub user kawamuray reopened a pull request:

[GitHub] kafka pull request #1607: MINOR: Doc of 'retries' config should mention abou...

2016-07-15 Thread kawamuray
GitHub user kawamuray reopened a pull request: https://github.com/apache/kafka/pull/1607 MINOR: Doc of 'retries' config should mention about max.in.flight.requests.per.connection to avoid confusion When I first read the doc of producer config `retries`, it was quite confusing

[jira] [Commented] (KAFKA-3947) kafka-reassign-partitions.sh should support dumping current assignment

2016-07-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15378965#comment-15378965 ] ASF GitHub Bot commented on KAFKA-3947: --- Github user kawamuray closed the pull request at:

[jira] [Resolved] (KAFKA-3102) Kafka server unable to connect to zookeeper

2016-07-15 Thread Manikumar Reddy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikumar Reddy resolved KAFKA-3102. Resolution: Duplicate > Kafka server unable to connect to zookeeper >

[jira] [Commented] (KAFKA-3102) Kafka server unable to connect to zookeeper

2016-07-15 Thread Sam Liu (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15378942#comment-15378942 ] Sam Liu commented on KAFKA-3102: is anyone working on this issue? > Kafka server unable to connect to

Re: [DISCUSS] KIP-4 ACL Admin Schema

2016-07-15 Thread Manikumar Reddy
Hi, Can we allow ListAcls to take list of resources? This may help when we have many associated resources under same principal. Thanks Manikumar On Fri, Jul 15, 2016 at 11:15 AM, Gwen Shapira wrote: > Thank you, Grant. This is lovely :) > > Few comments / requests for