[jira] [Commented] (KAFKA-1429) Yet another deadlock in controller shutdown

2016-06-21 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15343716#comment-15343716 ] Jun Rao commented on KAFKA-1429: [~pengwei], yes, it's a real bug. Thanks for finding and reporting this.

[jira] [Work started] (KAFKA-3890) Kafka Streams: task assignment is not maintained on cluster restart or rolling restart

2016-06-21 Thread Henry Cai (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on KAFKA-3890 started by Henry Cai. > Kafka Streams: task assignment is not maintained on cluster restart or > rolling

[jira] [Commented] (KAFKA-3890) Kafka Streams: task assignment is not maintained on cluster restart or rolling restart

2016-06-21 Thread Henry Cai (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15343209#comment-15343209 ] Henry Cai commented on KAFKA-3890: -- PR: https://github.com/apache/kafka/pull/1538 > Kafka Streams: task

[GitHub] kafka pull request #1538: AFKA-3890 Kafka Streams: task assignment is not ma...

2016-06-21 Thread HenryCaiHaiying
GitHub user HenryCaiHaiying opened a pull request: https://github.com/apache/kafka/pull/1538 AFKA-3890 Kafka Streams: task assignment is not maintained on cluster restart or rolling restart Current task assignment in TaskAssignor is not deterministic. During cluster

[jira] [Updated] (KAFKA-3890) Kafka Streams: task assignment is not maintained on cluster restart or rolling restart

2016-06-21 Thread Henry Cai (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Henry Cai updated KAFKA-3890: - Description: Currently the task assignment in TaskAssignor is not deterministic. During cluster restart

[jira] [Created] (KAFKA-3890) Kafka Streams: task assignment is not maintained on cluster restart or rolling restart

2016-06-21 Thread Henry Cai (JIRA)
Henry Cai created KAFKA-3890: Summary: Kafka Streams: task assignment is not maintained on cluster restart or rolling restart Key: KAFKA-3890 URL: https://issues.apache.org/jira/browse/KAFKA-3890

[jira] [Commented] (KAFKA-3846) Connect record types should include timestamps

2016-06-21 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15343117#comment-15343117 ] ASF GitHub Bot commented on KAFKA-3846: --- GitHub user shikhar opened a pull request:

[GitHub] kafka pull request #1537: KAFKA-3846: include timestamp in Connect record ty...

2016-06-21 Thread shikhar
GitHub user shikhar opened a pull request: https://github.com/apache/kafka/pull/1537 KAFKA-3846: include timestamp in Connect record types KIP to come You can merge this pull request into a Git repository by running: $ git pull https://github.com/shikhar/kafka kafka-3846

[jira] [Commented] (KAFKA-3740) Add configs for RocksDBStores

2016-06-21 Thread Henry Cai (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15343115#comment-15343115 ] Henry Cai commented on KAFKA-3740: -- Yes, you or Roger can pick it up. > Add configs for RocksDBStores >

Re: [VOTE] KIP-55: Secure quotas for authenticated users

2016-06-21 Thread Jun Rao
Yes, for consistency, perhaps we can allow client-id quota to be configured dynamically too and mark the static config in the broker as deprecated. If both are set, the dynamic one wins. Thanks, Jun On Tue, Jun 21, 2016 at 3:56 AM, Ismael Juma wrote: > On Tue, Jun 21, 2016

Re: [DISCUSS] KIP-48 Support for delegation tokens as an authentication mechanism

2016-06-21 Thread Jun Rao
Parth, Thanks for the reply. A couple of comments inline below. On Tue, Jun 21, 2016 at 10:36 AM, parth brahmbhatt < brahmbhatt.pa...@gmail.com> wrote: > 1. Who / how are tokens renewed? By original requester only? or using > Kerberos > auth only? > My recommendation is to do this only using

Re: [DISCUSS] KIP-4 Delete Topic Schema

2016-06-21 Thread Guozhang Wang
I see we have the similar setting for CreateTopic request timeout <= 0 as well, so maybe it has been discussed and I simply overlooked.. otherwise my question is for both of these cases. Guozhang On Tue, Jun 21, 2016 at 4:07 PM, Guozhang Wang wrote: > Thanks Grant, looks

Re: [DISCUSS] KIP-4 Delete Topic Schema

2016-06-21 Thread Guozhang Wang
Thanks Grant, looks good to me overall. One minor comment below: > - The error code in the response will either contain an argument > validation exception or a timeout exception. If you receive a timeout > exception, because you asked for 0 timeout, you can assume the message

[jira] [Commented] (KAFKA-3889) Change default Scala version to 2.11

2016-06-21 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15342984#comment-15342984 ] Ismael Juma commented on KAFKA-3889: Scala 2.10 is used if you do `./gradlew test` or `./gradlew jar`

[jira] [Commented] (KAFKA-3740) Add configs for RocksDBStores

2016-06-21 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15342979#comment-15342979 ] Guozhang Wang commented on KAFKA-3740: -- Since we need to pass the StreamsConfig object to the storage

[jira] [Commented] (KAFKA-3889) Change default Scala version to 2.11

2016-06-21 Thread Kevin Lafferty (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15342973#comment-15342973 ] Kevin Lafferty commented on KAFKA-3889: --- Well, both versions are built. It's just that the default

[jira] [Commented] (KAFKA-3889) Change default Scala version to 2.11

2016-06-21 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15342939#comment-15342939 ] Ismael Juma commented on KAFKA-3889: This is intentional. We build with the lowest version supported

[jira] [Updated] (KAFKA-3889) Change default Scala version to 2.11

2016-06-21 Thread Kevin Lafferty (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Lafferty updated KAFKA-3889: -- Description: The [downloads page|http://kafka.apache.org/downloads.html] says that Scala 2.11

[jira] [Created] (KAFKA-3889) Change default Scala version to 2.11

2016-06-21 Thread Kevin Lafferty (JIRA)
Kevin Lafferty created KAFKA-3889: - Summary: Change default Scala version to 2.11 Key: KAFKA-3889 URL: https://issues.apache.org/jira/browse/KAFKA-3889 Project: Kafka Issue Type: Improvement

[jira] [Comment Edited] (KAFKA-3887) StreamBounceTest.test_bounce and StreamSmokeTest.test_streams failing

2016-06-21 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15342841#comment-15342841 ] Ismael Juma edited comment on KAFKA-3887 at 6/21/16 10:17 PM: -- First build to

Re: [VOTE] KIP-62: Allow consumer to send heartbeats from a background thread

2016-06-21 Thread Jason Gustafson
Thanks Guozhang. I missed Jun's question. @Ismael Done. On Tue, Jun 21, 2016 at 2:37 PM, Guozhang Wang wrote: > Hello Jun, > > Just clarifying, it will be using the max.poll.interval.ms config, in the > wiki we use the term "process timeout" for it which exposed in the

[jira] [Assigned] (KAFKA-3846) Connect record types should include timestamps

2016-06-21 Thread Shikhar Bhushan (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shikhar Bhushan reassigned KAFKA-3846: -- Assignee: Shikhar Bhushan (was: Ewen Cheslack-Postava) > Connect record types should

[jira] [Commented] (KAFKA-3887) StreamBounceTest.test_bounce and StreamSmokeTest.test_streams failing

2016-06-21 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15342841#comment-15342841 ] Ismael Juma commented on KAFKA-3887: First build to fail:

[jira] [Created] (KAFKA-3888) Allow consumer to send heartbeats in background thread (KIP-62)

2016-06-21 Thread Jason Gustafson (JIRA)
Jason Gustafson created KAFKA-3888: -- Summary: Allow consumer to send heartbeats in background thread (KIP-62) Key: KAFKA-3888 URL: https://issues.apache.org/jira/browse/KAFKA-3888 Project: Kafka

Re: [VOTE] KIP-62: Allow consumer to send heartbeats from a background thread

2016-06-21 Thread Guozhang Wang
Hello Jun, Just clarifying, it will be using the max.poll.interval.ms config, in the wiki we use the term "process timeout" for it which exposed in the consumer configs as "max.poll.interval.ms". I have updated the wiki to make it more clear. Guozhang On Tue, Jun 21, 2016 at 2:14 PM, Jason

Re: [VOTE] KIP-62: Allow consumer to send heartbeats from a background thread

2016-06-21 Thread Ismael Juma
Awesome, please update the KIP page Jason. :) Ismael On Tue, Jun 21, 2016 at 11:14 PM, Jason Gustafson wrote: > Hi All, > > Looks like the vote has passed with +6 binding and +5 non-binding. Thanks > everyone for help reviewing the proposal. > > -Jason > > On Mon, Jun 20,

Jenkins build is back to normal : kafka-trunk-jdk7 #1383

2016-06-21 Thread Apache Jenkins Server
See

Re: KafkaConsumer - Poll consumes more records than needed

2016-06-21 Thread Jason Gustafson
Hi there, >From 0.10 forward, the consumer supports a configuration option "max.poll.records" to limit the number of records returned from each call to poll(). Note also that if you use commitSync or commitAsync (with no arguments), the consumer assumes that you intend to commit offsets for all

Re: [VOTE] KIP-62: Allow consumer to send heartbeats from a background thread

2016-06-21 Thread Jason Gustafson
Hi All, Looks like the vote has passed with +6 binding and +5 non-binding. Thanks everyone for help reviewing the proposal. -Jason On Mon, Jun 20, 2016 at 2:04 PM, Jay Kreps wrote: > +1 > > -Jay > > On Mon, Jun 20, 2016 at 1:39 PM, Jason Gustafson >

[jira] [Resolved] (KAFKA-3872) OOM while running Kafka Streams integration tests

2016-06-21 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma resolved KAFKA-3872. Resolution: Fixed Fix Version/s: 0.10.1.0 Issue resolved by pull request 1533

[GitHub] kafka pull request #1533: KAFKA-3872: Reduce log cleaner buffer size to 2 MB

2016-06-21 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1533 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Commented] (KAFKA-3872) OOM while running Kafka Streams integration tests

2016-06-21 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15342659#comment-15342659 ] ASF GitHub Bot commented on KAFKA-3872: --- Github user asfgit closed the pull request at:

[jira] [Created] (KAFKA-3887) StreamBounceTest.test_bounce and StreamSmokeTest.test_streams failing

2016-06-21 Thread Ismael Juma (JIRA)
Ismael Juma created KAFKA-3887: -- Summary: StreamBounceTest.test_bounce and StreamSmokeTest.test_streams failing Key: KAFKA-3887 URL: https://issues.apache.org/jira/browse/KAFKA-3887 Project: Kafka

[jira] [Commented] (KAFKA-3263) Add Markdown support for ConfigDef

2016-06-21 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3263?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15342595#comment-15342595 ] ASF GitHub Bot commented on KAFKA-3263: --- Github user jcustenborder closed the pull request at:

[GitHub] kafka pull request #952: KAFKA-3263 - Support for markdown generation.

2016-06-21 Thread jcustenborder
Github user jcustenborder closed the pull request at: https://github.com/apache/kafka/pull/952 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

Re: [DISCUSS] KIP-63: Unify store and downstream caching in streams

2016-06-21 Thread Roger Hoover
Thanks, Eno. On Tue, Jun 21, 2016 at 2:22 AM, Eno Thereska wrote: > Hi Roger, > > I realised I never got back to you on this one, sorry. Some answers inline: > > > On 3 Jun 2016, at 22:48, Roger Hoover wrote: > > > > Hi Eno, > > > > Does this

[jira] [Updated] (KAFKA-3886) Consumer should handle wakeups while rebalancing more gracefully

2016-06-21 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson updated KAFKA-3886: --- Description: If the user calls wakeup() while a rebalance in progress, we currently lose

[jira] [Created] (KAFKA-3886) Consumer should handle wakeups while rebalancing more gracefully

2016-06-21 Thread Jason Gustafson (JIRA)
Jason Gustafson created KAFKA-3886: -- Summary: Consumer should handle wakeups while rebalancing more gracefully Key: KAFKA-3886 URL: https://issues.apache.org/jira/browse/KAFKA-3886 Project: Kafka

[GitHub] kafka pull request #1534: MINOR: update streams.html with KStream API change...

2016-06-21 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1534 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Commented] (KAFKA-3176) Allow console consumer to consume from particular partitions when new consumer is used.

2016-06-21 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15342372#comment-15342372 ] ASF GitHub Bot commented on KAFKA-3176: --- GitHub user vahidhashemian reopened a pull request:

[jira] [Commented] (KAFKA-3176) Allow console consumer to consume from particular partitions when new consumer is used.

2016-06-21 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15342371#comment-15342371 ] ASF GitHub Bot commented on KAFKA-3176: --- Github user vahidhashemian closed the pull request at:

[GitHub] kafka pull request #1536: MINOR: KAFKA-3176 Follow-up to fix minor issues

2016-06-21 Thread vahidhashemian
GitHub user vahidhashemian reopened a pull request: https://github.com/apache/kafka/pull/1536 MINOR: KAFKA-3176 Follow-up to fix minor issues You can merge this pull request into a Git repository by running: $ git pull https://github.com/vahidhashemian/kafka

[GitHub] kafka pull request #1536: MINOR: KAFKA-3176 Follow-up to fix minor issues

2016-06-21 Thread vahidhashemian
Github user vahidhashemian closed the pull request at: https://github.com/apache/kafka/pull/1536 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[jira] [Commented] (KAFKA-3176) Allow console consumer to consume from particular partitions when new consumer is used.

2016-06-21 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15342313#comment-15342313 ] ASF GitHub Bot commented on KAFKA-3176: --- GitHub user vahidhashemian opened a pull request:

[GitHub] kafka pull request #1536: MINOR: KAFKA-3176 Follow-up to fix minor issues

2016-06-21 Thread vahidhashemian
GitHub user vahidhashemian opened a pull request: https://github.com/apache/kafka/pull/1536 MINOR: KAFKA-3176 Follow-up to fix minor issues You can merge this pull request into a Git repository by running: $ git pull https://github.com/vahidhashemian/kafka

[jira] [Commented] (KAFKA-3727) Consumer.poll() stuck in loop on non-existent topic manually assigned

2016-06-21 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15342295#comment-15342295 ] ASF GitHub Bot commented on KAFKA-3727: --- GitHub user edoardocomar opened a pull request:

[GitHub] kafka pull request #1535: KAFKA-3727 - ConsumerListener for UnknownTopicOrPa...

2016-06-21 Thread edoardocomar
GitHub user edoardocomar opened a pull request: https://github.com/apache/kafka/pull/1535 KAFKA-3727 - ConsumerListener for UnknownTopicOrPartitionException Added a ConsumerListener to KafkaConsumer Modified Fetcher and Cluster to account for Unknown Topics Added

Re: [DISCUSS] KIP-48 Support for delegation tokens as an authentication mechanism

2016-06-21 Thread parth brahmbhatt
1. Who / how are tokens renewed? By original requester only? or using Kerberos auth only? My recommendation is to do this only using Kerberos auth and only threw the renewer specified during the acquisition request. 2. Are tokens stored on each broker or in ZK? My recommendation is still to store

RE: Error while sending message to Kafka broker on SSL with Kafka 0.10.0.0

2016-06-21 Thread Subhash Agrawal
Now I changed the test producer call like this. C:\development\kafka\kafka_2.11-0.10.0.0\kafka_2.11-0.10.0.0\bin\windows>.\kafka-console-producer.bat --broker-list localhost:8393 --topic test --prod ucer.config ..\..\config\producer.properties and updated producer.properties like this

[jira] [Resolved] (KAFKA-3828) Consumer thread stalls after consumer re balance for some partition

2016-06-21 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma resolved KAFKA-3828. Resolution: Duplicate Thanks for the update! > Consumer thread stalls after consumer re balance

[jira] [Commented] (KAFKA-3828) Consumer thread stalls after consumer re balance for some partition

2016-06-21 Thread Joseph Aliase (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15342026#comment-15342026 ] Joseph Aliase commented on KAFKA-3828: -- Upgrading the consumer fixed the issue. Thanks > Consumer

Re: [DISCUSS] KIP-4 Delete Topic Schema

2016-06-21 Thread Grant Henke
Hi Ismael, Thanks for the review. See my responses below. One potential issue is that the number of topics in the response won't > match the number of topics in the request. Worth checking what others think > of this one. Based on the choice of how we handled duplicate topics in the create

Re: [DISCUSS] Java 8 as a minimum requirement

2016-06-21 Thread Damian Guy
+1 On Tue, 21 Jun 2016 at 09:59 Marcus Gründler wrote: > Hi Ismael, > > thanks for the pointer to the latest WebSphere documentation - I wasn’t > aware > of that release. > > We currently have customers that run our software frontend on an older > WebSphere version

KafkaConsumer - Poll consumes more records than needed

2016-06-21 Thread Asier Aranbarri Beldarrain
Hi everyone! I'm new to this mailing list; Hope I can find solutions and who knows, maybe some day help other Kafka developers. I'm facing an issue regarding the new (>=0.9) KafkaConsumer and its poll() method: What would be the correct way to specify a maximum amount of records to be processed

[jira] [Updated] (KAFKA-3885) Kafka new producer cannot failover

2016-06-21 Thread wateray (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wateray updated KAFKA-3885: --- Description: This bug can reproduce by the following steps. The cluster has 2 brokers. a) start a new

[jira] [Created] (KAFKA-3885) Kafka new producer cannot failover

2016-06-21 Thread wateray (JIRA)
wateray created KAFKA-3885: -- Summary: Kafka new producer cannot failover Key: KAFKA-3885 URL: https://issues.apache.org/jira/browse/KAFKA-3885 Project: Kafka Issue Type: Bug Components:

[jira] [Resolved] (KAFKA-3874) Transient test failure: org.apache.kafka.streams.integration.JoinIntegrationTest.shouldCountClicksPerRegion

2016-06-21 Thread Damian Guy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Damian Guy resolved KAFKA-3874. --- Resolution: Fixed Fix Version/s: 0.10.1.0 Should be fixed by:

[jira] [Commented] (KAFKA-3874) Transient test failure: org.apache.kafka.streams.integration.JoinIntegrationTest.shouldCountClicksPerRegion

2016-06-21 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15341632#comment-15341632 ] Ismael Juma commented on KAFKA-3874: [~damianguy], if it should be fixed, then feel free to close it.

[jira] [Commented] (KAFKA-3874) Transient test failure: org.apache.kafka.streams.integration.JoinIntegrationTest.shouldCountClicksPerRegion

2016-06-21 Thread Damian Guy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15341627#comment-15341627 ] Damian Guy commented on KAFKA-3874: --- This should be fixed with the commit yesterday. I'll keep an eye on

[GitHub] kafka pull request #1534: MINOR: update streams.html with KStream API change...

2016-06-21 Thread dguy
GitHub user dguy opened a pull request: https://github.com/apache/kafka/pull/1534 MINOR: update streams.html with KStream API changes @mjsax @guozhangwang You can merge this pull request into a Git repository by running: $ git pull https://github.com/dguy/kafka

Re: [VOTE] KIP-55: Secure quotas for authenticated users

2016-06-21 Thread Ismael Juma
On Tue, Jun 21, 2016 at 12:50 PM, Rajini Sivaram < rajinisiva...@googlemail.com> wrote: > It is actually quite tempting to do the same for client-id quotas as well, > but I suppose we can't break existing users who have configured defaults in > server.properties and providing two ways of setting

Re: [VOTE] KIP-55: Secure quotas for authenticated users

2016-06-21 Thread Rajini Sivaram
Jun, I think that is a good idea. It keeps all user quotas in one place with an intuitive hierarchy, avoids properties that are applied based on various conditions and also enables dynamic updates. Dynamic updates obviously need to get applied to all clients using the default, but I think that

Re: [DISCUSS] KIP-4 Delete Topic Schema

2016-06-21 Thread Ismael Juma
Thanks Grant. A few comments inline. On Mon, Jun 20, 2016 at 9:09 PM, Grant Henke wrote: > >2. If there are multiple instructions for the same topic in one > >request the extra request will be ignored > > - This is because the list of topics is modeled server

[jira] [Created] (KAFKA-3884) KGroupedStreamIntegrationTest.shouldAggregate seems to be hanging

2016-06-21 Thread Ismael Juma (JIRA)
Ismael Juma created KAFKA-3884: -- Summary: KGroupedStreamIntegrationTest.shouldAggregate seems to be hanging Key: KAFKA-3884 URL: https://issues.apache.org/jira/browse/KAFKA-3884 Project: Kafka

[jira] [Commented] (KAFKA-3502) Build is killed during kafka streams tests due to `pure virtual method called` error

2016-06-21 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15341438#comment-15341438 ] Ismael Juma commented on KAFKA-3502: This happened again:

Re: [DISCUSS] KIP-63: Unify store and downstream caching in streams

2016-06-21 Thread Eno Thereska
Hi Roger, I realised I never got back to you on this one, sorry. Some answers inline: > On 3 Jun 2016, at 22:48, Roger Hoover wrote: > > Hi Eno, > > Does this mean that Kafka Streams will disable the RocksDB write buffer? For the purposes of this KIP we might not want

Jenkins build is back to normal : kafka-trunk-jdk8 #713

2016-06-21 Thread Apache Jenkins Server
See

Re: [DISCUSS] Java 8 as a minimum requirement

2016-06-21 Thread Marcus Gründler
Hi Ismael, thanks for the pointer to the latest WebSphere documentation - I wasn’t aware of that release. We currently have customers that run our software frontend on an older WebSphere version that runs on Java 7 and push data to kafka brokers in the backend. Replacing Kafka brokers

[jira] [Issue Comment Deleted] (KAFKA-3482) [DOC] - Remove the part about LinkedIn running ZK 3.3.X

2016-06-21 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-3482: --- Comment: was deleted (was: GitHub user bbejeck opened a pull request:

Build failed in Jenkins: kafka-trunk-jdk7 #1382

2016-06-21 Thread Apache Jenkins Server
See Changes: [me] KAFKA-3176: Add partition/offset options to the new consumer -- [...truncated 5129 lines...] kafka.api.SaslSslEndToEndAuthorizationTest > testNoConsumeAcl PASSED

Build failed in Jenkins: kafka-trunk-jdk8 #712

2016-06-21 Thread Apache Jenkins Server
See Changes: [me] KAFKA-3865: Fix transient failure in -- [...truncated 10740 lines...] org.apache.kafka.common.record.RecordTest > testFields[189] PASSED

Build failed in Jenkins: kafka-0.10.0-jdk7 #132

2016-06-21 Thread Apache Jenkins Server
See Changes: [me] MINOR: Catch Throwable in commitSourceTask() [me] KAFKA-3865: Fix transient failure in -- [...truncated 6345 lines...] org.apache.kafka.connect.runtime.WorkerSourceTaskTest

Re: [VOTE] KIP-4 Create Topics Schema

2016-06-21 Thread Manikumar Reddy
+1 (non-binding) On Tue, Jun 21, 2016 at 9:16 AM, Ewen Cheslack-Postava wrote: > +1 (binding) and thanks for the work on this Grant! > > -Ewen > > On Mon, Jun 20, 2016 at 12:18 PM, Gwen Shapira wrote: > > > +1 (binding) > > > > On Mon, Jun 20, 2016 at

[jira] [Commented] (KAFKA-3872) OOM while running Kafka Streams integration tests

2016-06-21 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15341178#comment-15341178 ] ASF GitHub Bot commented on KAFKA-3872: --- GitHub user enothereska opened a pull request:

[GitHub] kafka pull request #1533: KAFKA-3872: Reduce log cleaner buffer size to 2 MB

2016-06-21 Thread enothereska
GitHub user enothereska opened a pull request: https://github.com/apache/kafka/pull/1533 KAFKA-3872: Reduce log cleaner buffer size to 2 MB You can merge this pull request into a Git repository by running: $ git pull https://github.com/enothereska/kafka

[jira] [Work started] (KAFKA-3872) OOM while running Kafka Streams integration tests

2016-06-21 Thread Eno Thereska (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on KAFKA-3872 started by Eno Thereska. --- > OOM while running Kafka Streams integration tests >

[jira] [Assigned] (KAFKA-3872) OOM while running Kafka Streams integration tests

2016-06-21 Thread Eno Thereska (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eno Thereska reassigned KAFKA-3872: --- Assignee: Eno Thereska (was: Guozhang Wang) > OOM while running Kafka Streams integration