Re: [DISCUSS] KIP-58 - Make Log Compaction Point Configurable

2016-05-19 Thread Jay Kreps
Hey Gwen, Yeah specifying in bytes versus the utilization percent would have been easier to implement. The argument against that is that basically users are super terrible at predicting and updating data sizes as stuff grows and you'd have to really set this then for each individual log perhaps?

[jira] [Commented] (KAFKA-3735) RocksDB objects needs to be disposed after usage

2016-05-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15292622#comment-15292622 ] ASF GitHub Bot commented on KAFKA-3735: --- GitHub user guozhangwang opened a pull request:

[GitHub] kafka pull request: KAFKA-3735: Dispose all RocksObejcts upon comp...

2016-05-19 Thread guozhangwang
GitHub user guozhangwang opened a pull request: https://github.com/apache/kafka/pull/1411 KAFKA-3735: Dispose all RocksObejcts upon completeness You can merge this pull request into a Git repository by running: $ git pull https://github.com/guozhangwang/kafka

Re: [VOTE] 0.10.0.0 RC6

2016-05-19 Thread Jun Rao
Thanks for running the release. +1 from me. Verified the quickstart. Jun On Tue, May 17, 2016 at 10:00 PM, Gwen Shapira wrote: > Hello Kafka users, developers and client-developers, > > This is the seventh (!) candidate for release of Apache Kafka > 0.10.0.0. This is a major

[jira] [Updated] (KAFKA-3735) RocksDB objects needs to be disposed after usage

2016-05-19 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-3735: - Description: The RocksDB JNI interface {{RocksObject}} has a dispose() function which need to be

[jira] [Created] (KAFKA-3735) RocksDB objects needs to be disposed after usage

2016-05-19 Thread Guozhang Wang (JIRA)
Guozhang Wang created KAFKA-3735: Summary: RocksDB objects needs to be disposed after usage Key: KAFKA-3735 URL: https://issues.apache.org/jira/browse/KAFKA-3735 Project: Kafka Issue Type:

[jira] [Updated] (KAFKA-3567) Add --security-protocol option to console consumer and producer

2016-05-19 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated KAFKA-3567: -- Reviewer: Ismael Juma Fix Version/s: 0.9.0.0 Affects Version/s:

[jira] [Updated] (KAFKA-3699) Update protocol page on website to explain how KIP-35 should be used

2016-05-19 Thread Ashish K Singh (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashish K Singh updated KAFKA-3699: -- Status: Patch Available (was: Open) > Update protocol page on website to explain how KIP-35

[GitHub] kafka pull request: Kafka 3567:Add --security-protocol option to c...

2016-05-19 Thread bharatviswa504
Github user bharatviswa504 closed the pull request at: https://github.com/apache/kafka/pull/1408 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

Re: [DISCUSS] KIP-58 - Make Log Compaction Point Configurable

2016-05-19 Thread Gwen Shapira
No, you are right that mapping dirty-bytes to dirty-map sizes is non-trivial. I think it would be good to discuss an alternative approach, but this is probably the wrong thread :) On Thu, May 19, 2016 at 4:36 AM, Ben Stopford wrote: > Hmm. Suffice to say, this isn’t an easy

[jira] [Assigned] (KAFKA-3734) Exceptions in SourceTask.commit() methods should cause task to stop and report failed state

2016-05-19 Thread Liquan Pei (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liquan Pei reassigned KAFKA-3734: - Assignee: Liquan Pei (was: Ewen Cheslack-Postava) > Exceptions in SourceTask.commit() methods

[jira] [Updated] (KAFKA-3443) Support regex topics in addSource() and stream()

2016-05-19 Thread Bill Bejeck (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bill Bejeck updated KAFKA-3443: --- Status: Patch Available (was: Open) Initial pass completed, ready for review > Support regex topics

Re: [VOTE] 0.10.0.0 RC6

2016-05-19 Thread Jay Kreps
+1 -Jay On Tue, May 17, 2016 at 10:00 PM, Gwen Shapira wrote: > Hello Kafka users, developers and client-developers, > > This is the seventh (!) candidate for release of Apache Kafka > 0.10.0.0. This is a major release that includes: (1) New message > format including

[jira] [Work stopped] (KAFKA-3443) Support regex topics in addSource() and stream()

2016-05-19 Thread Bill Bejeck (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on KAFKA-3443 stopped by Bill Bejeck. -- > Support regex topics in addSource() and stream() >

[jira] [Commented] (KAFKA-3443) Support regex topics in addSource() and stream()

2016-05-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15292476#comment-15292476 ] ASF GitHub Bot commented on KAFKA-3443: --- GitHub user bbejeck opened a pull request:

[GitHub] kafka pull request: KAFKA-3443 added support for subscribing to to...

2016-05-19 Thread bbejeck
GitHub user bbejeck opened a pull request: https://github.com/apache/kafka/pull/1410 KAFKA-3443 added support for subscribing to topics via regex You can merge this pull request into a Git repository by running: $ git pull https://github.com/bbejeck/kafka

[jira] [Created] (KAFKA-3734) Exceptions in SourceTask.commit() methods should cause task to stop and report failed state

2016-05-19 Thread Ewen Cheslack-Postava (JIRA)
Ewen Cheslack-Postava created KAFKA-3734: Summary: Exceptions in SourceTask.commit() methods should cause task to stop and report failed state Key: KAFKA-3734 URL:

[GitHub] kafka pull request: Kafka 3567:Add --security-protocol option to c...

2016-05-19 Thread bharatviswa504
GitHub user bharatviswa504 opened a pull request: https://github.com/apache/kafka/pull/1409 Kafka 3567:Add --security-protocol option to console consumer and producer Creating a new pull request, because of branch is out of date. You can merge this pull request into a Git

[jira] [Resolved] (KAFKA-3724) Replace inter.broker.protocol.version with KIP-35 based version detection

2016-05-19 Thread Ashish K Singh (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashish K Singh resolved KAFKA-3724. --- Resolution: Duplicate Assignee: Ashish K Singh Closing as duplicate of KAFKA-3308 and

[jira] [Updated] (KAFKA-3308) Use ProtocolVersion during rolling upgrades to decide on a mutually agreed protocol version between brokers, eliminating the need of inter.broker.protocol.version.

2016-05-19 Thread Ashish K Singh (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashish K Singh updated KAFKA-3308: -- Description: inter.broker.protocol.version configuration was nice for few releases, but it is

[GitHub] kafka pull request: Kafka 3567:Add --security-protocol option to c...

2016-05-19 Thread bharatviswa504
GitHub user bharatviswa504 opened a pull request: https://github.com/apache/kafka/pull/1408 Kafka 3567:Add --security-protocol option to console consumer and producer @harshach Please review the code changes You can merge this pull request into a Git repository by running: $

[jira] [Commented] (KAFKA-493) High CPU usage on inactive server

2016-05-19 Thread Manoj Ramakrishnan (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15292319#comment-15292319 ] Manoj Ramakrishnan commented on KAFKA-493: -- Thanks! > High CPU usage on inactive server >

[jira] [Commented] (KAFKA-3664) When subscription set changes on new consumer, the partitions may be removed without offset being committed.

2016-05-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15292280#comment-15292280 ] ASF GitHub Bot commented on KAFKA-3664: --- GitHub user vahidhashemian reopened a pull request:

[jira] [Commented] (KAFKA-3664) When subscription set changes on new consumer, the partitions may be removed without offset being committed.

2016-05-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15292279#comment-15292279 ] ASF GitHub Bot commented on KAFKA-3664: --- Github user vahidhashemian closed the pull request at:

[GitHub] kafka pull request: KAFKA-3664: Commit offset of unsubscribed part...

2016-05-19 Thread vahidhashemian
Github user vahidhashemian closed the pull request at: https://github.com/apache/kafka/pull/1363 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] kafka pull request: KAFKA-3664: Commit offset of unsubscribed part...

2016-05-19 Thread vahidhashemian
GitHub user vahidhashemian reopened a pull request: https://github.com/apache/kafka/pull/1363 KAFKA-3664: Commit offset of unsubscribed partitions of the new consumer on a subscription change When users are using group management, if they call consumer.subscribe() to change the

[jira] [Commented] (KAFKA-3732) Add an auto accept option to kafka-acls.sh

2016-05-19 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15292243#comment-15292243 ] Ismael Juma commented on KAFKA-3732: There are a number of distributions that alias `rm` to be

[jira] [Commented] (KAFKA-3733) Avoid long command lines by setting CLASSPATH in environment

2016-05-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15292223#comment-15292223 ] ASF GitHub Bot commented on KAFKA-3733: --- GitHub user amuraru opened a pull request:

[GitHub] kafka pull request: KAFKA-3733 Avoid long command lines by setting...

2016-05-19 Thread amuraru
GitHub user amuraru opened a pull request: https://github.com/apache/kafka/pull/1407 KAFKA-3733 Avoid long command lines by setting CLASSPATH in environment Avoid trimming the command line You can merge this pull request into a Git repository by running: $ git pull

[jira] [Created] (KAFKA-3733) Avoid long command lines by setting CLASSPATH in environment

2016-05-19 Thread Adrian Muraru (JIRA)
Adrian Muraru created KAFKA-3733: Summary: Avoid long command lines by setting CLASSPATH in environment Key: KAFKA-3733 URL: https://issues.apache.org/jira/browse/KAFKA-3733 Project: Kafka

[jira] [Commented] (KAFKA-3664) When subscription set changes on new consumer, the partitions may be removed without offset being committed.

2016-05-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15292137#comment-15292137 ] ASF GitHub Bot commented on KAFKA-3664: --- Github user vahidhashemian closed the pull request at:

[jira] [Commented] (KAFKA-3664) When subscription set changes on new consumer, the partitions may be removed without offset being committed.

2016-05-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15292138#comment-15292138 ] ASF GitHub Bot commented on KAFKA-3664: --- GitHub user vahidhashemian reopened a pull request:

[GitHub] kafka pull request: KAFKA-3664: Commit offset of unsubscribed part...

2016-05-19 Thread vahidhashemian
GitHub user vahidhashemian reopened a pull request: https://github.com/apache/kafka/pull/1363 KAFKA-3664: Commit offset of unsubscribed partitions of the new consumer on a subscription change When users are using group management, if they call consumer.subscribe() to change the

[GitHub] kafka pull request: KAFKA-3664: Commit offset of unsubscribed part...

2016-05-19 Thread vahidhashemian
Github user vahidhashemian closed the pull request at: https://github.com/apache/kafka/pull/1363 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[jira] [Commented] (KAFKA-493) High CPU usage on inactive server

2016-05-19 Thread Cosmin Marginean (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15292129#comment-15292129 ] Cosmin Marginean commented on KAFKA-493: [~manoj.ramakrish...@plantronics.com] We are using the

[jira] [Commented] (KAFKA-3732) Add an auto accept option to kafka-acls.sh

2016-05-19 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15292095#comment-15292095 ] Jay Kreps commented on KAFKA-3732: -- Is the right fix to add an option here. I mean, this is unix, the

[jira] [Commented] (KAFKA-3664) When subscription set changes on new consumer, the partitions may be removed without offset being committed.

2016-05-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15292012#comment-15292012 ] ASF GitHub Bot commented on KAFKA-3664: --- Github user vahidhashemian closed the pull request at:

[jira] [Commented] (KAFKA-3664) When subscription set changes on new consumer, the partitions may be removed without offset being committed.

2016-05-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15292013#comment-15292013 ] ASF GitHub Bot commented on KAFKA-3664: --- GitHub user vahidhashemian reopened a pull request:

[GitHub] kafka pull request: KAFKA-3664: Commit offset of unsubscribed part...

2016-05-19 Thread vahidhashemian
Github user vahidhashemian closed the pull request at: https://github.com/apache/kafka/pull/1363 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] kafka pull request: KAFKA-3664: Commit offset of unsubscribed part...

2016-05-19 Thread vahidhashemian
GitHub user vahidhashemian reopened a pull request: https://github.com/apache/kafka/pull/1363 KAFKA-3664: Commit offset of unsubscribed partitions of the new consumer on a subscription change When users are using group management, if they call consumer.subscribe() to change the

[jira] [Updated] (KAFKA-3561) Auto create through topic for KStream aggregation and join

2016-05-19 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-3561: - Assignee: (was: Guozhang Wang) > Auto create through topic for KStream aggregation and join >

[jira] [Commented] (KAFKA-3664) When subscription set changes on new consumer, the partitions may be removed without offset being committed.

2016-05-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15291670#comment-15291670 ] ASF GitHub Bot commented on KAFKA-3664: --- Github user vahidhashemian closed the pull request at:

Build failed in Jenkins: kafka-trunk-jdk8 #641

2016-05-19 Thread Apache Jenkins Server
See Changes: [ismael] MINOR: Move `Incorporating Security Features in a Running Cluster` to [me] KAFKA-2935: Remove vestigial WorkerConfig.CLUSTER_CONFIG -- [...truncated 1668 lines...]

[jira] [Commented] (KAFKA-3664) When subscription set changes on new consumer, the partitions may be removed without offset being committed.

2016-05-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15291671#comment-15291671 ] ASF GitHub Bot commented on KAFKA-3664: --- GitHub user vahidhashemian reopened a pull request:

[GitHub] kafka pull request: KAFKA-3664: Commit offset of unsubscribed part...

2016-05-19 Thread vahidhashemian
GitHub user vahidhashemian reopened a pull request: https://github.com/apache/kafka/pull/1363 KAFKA-3664: Commit offset of unsubscribed partitions of the new consumer on a subscription change When users are using group management, if they call consumer.subscribe() to change the

[GitHub] kafka pull request: KAFKA-3664: Commit offset of unsubscribed part...

2016-05-19 Thread vahidhashemian
Github user vahidhashemian closed the pull request at: https://github.com/apache/kafka/pull/1363 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[jira] [Updated] (KAFKA-3732) Add an auto accept option to kafka-acls.sh

2016-05-19 Thread Mickael Maison (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mickael Maison updated KAFKA-3732: -- Summary: Add an auto accept option to kafka-acls.sh (was: Add an auto accept option to

[jira] [Commented] (KAFKA-3732) Add an auto accept option to kafka-acl

2016-05-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15291631#comment-15291631 ] ASF GitHub Bot commented on KAFKA-3732: --- GitHub user mimaison opened a pull request:

[GitHub] kafka pull request: KAFKA-3732: Add an auto accept option to kafka...

2016-05-19 Thread mimaison
GitHub user mimaison opened a pull request: https://github.com/apache/kafka/pull/1406 KAFKA-3732: Add an auto accept option to kafka-acl Added a new argument to AclCommand: --yes. When set, automatically answer yes to prompts You can merge this pull request into a Git repository

[jira] [Created] (KAFKA-3732) Add an auto accept option to kafka-acl

2016-05-19 Thread Mickael Maison (JIRA)
Mickael Maison created KAFKA-3732: - Summary: Add an auto accept option to kafka-acl Key: KAFKA-3732 URL: https://issues.apache.org/jira/browse/KAFKA-3732 Project: Kafka Issue Type:

[jira] [Commented] (KAFKA-493) High CPU usage on inactive server

2016-05-19 Thread Manoj Ramakrishnan (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15291584#comment-15291584 ] Manoj Ramakrishnan commented on KAFKA-493: -- [~cosmin.marginean] We are running into something

[jira] [Commented] (KAFKA-3685) Auto-generate ZooKeeper data structure wiki

2016-05-19 Thread Vahid Hashemian (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15291503#comment-15291503 ] Vahid Hashemian commented on KAFKA-3685: [~granthenke] Is

[jira] [Updated] (KAFKA-3511) Add common aggregation functions like Sum and Avg as build-ins in Kafka Streams DSL

2016-05-19 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-3511: - Description: Currently we have the following aggregation APIs in the Streams DSL: {code}

[jira] [Updated] (KAFKA-3511) Add common aggregation functions like Sum and Avg as build-ins in Kafka Streams DSL

2016-05-19 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-3511: - Summary: Add common aggregation functions like Sum and Avg as build-ins in Kafka Streams DSL

[jira] [Commented] (KAFKA-3511) Provide built-in aggregators sum() and avg() in Kafka Streams DSL

2016-05-19 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15291455#comment-15291455 ] Guozhang Wang commented on KAFKA-3511: -- I think I agree. As long as we still need the {{Mapper}} for

[jira] [Commented] (KAFKA-2935) Remove vestigial CLUSTER_CONFIG in WorkerConfig

2016-05-19 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15291439#comment-15291439 ] Ewen Cheslack-Postava commented on KAFKA-2935: -- [~shikhar] Thanks for the patch, and congrats

[GitHub] kafka pull request: KAFKA-2935: Remove vestigial WorkerConfig.CLUS...

2016-05-19 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1404 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Commented] (KAFKA-3664) When subscription set changes on new consumer, the partitions may be removed without offset being committed.

2016-05-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15291437#comment-15291437 ] ASF GitHub Bot commented on KAFKA-3664: --- Github user vahidhashemian closed the pull request at:

[jira] [Commented] (KAFKA-3664) When subscription set changes on new consumer, the partitions may be removed without offset being committed.

2016-05-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15291438#comment-15291438 ] ASF GitHub Bot commented on KAFKA-3664: --- GitHub user vahidhashemian reopened a pull request:

[jira] [Commented] (KAFKA-2935) Remove vestigial CLUSTER_CONFIG in WorkerConfig

2016-05-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15291436#comment-15291436 ] ASF GitHub Bot commented on KAFKA-2935: --- Github user asfgit closed the pull request at:

[jira] [Resolved] (KAFKA-2935) Remove vestigial CLUSTER_CONFIG in WorkerConfig

2016-05-19 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava resolved KAFKA-2935. -- Resolution: Fixed Fix Version/s: 0.10.1.0 Issue resolved by pull request

[GitHub] kafka pull request: KAFKA-3664: Commit offset of unsubscribed part...

2016-05-19 Thread vahidhashemian
Github user vahidhashemian closed the pull request at: https://github.com/apache/kafka/pull/1363 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] kafka pull request: KAFKA-3664: Commit offset of unsubscribed part...

2016-05-19 Thread vahidhashemian
GitHub user vahidhashemian reopened a pull request: https://github.com/apache/kafka/pull/1363 KAFKA-3664: Commit offset of unsubscribed partitions of the new consumer on a subscription change When users are using group management, if they call consumer.subscribe() to change the

Build failed in Jenkins: kafka-0.10.0-jdk7 #101

2016-05-19 Thread Apache Jenkins Server
See Changes: [ismael] MINOR: Move `Incorporating Security Features in a Running Cluster` to -- Started by an SCM change [EnvInject] - Loading node environment variables. Building remotely on

[GitHub] kafka pull request: MINOR: Move `Incorporating Security Features i...

2016-05-19 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1405 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Updated] (KAFKA-2935) Remove vestigial CLUSTER_CONFIG in WorkerConfig

2016-05-19 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava updated KAFKA-2935: - Assignee: Shikhar Bhushan (was: Ewen Cheslack-Postava) > Remove vestigial

Re: [DISCUSS] KIP-48 Support for delegation tokens as an authentication mechanism

2016-05-19 Thread Harsha
Hi All, Can we have a KIP meeting around this. The KIP is up for sometime and if there are any questions lets quickly hash out details. Thanks, Harsha On Thu, May 19, 2016, at 08:40 AM, parth brahmbhatt wrote: > That is what the hadoop echo system uses so no

Re: [DISCUSS] KIP-48 Support for delegation tokens as an authentication mechanism

2016-05-19 Thread parth brahmbhatt
That is what the hadoop echo system uses so no good reason really. We could change it to whatever is the newest recommended standard is. Thanks Parth On Thu, May 19, 2016 at 3:33 AM, Ismael Juma wrote: > Hi Parth, > > Thanks for the KIP. I only started reviewing this and may

[GitHub] kafka pull request: MINOR: Move `Incorporating Security Features i...

2016-05-19 Thread ijuma
GitHub user ijuma opened a pull request: https://github.com/apache/kafka/pull/1405 MINOR: Move `Incorporating Security Features in a Running Cluster` to its own section under `Security` It was previously in the SASL section (probably by mistake). You can merge this pull request

[jira] [Reopened] (KAFKA-3479) Add new consumer metrics documentation

2016-05-19 Thread Kaufman Ng (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaufman Ng reopened KAFKA-3479: --- adding topic level metrics > Add new consumer metrics documentation >

[jira] [Commented] (KAFKA-3728) inconsistent behavior of Consumer.poll() when assigned vs subscribed

2016-05-19 Thread Rajini Sivaram (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15291108#comment-15291108 ] Rajini Sivaram commented on KAFKA-3728: --- EndToEndAuthorizationTest has a misconfigured

[jira] [Updated] (KAFKA-3731) Problems with : Controller 0's connection to broker Node

2016-05-19 Thread Vivien D (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vivien D updated KAFKA-3731: Description: Hi, I launch Zookeeper and kafka with the default conf. And after that, the controler.log

[jira] [Created] (KAFKA-3731) Problems with : Controller 0's connection to broker Node

2016-05-19 Thread Vivien D (JIRA)
Vivien D created KAFKA-3731: --- Summary: Problems with : Controller 0's connection to broker Node Key: KAFKA-3731 URL: https://issues.apache.org/jira/browse/KAFKA-3731 Project: Kafka Issue Type: Bug

Re: [DISCUSS] KIP-58 - Make Log Compaction Point Configurable

2016-05-19 Thread Ben Stopford
Hmm. Suffice to say, this isn’t an easy thing to tune, so I would agree that a more holistic solution, which tuned itself to total disk availability, might be quite useful :) If we took the min.dirty.bytes route, and defaulted it to the segment size, that would work well for distributions

[jira] [Commented] (KAFKA-3730) Problem when updating from 0.8.2 to 0.9.0

2016-05-19 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15290910#comment-15290910 ] Ismael Juma commented on KAFKA-3730: The error seems to imply that the broker with

Re: [DISCUSS] KIP-48 Support for delegation tokens as an authentication mechanism

2016-05-19 Thread Ismael Juma
Hi Parth, Thanks for the KIP. I only started reviewing this and may have additional questions later. The immediate question that came to mind is our choice of "DIGEST-MD5" even though it's marked as OBSOLETE in the IANA Registry of SASL mechanisms and the original RFC (2831) has been moved to