[jira] [Commented] (KAFKA-2673) Log JmxTool output to logger

2016-02-12 Thread Eno Thereska (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15145866#comment-15145866 ] Eno Thereska commented on KAFKA-2673: - [~chenzhu]: you are right, piping it to a file

[jira] [Comment Edited] (KAFKA-3238) Deadlock Mirrormaker consumer not fetching any messages

2016-02-12 Thread Rekha Joshi (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15145786#comment-15145786 ] Rekha Joshi edited comment on KAFKA-3238 at 2/13/16 7:29 AM: -

[jira] [Updated] (KAFKA-3238) Deadlock Mirrormaker consumer not fetching any messages

2016-02-12 Thread Rekha Joshi (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rekha Joshi updated KAFKA-3238: --- Priority: Critical (was: Blocker) > Deadlock Mirrormaker consumer not fetching any messages > ---

[jira] [Updated] (KAFKA-3238) Deadlock Mirrormaker consumer not fetching any messages

2016-02-12 Thread Rekha Joshi (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rekha Joshi updated KAFKA-3238: --- Priority: Blocker (was: Critical) > Deadlock Mirrormaker consumer not fetching any messages > ---

[jira] [Work started] (KAFKA-2757) Consolidate BrokerEndPoint and EndPoint

2016-02-12 Thread chen zhu (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on KAFKA-2757 started by chen zhu. --- > Consolidate BrokerEndPoint and EndPoint > --- > >

[jira] [Commented] (KAFKA-2757) Consolidate BrokerEndPoint and EndPoint

2016-02-12 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15145833#comment-15145833 ] ASF GitHub Bot commented on KAFKA-2757: --- GitHub user zhuchen1018 opened a pull reque

[GitHub] kafka pull request: KAFKA-2757; Consolidate BrokerEndPoint and End...

2016-02-12 Thread zhuchen1018
GitHub user zhuchen1018 opened a pull request: https://github.com/apache/kafka/pull/911 KAFKA-2757; Consolidate BrokerEndPoint and EndPoint You can merge this pull request into a Git repository by running: $ git pull https://github.com/zhuchen1018/kafka KAFKA-2757 Alternative

[jira] [Commented] (KAFKA-3237) ConfigDef validators require a default value

2016-02-12 Thread Jeremy Custenborder (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3237?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15145816#comment-15145816 ] Jeremy Custenborder commented on KAFKA-3237: Correct me if i'm wrong but there

[jira] [Comment Edited] (KAFKA-3238) Deadlock Mirrormaker consumer not fetching any messages

2016-02-12 Thread Rekha Joshi (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15145786#comment-15145786 ] Rekha Joshi edited comment on KAFKA-3238 at 2/13/16 4:24 AM: -

[jira] [Commented] (KAFKA-3238) Deadlock Mirrormaker consumer not fetching any messages

2016-02-12 Thread Rekha Joshi (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15145786#comment-15145786 ] Rekha Joshi commented on KAFKA-3238: Hi, [~nehanarkhede] [~junrao] [~jkreps] : I have

[jira] [Commented] (KAFKA-3088) 0.9.0.0 broker crash on receipt of produce request with empty client ID

2016-02-12 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15145773#comment-15145773 ] ASF GitHub Bot commented on KAFKA-3088: --- GitHub user granthenke opened a pull reques

[GitHub] kafka pull request: KAFKA-3088: (0.9 branch) broker crash on recei...

2016-02-12 Thread granthenke
GitHub user granthenke opened a pull request: https://github.com/apache/kafka/pull/910 KAFKA-3088: (0.9 branch) broker crash on receipt of produce request w… …ith empty client ID - Adds NULLABLE_STRING Type to the protocol - Changes client_id in the REQUEST_HEADER t

Build failed in Jenkins: kafka-trunk-jdk7 #1040

2016-02-12 Thread Apache Jenkins Server
See Changes: [jjkoshy] KAFKA-3088; Make client-id a nullable string and fix handling of invalid -- Started by an SCM change [EnvInject] - Loading node environment variables. Building remotely o

Re: [DISCUSS] KIP-36 - Rack aware replica assignment

2016-02-12 Thread Grant Henke
NULLABLE_STRING was just committed to trunk: https://github.com/apache/kafka/pull/866 Also we should pull in this PR before making changes to UpdateMetadata: https://github.com/apache/kafka/pull/896 Thanks, Grant On Fri, Feb 12, 2016 at 8:16 PM, Joel Koshy wrote: > We are adding a NULLABLE_STR

Build failed in Jenkins: kafka-trunk-jdk8 #368

2016-02-12 Thread Apache Jenkins Server
See Changes: [jjkoshy] KAFKA-3088; Make client-id a nullable string and fix handling of -- [...truncated 82 lines...] /x1/jenkins/jenkins-slave/workspace/kafka-trunk-jdk8/core/src/main/scala/kafk

[jira] [Commented] (KAFKA-3088) 0.9.0.0 broker crash on receipt of produce request with empty client ID

2016-02-12 Thread Joel Koshy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15145738#comment-15145738 ] Joel Koshy commented on KAFKA-3088: --- [~granthenke] I'm leaving this open for 0.9 (i.e.,

[jira] [Commented] (KAFKA-3088) 0.9.0.0 broker crash on receipt of produce request with empty client ID

2016-02-12 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15145737#comment-15145737 ] ASF GitHub Bot commented on KAFKA-3088: --- Github user asfgit closed the pull request

[GitHub] kafka pull request: KAFKA-3088: broker crash on receipt of produce...

2016-02-12 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/866 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[jira] [Commented] (KAFKA-2673) Log JmxTool output to logger

2016-02-12 Thread chen zhu (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15145736#comment-15145736 ] chen zhu commented on KAFKA-2673: - Hi [~enothereska], currently JmxTool outputs the data t

Re: [DISCUSS] KIP-36 - Rack aware replica assignment

2016-02-12 Thread Joel Koshy
We are adding a NULLABLE_STRING type (KAFKA-3088) but you would then need to evolve the UpdateMetadata request. Regardless, it seems better to just go with an empty string. On Fri, Feb 12, 2016 at 5:38 PM, Allen Wang wrote: > In implementing changes to UpdateMetadataRequest, I noticed > that org

[jira] [Commented] (KAFKA-3237) ConfigDef validators require a default value

2016-02-12 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3237?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15145710#comment-15145710 ] Ismael Juma commented on KAFKA-3237: Why don't you use the overload of define that doe

[jira] [Commented] (KAFKA-3237) ConfigDef validators require a default value

2016-02-12 Thread Jeremy Custenborder (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3237?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15145692#comment-15145692 ] Jeremy Custenborder commented on KAFKA-3237: There are two test cases [testInv

Re: [DISCUSS] KIP-36 - Rack aware replica assignment

2016-02-12 Thread Allen Wang
In implementing changes to UpdateMetadataRequest, I noticed that org.apache.kafka.common.protocol.types.STRING does not allow null value. This creates a problem for rack as it is an optional field for broker. In Scala, it is declared as Option[String]. I was planning to transmit the rack as null in

[jira] [Updated] (KAFKA-3238) Deadlock Mirrormaker consumer not fetching any messages

2016-02-12 Thread Rekha Joshi (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rekha Joshi updated KAFKA-3238: --- Priority: Critical (was: Major) > Deadlock Mirrormaker consumer not fetching any messages > -

[jira] [Comment Edited] (KAFKA-914) Deadlock between initial rebalance and watcher-triggered rebalances

2016-02-12 Thread Rekha Joshi (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15145519#comment-15145519 ] Rekha Joshi edited comment on KAFKA-914 at 2/13/16 1:20 AM: Hi,

[jira] [Created] (KAFKA-3238) Deadlock Mirrormaker consumer not fetching any messages

2016-02-12 Thread Rekha Joshi (JIRA)
Rekha Joshi created KAFKA-3238: -- Summary: Deadlock Mirrormaker consumer not fetching any messages Key: KAFKA-3238 URL: https://issues.apache.org/jira/browse/KAFKA-3238 Project: Kafka Issue Type:

[jira] [Updated] (KAFKA-3237) ConfigDef validators require a default value

2016-02-12 Thread Jeremy Custenborder (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeremy Custenborder updated KAFKA-3237: --- Description: I should be able to add a ConfigDef that has a validator but does has nul

[jira] [Created] (KAFKA-3237) ConfigDef validators require a default value

2016-02-12 Thread Jeremy Custenborder (JIRA)
Jeremy Custenborder created KAFKA-3237: -- Summary: ConfigDef validators require a default value Key: KAFKA-3237 URL: https://issues.apache.org/jira/browse/KAFKA-3237 Project: Kafka Issue

[jira] [Comment Edited] (KAFKA-914) Deadlock between initial rebalance and watcher-triggered rebalances

2016-02-12 Thread Rekha Joshi (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15145519#comment-15145519 ] Rekha Joshi edited comment on KAFKA-914 at 2/12/16 11:16 PM: - H

[jira] [Commented] (KAFKA-914) Deadlock between initial rebalance and watcher-triggered rebalances

2016-02-12 Thread Rekha Joshi (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15145519#comment-15145519 ] Rekha Joshi commented on KAFKA-914: --- Hi, We have been seeing consistent issue mirroring

[jira] [Commented] (KAFKA-3225) Method commit() of class SourceTask never invoked

2016-02-12 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15145392#comment-15145392 ] ASF GitHub Bot commented on KAFKA-3225: --- GitHub user jcustenborder opened a pull req

[GitHub] kafka pull request: KAFKA-3225: Method commit() of class SourceTas...

2016-02-12 Thread jcustenborder
GitHub user jcustenborder opened a pull request: https://github.com/apache/kafka/pull/909 KAFKA-3225: Method commit() of class SourceTask never invoked 1. Added a test case to prove commit() on SourceTask was not being called. 2. Added commitSourceTask() which logs potential exce

[jira] [Commented] (KAFKA-1397) delete topic is not working

2016-02-12 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1397?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15145364#comment-15145364 ] Ismael Juma commented on KAFKA-1397: There is also KAFKA-2937 which was fixed for 0.9.

[jira] [Commented] (KAFKA-1397) delete topic is not working

2016-02-12 Thread Andrew Duch (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1397?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15145356#comment-15145356 ] Andrew Duch commented on KAFKA-1397: I would just like to add that I am still seeing i

[jira] [Assigned] (KAFKA-2970) Both UpdateMetadataRequest.java and LeaderAndIsrRequest.java have an Endpoint class

2016-02-12 Thread chen zhu (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chen zhu reassigned KAFKA-2970: --- Assignee: chen zhu > Both UpdateMetadataRequest.java and LeaderAndIsrRequest.java have an Endpoint >

[jira] [Assigned] (KAFKA-2757) Consolidate BrokerEndPoint and EndPoint

2016-02-12 Thread chen zhu (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chen zhu reassigned KAFKA-2757: --- Assignee: chen zhu > Consolidate BrokerEndPoint and EndPoint > --

Re: [DISCUSS] KIP-47 - Add timestamp-based log deletion policy

2016-02-12 Thread Neha Narkhede
Adding a timestamp based auto-expiration is useful and this proposal makes sense. Thx! On Wed, Feb 10, 2016 at 3:35 PM, Jay Kreps wrote: > I think this makes a lot of sense and won't be hard to implement and > doesn't create too much in the way of new interfaces. > > -Jay > > On Tue, Feb 9, 2016

Question about old publishing process

2016-02-12 Thread Chip Senkbeil
Hey everyone. I'm from the incubator project, Apache Toree, a project written in Scala. We use sbt for our build process and were looking into how to leverage sbt to publish to the Apache staging and release repositories. I was looking around at other Apache projects that used sbt and noticed that

[GitHub] kafka pull request: Reconcile differences in .bat & .sh start scri...

2016-02-12 Thread fluetm
GitHub user fluetm opened a pull request: https://github.com/apache/kafka/pull/908 Reconcile differences in .bat & .sh start scripts A few minor fixes to reconcile differences between the windows and unix versions of the kafka/zookeeper start scripts that were causing cross-platform

"Topic Created" event

2016-02-12 Thread Karan Gupta
Hello, I am learning how to use kafka as my personal project. I was wondering if there is a "topic created" event that kafka or zookeeper sends such that a simple scala/java program can listen to. I was not able to find any documentation on that. Thanks for any advice :) -- Best regards Karan

[jira] [Assigned] (KAFKA-3176) Allow console consumer to consume from particular partitions when new consumer is used.

2016-02-12 Thread Vahid Hashemian (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vahid Hashemian reassigned KAFKA-3176: -- Assignee: Vahid Hashemian > Allow console consumer to consume from particular partition

[jira] [Commented] (KAFKA-3236) Honor Producer Configuration "block.on.buffer.full"

2016-02-12 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3236?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15144778#comment-15144778 ] Ismael Juma commented on KAFKA-3236: I'd mark this as an "Improvement" instead of "Bug

[jira] [Created] (KAFKA-3236) Honor Producer Configuration "block.on.buffer.full"

2016-02-12 Thread Thomas Graves (JIRA)
Thomas Graves created KAFKA-3236: Summary: Honor Producer Configuration "block.on.buffer.full" Key: KAFKA-3236 URL: https://issues.apache.org/jira/browse/KAFKA-3236 Project: Kafka Issue Type:

[jira] [Updated] (KAFKA-3235) Unclosed stream in AppInfoParser static block

2016-02-12 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-3235: --- Fix Version/s: 0.9.1.0 > Unclosed stream in AppInfoParser static block > -

[jira] [Created] (KAFKA-3235) Unclosed stream in AppInfoParser static block

2016-02-12 Thread Ted Yu (JIRA)
Ted Yu created KAFKA-3235: - Summary: Unclosed stream in AppInfoParser static block Key: KAFKA-3235 URL: https://issues.apache.org/jira/browse/KAFKA-3235 Project: Kafka Issue Type: Bug Rep

Jenkins build is back to normal : kafka_0.9.0_jdk7 #124

2016-02-12 Thread Apache Jenkins Server
See

Build failed in Jenkins: kafka-trunk-jdk8 #367

2016-02-12 Thread Apache Jenkins Server
See Changes: [wangguoz] KAFKA-3147; Memory records is not writable in MirrorMaker -- [...truncated 2826 lines...] kafka.log.FileMessageSetTest > testWrittenEqualsRead PASSED kafka.log.FileMessa

[jira] [Commented] (KAFKA-3230) Unable to commit offsets if partition is paused

2016-02-12 Thread Craig W (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15144400#comment-15144400 ] Craig W commented on KAFKA-3230: Yup, this is not a problem. > Unable to commit offsets i

[jira] [Resolved] (KAFKA-3230) Unable to commit offsets if partition is paused

2016-02-12 Thread Craig W (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig W resolved KAFKA-3230. Resolution: Not A Problem > Unable to commit offsets if partition is paused > --

Build failed in Jenkins: kafka-trunk-jdk7 #1039

2016-02-12 Thread Apache Jenkins Server
See Changes: [wangguoz] MINOR: catch an exception in rebalance and stop the stream thread [wangguoz] KAFKA-3147; Memory records is not writable in MirrorMaker -- Started by an SCM change [EnvIn

[jira] [Commented] (KAFKA-3147) Memory records is not writable in MirrorMaker

2016-02-12 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15144291#comment-15144291 ] ASF GitHub Bot commented on KAFKA-3147: --- Github user asfgit closed the pull request

[jira] [Updated] (KAFKA-3147) Memory records is not writable in MirrorMaker

2016-02-12 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-3147: - Resolution: Fixed Status: Resolved (was: Patch Available) Issue resolved by pull request

[GitHub] kafka pull request: KAFKA-3147 : Memory records is not writable in...

2016-02-12 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/825 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

Build failed in Jenkins: kafka-trunk-jdk8 #366

2016-02-12 Thread Apache Jenkins Server
See Changes: [wangguoz] MINOR: catch an exception in rebalance and stop the stream thread -- Started by an SCM change [EnvInject] - Loading node environment variables. Building remotely on H11 (d

[GitHub] kafka pull request: MINOR: catch an exception in rebalance and sto...

2016-02-12 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/901 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[jira] [Commented] (KAFKA-3234) Minor documentation edits: clarify minISR; some topic-level configs are missing

2016-02-12 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15144269#comment-15144269 ] Ismael Juma commented on KAFKA-3234: Changed "Fix version" as this missed the 0.9.0.1

[jira] [Updated] (KAFKA-3234) Minor documentation edits: clarify minISR; some topic-level configs are missing

2016-02-12 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-3234: --- Fix Version/s: (was: 0.9.0.1) 0.9.1.0 > Minor documentation edits: clarify minI