[jira] [Updated] (KAFKA-1438) Migrate kafka client tools

2014-05-23 Thread Sriharsha Chintalapani (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sriharsha Chintalapani updated KAFKA-1438: -- Attachment: KAFKA-1438.patch Migrate kafka client tools

Review Request 21865: Patch for KAFKA-1438

2014-05-23 Thread Sriharsha Chintalapani
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/21865/ --- Review request for kafka. Bugs: KAFKA-1438

[jira] [Commented] (KAFKA-1438) Migrate kafka client tools

2014-05-23 Thread Sriharsha Chintalapani (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14007278#comment-14007278 ] Sriharsha Chintalapani commented on KAFKA-1438: --- Created reviewboard

[jira] [Created] (KAFKA-1467) Fixes small documentation typos

2014-05-23 Thread Brian Chhun (JIRA)
Brian Chhun created KAFKA-1467: -- Summary: Fixes small documentation typos Key: KAFKA-1467 URL: https://issues.apache.org/jira/browse/KAFKA-1467 Project: Kafka Issue Type: Bug

[jira] [Updated] (KAFKA-1467) Fixes small documentation typos

2014-05-23 Thread Brian Chhun (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Chhun updated KAFKA-1467: --- Description: Fixes a minor typo in the log compaction section of the documentation. Also includes

Re: Review Request 21663: Patch for KAFKA-1456

2014-05-23 Thread Jun Rao
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/21663/#review43842 --- Thanks for the patch. Could we add the new codec in

[jira] [Commented] (KAFKA-1466) Kafka server is hung after throwing Attempt to swap the new high watermark file with the old one failed

2014-05-23 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14007422#comment-14007422 ] Jun Rao commented on KAFKA-1466: Hmm, that's weird. Haven't seen the file swapping failing

[jira] [Resolved] (KAFKA-1467) Fixes small documentation typos

2014-05-23 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Kreps resolved KAFKA-1467. -- Resolution: Fixed Thanks for the patch! Committed. Fixes small documentation typos

[jira] [Created] (KAFKA-1468) Improve perf tests

2014-05-23 Thread Jay Kreps (JIRA)
Jay Kreps created KAFKA-1468: Summary: Improve perf tests Key: KAFKA-1468 URL: https://issues.apache.org/jira/browse/KAFKA-1468 Project: Kafka Issue Type: Bug Reporter: Jay Kreps

Topic Partitioning Strategy For Large Data

2014-05-23 Thread Bhavesh Mistry
Hi Kafka Users, We are trying to transport 4TB data per day on single topic. It is operation application logs.How do we estimate number of partitions and partitioning strategy? Our goal is to drain (from consumer side) from the Kafka Brokers as soon as messages arrive (keep the lag as

Re: Topic Partitioning Strategy For Large Data

2014-05-23 Thread Joel Koshy
Take a look at: https://cwiki.apache.org/confluence/display/KAFKA/FAQ#FAQ-HowdoIchoosethenumberofpartitionsforatopic? On Fri, May 23, 2014 at 12:49:39PM -0700, Bhavesh Mistry wrote: Hi Kafka Users, We are trying to transport 4TB data per day on single topic. It is operation application

[jira] [Commented] (KAFKA-1466) Kafka server is hung after throwing Attempt to swap the new high watermark file with the old one failed

2014-05-23 Thread Arup Malakar (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14007651#comment-14007651 ] Arup Malakar commented on KAFKA-1466: - [~fancyrao] couldn't reproduce the error. It

[jira] [Commented] (KAFKA-1466) Kafka server is hung after throwing Attempt to swap the new high watermark file with the old one failed

2014-05-23 Thread Joel Koshy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14007674#comment-14007674 ] Joel Koshy commented on KAFKA-1466: --- You seem to have a replication factor of 1 for

[jira] [Resolved] (KAFKA-1466) Kafka server is hung after throwing Attempt to swap the new high watermark file with the old one failed

2014-05-23 Thread Joel Koshy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joel Koshy resolved KAFKA-1466. --- Resolution: Cannot Reproduce Not sure if it would help but perhaps you can include your file system,

Review Request 21878: KAFKA-1468: Misc. improvements to test scripts from benchmarking

2014-05-23 Thread Jay Kreps
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/21878/ --- Review request for kafka. Bugs: KAFKA-1468

[jira] [Updated] (KAFKA-1468) Improve perf tests

2014-05-23 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Kreps updated KAFKA-1468: - Attachment: KAFKA-1468.patch Improve perf tests -- Key: KAFKA-1468

[jira] [Commented] (KAFKA-1468) Improve perf tests

2014-05-23 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14007705#comment-14007705 ] Jay Kreps commented on KAFKA-1468: -- Created reviewboard

Re: Review Request 21616: Patch for KAFKA-924

2014-05-23 Thread Sriharsha Chintalapani
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/21616/ --- (Updated May 23, 2014, 9:47 p.m.) Review request for kafka. Bugs: KAFKA-924

[jira] [Updated] (KAFKA-924) Specify console consumer properties via a single --property command line parameter

2014-05-23 Thread Sriharsha Chintalapani (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sriharsha Chintalapani updated KAFKA-924: - Attachment: KAFKA-924_2014-05-23_14:47:30.patch Specify console consumer

[jira] [Commented] (KAFKA-924) Specify console consumer properties via a single --property command line parameter

2014-05-23 Thread Sriharsha Chintalapani (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14007753#comment-14007753 ] Sriharsha Chintalapani commented on KAFKA-924: -- Updated reviewboard

[jira] [Created] (KAFKA-1469) Util.abs function does not return correct absolute values for negative values

2014-05-23 Thread Joel Koshy (JIRA)
Joel Koshy created KAFKA-1469: - Summary: Util.abs function does not return correct absolute values for negative values Key: KAFKA-1469 URL: https://issues.apache.org/jira/browse/KAFKA-1469 Project: Kafka

Review Request 21883: Patch for KAFKA-1459

2014-05-23 Thread Sriharsha Chintalapani
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/21883/ --- Review request for kafka. Bugs: KAFKA-1459

[jira] [Updated] (KAFKA-1459) kafka.tools.ConsumerOffsetChecker throws NoNodeException

2014-05-23 Thread Sriharsha Chintalapani (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sriharsha Chintalapani updated KAFKA-1459: -- Attachment: KAFKA-1459.patch kafka.tools.ConsumerOffsetChecker throws

[jira] [Commented] (KAFKA-1459) kafka.tools.ConsumerOffsetChecker throws NoNodeException

2014-05-23 Thread Sriharsha Chintalapani (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1459?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14007968#comment-14007968 ] Sriharsha Chintalapani commented on KAFKA-1459: --- Created reviewboard