[jira] [Commented] (KAFKA-1414) Speedup broker startup after hard reset

2014-07-20 Thread Alexey Ozeritskiy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14067872#comment-14067872 ] Alexey Ozeritskiy commented on KAFKA-1414: -- Anton, your patch is not working for

[jira] [Commented] (KAFKA-1414) Speedup broker startup after hard reset

2014-07-20 Thread Anton Karamanov (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14067884#comment-14067884 ] Anton Karamanov commented on KAFKA-1414: [~aozeritsky] are you testing shutdown or

[jira] [Comment Edited] (KAFKA-1414) Speedup broker startup after hard reset

2014-07-20 Thread Anton Karamanov (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14067884#comment-14067884 ] Anton Karamanov edited comment on KAFKA-1414 at 7/20/14 11:07 AM:

[jira] [Commented] (KAFKA-1414) Speedup broker startup after hard reset

2014-07-20 Thread Alexey Ozeritskiy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14067917#comment-14067917 ] Alexey Ozeritskiy commented on KAFKA-1414: -- You must create an instance of

[jira] [Comment Edited] (KAFKA-1414) Speedup broker startup after hard reset

2014-07-20 Thread Alexey Ozeritskiy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14067917#comment-14067917 ] Alexey Ozeritskiy edited comment on KAFKA-1414 at 7/20/14 12:48 PM:

[jira] [Comment Edited] (KAFKA-1414) Speedup broker startup after hard reset

2014-07-20 Thread Alexey Ozeritskiy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14067917#comment-14067917 ] Alexey Ozeritskiy edited comment on KAFKA-1414 at 7/20/14 12:54 PM:

Re: Review Request 23702: Patch for KAFKA-1070

2014-07-20 Thread Sriharsha Chintalapani
On July 19, 2014, 11:28 p.m., Timothy Chen wrote: core/src/main/scala/kafka/server/KafkaConfig.scala, line 64 https://reviews.apache.org/r/23702/diff/2/?file=636339#file636339line64 Why reduce the range to 1000? As we go with auto-generating broker id we want to have a backward

Re: Review Request 23702: Patch for KAFKA-1070

2014-07-20 Thread Timothy Chen
On July 19, 2014, 11:28 p.m., Timothy Chen wrote: core/src/main/scala/kafka/server/KafkaConfig.scala, line 64 https://reviews.apache.org/r/23702/diff/2/?file=636339#file636339line64 Why reduce the range to 1000? Sriharsha Chintalapani wrote: As we go with auto-generating

[jira] [Commented] (KAFKA-1414) Speedup broker startup after hard reset

2014-07-20 Thread Oleg Golovin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14067986#comment-14067986 ] Oleg Golovin commented on KAFKA-1414: - [~ataraxer], you seem to run all the threadpool

[jira] [Resolved] (KAFKA-1551) Configuration example errors

2014-07-20 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Kreps resolved KAFKA-1551. -- Resolution: Fixed Fixed. Configuration example errors

[jira] [Updated] (KAFKA-1552) Quickstart refers to wrong port in pastable commands

2014-07-20 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Kreps updated KAFKA-1552: - Assignee: Olle Jonsson Quickstart refers to wrong port in pastable commands

[jira] [Updated] (KAFKA-1552) Quickstart refers to wrong port in pastable commands

2014-07-20 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Kreps updated KAFKA-1552: - Resolution: Fixed Status: Resolved (was: Patch Available) Fixed, thanks! Quickstart refers to

[jira] [Updated] (KAFKA-1551) Configuration example errors

2014-07-20 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Kreps updated KAFKA-1551: - Assignee: Alexey Ozeritskiy Configuration example errors

[jira] [Commented] (KAFKA-1414) Speedup broker startup after hard reset

2014-07-20 Thread Anton Karamanov (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14068007#comment-14068007 ] Anton Karamanov commented on KAFKA-1414: I see the problem now. I still think that

[jira] [Commented] (KAFKA-1539) Due to OS caching Kafka might loose offset files which causes full reset of data

2014-07-20 Thread Dmitry Bugaychenko (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1539?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14068010#comment-14068010 ] Dmitry Bugaychenko commented on KAFKA-1539: --- Digged the proble a bit more. It

[jira] [Comment Edited] (KAFKA-1539) Due to OS caching Kafka might loose offset files which causes full reset of data

2014-07-20 Thread Dmitry Bugaychenko (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1539?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14068010#comment-14068010 ] Dmitry Bugaychenko edited comment on KAFKA-1539 at 7/20/14 6:30 PM:

[jira] [Commented] (KAFKA-1414) Speedup broker startup after hard reset

2014-07-20 Thread Dmitry Bugaychenko (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14068013#comment-14068013 ] Dmitry Bugaychenko commented on KAFKA-1414: --- In our use case inter-directory

[jira] [Commented] (KAFKA-1414) Speedup broker startup after hard reset

2014-07-20 Thread Oleg Golovin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14068014#comment-14068014 ] Oleg Golovin commented on KAFKA-1414: - I see only one problem here. If we disperse

[jira] [Commented] (KAFKA-1414) Speedup broker startup after hard reset

2014-07-20 Thread Dmitry Bugaychenko (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14068015#comment-14068015 ] Dmitry Bugaychenko commented on KAFKA-1414: --- That is why in my initial proposal

[jira] [Commented] (KAFKA-1414) Speedup broker startup after hard reset

2014-07-20 Thread Oleg Golovin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14068018#comment-14068018 ] Oleg Golovin commented on KAFKA-1414: - [~junrao] wrote about parallelization over

[jira] [Commented] (KAFKA-1414) Speedup broker startup after hard reset

2014-07-20 Thread Dmitry Bugaychenko (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14068020#comment-14068020 ] Dmitry Bugaychenko commented on KAFKA-1414: --- Separate thread pool per each dir

[jira] [Commented] (KAFKA-1414) Speedup broker startup after hard reset

2014-07-20 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14068021#comment-14068021 ] Jay Kreps commented on KAFKA-1414: -- We should check that having multiple threads

Improved site docs on how to contribute

2014-07-20 Thread Jay Kreps
Following up on the recent contributor thread I tried to improve the docs on how to contribute to Kafka: http://kafka.apache.org/contributing.html Let me know if anyone has any additional suggestions on what should be there. -Jay

[jira] [Updated] (KAFKA-1414) Speedup broker startup after hard reset

2014-07-20 Thread Anton Karamanov (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anton Karamanov updated KAFKA-1414: --- Attachment: KAFKA-1414-rev3-interleaving.patch Log-level parallelization is better in any

[jira] [Comment Edited] (KAFKA-1414) Speedup broker startup after hard reset

2014-07-20 Thread Anton Karamanov (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14068047#comment-14068047 ] Anton Karamanov edited comment on KAFKA-1414 at 7/20/14 9:14 PM:

Re: Review Request 23697: Fix KAFKA-1533: Address Jun and Neha's comments

2014-07-20 Thread Jun Rao
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/23697/#review48194 --- clients/src/main/java/org/apache/kafka/clients/NetworkClient.java

[jira] [Commented] (KAFKA-1549) dead brokers coming in the TopicMetadataResponse

2014-07-20 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14068165#comment-14068165 ] Jun Rao commented on KAFKA-1549: Thanks for the patch. A couple of comments. 1.

Re: Review Request 23705: Patch for KAFKA-1192

2014-07-20 Thread Jun Rao
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/23705/#review48195 --- Thanks for the patch. A couple of comments below.

[jira] [Commented] (KAFKA-1414) Speedup broker startup after hard reset

2014-07-20 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14068173#comment-14068173 ] Jay Kreps commented on KAFKA-1414: -- I did a test of single-threaded recovery on my laptop

[jira] [Commented] (KAFKA-1414) Speedup broker startup after hard reset

2014-07-20 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14068177#comment-14068177 ] Jay Kreps commented on KAFKA-1414: -- [~ataraxer] I agree that just throwing all the logs

[jira] [Commented] (KAFKA-1451) Broker stuck due to leader election race

2014-07-20 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14068193#comment-14068193 ] Jun Rao commented on KAFKA-1451: Neha, I am not sure if #1 is need. We can get into elect

[jira] [Commented] (KAFKA-1546) Automate replica lag tuning

2014-07-20 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14068209#comment-14068209 ] Jun Rao commented on KAFKA-1546: Jay, I think what you proposed is nice and simple. I