[jira] [Commented] (KAFKA-1196) java.lang.IllegalArgumentException Buffer.limit on FetchResponse.scala + 33

2014-01-15 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13872210#comment-13872210 ] Jun Rao commented on KAFKA-1196: Yes, I wasn't thinking of fixing the issue since I can't

[jira] [Commented] (KAFKA-1196) java.lang.IllegalArgumentException Buffer.limit on FetchResponse.scala + 33

2014-01-15 Thread Gerrit Jansen van Vuuren (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13872215#comment-13872215 ] Gerrit Jansen van Vuuren commented on KAFKA-1196: - :) , it doesn't seem

[jira] [Resolved] (KAFKA-1202) optimize ZK access in KafkaController

2014-01-15 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao resolved KAFKA-1202. Resolution: Fixed Fix Version/s: 0.8.1 Thanks for the review. Committed to trunk. Also,

[jira] [Updated] (KAFKA-1020) Remove getAllReplicasOnBroker from KafkaController

2014-01-15 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao updated KAFKA-1020: --- Resolution: Fixed Status: Resolved (was: Patch Available) Fixed as part of kafka-1202. Remove

[jira] [Commented] (KAFKA-1196) java.lang.IllegalArgumentException Buffer.limit on FetchResponse.scala + 33

2014-01-15 Thread Gerrit Jansen van Vuuren (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13872281#comment-13872281 ] Gerrit Jansen van Vuuren commented on KAFKA-1196: - I've written a consumer

Kafka server start from resource negotiator(s)

2014-01-15 Thread Joe Stein
Hi, I am working at adding some code to the kafka.Kafka.scala file. What I was thinking for the Utils.loadProps is to create some ResourceNegotiatedConfiguration class or something to sit with it so various frameworks can be supported. For Mesos I am thinking of storing the properties in

[jira] [Created] (KAFKA-1207) Launch Kafka from within Apache Mesos

2014-01-15 Thread Joe Stein (JIRA)
Joe Stein created KAFKA-1207: Summary: Launch Kafka from within Apache Mesos Key: KAFKA-1207 URL: https://issues.apache.org/jira/browse/KAFKA-1207 Project: Kafka Issue Type: Bug

[jira] [Updated] (KAFKA-1207) Launch Kafka from within Apache Mesos

2014-01-15 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joe Stein updated KAFKA-1207: - Labels: mesos (was: ) Launch Kafka from within Apache Mesos -

[jira] [Updated] (KAFKA-1206) allow Kafka to start from a resource negotiator system

2014-01-15 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joe Stein updated KAFKA-1206: - Labels: mesos (was: ) allow Kafka to start from a resource negotiator system

[jira] [Updated] (KAFKA-1206) allow Kafka to start from a resource negotiator system

2014-01-15 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joe Stein updated KAFKA-1206: - Description: We need a generic implementation to hold the property information for brokers, producers

Review Request 16923: Patch for KAFKA-1206

2014-01-15 Thread Joe Stein
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/16923/ --- Review request for kafka. Bugs: KAFKA-1206

[jira] [Updated] (KAFKA-1206) allow Kafka to start from a resource negotiator system

2014-01-15 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joe Stein updated KAFKA-1206: - Attachment: KAFKA-1206.patch allow Kafka to start from a resource negotiator system

[jira] [Commented] (KAFKA-1206) allow Kafka to start from a resource negotiator system

2014-01-15 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13872749#comment-13872749 ] Joe Stein commented on KAFKA-1206: -- Created reviewboard

[jira] [Created] (KAFKA-1208) Update system test still to use kafka-topics instead of kafka-create-topics shell

2014-01-15 Thread Guozhang Wang (JIRA)
Guozhang Wang created KAFKA-1208: Summary: Update system test still to use kafka-topics instead of kafka-create-topics shell Key: KAFKA-1208 URL: https://issues.apache.org/jira/browse/KAFKA-1208

[jira] [Created] (KAFKA-1209) System test transient failure due to ProducerPerformance's connection to servers kept broken

2014-01-15 Thread Guozhang Wang (JIRA)
Guozhang Wang created KAFKA-1209: Summary: System test transient failure due to ProducerPerformance's connection to servers kept broken Key: KAFKA-1209 URL: https://issues.apache.org/jira/browse/KAFKA-1209

Re: Review Request 16360: Fix the offset bug while adding fetchers

2014-01-15 Thread Guozhang Wang
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/16360/ --- (Updated Jan. 16, 2014, 12:43 a.m.) Review request for kafka. Summary

[jira] [Updated] (KAFKA-1188) Stale LeaderAndIsr request could be handled by the broker on Controller failover

2014-01-15 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-1188: - Attachment: KAFKA-1188_2014-01-15_16:43:30.patch Stale LeaderAndIsr request could be handled by

[jira] [Commented] (KAFKA-1188) Stale LeaderAndIsr request could be handled by the broker on Controller failover

2014-01-15 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13872882#comment-13872882 ] Guozhang Wang commented on KAFKA-1188: -- Updated reviewboard

Re: Review Request 16360: Fix the offset bug while adding fetchers

2014-01-15 Thread Guozhang Wang
On Jan. 7, 2014, 5:12 p.m., Neha Narkhede wrote: In general, does the alternate approach of sending all commands to every broker and let the broker ignore a become follower if it is for the same leader as the current one? The reason why this would work is because all

development branches in git

2014-01-15 Thread Joe Stein
What are folks thoughts about development branches with the branch being the ticket number? I think it should continue to follow the bylaws but how do we vote in the initial commit? Can a committer just +1 whether the JIRA ticket gets a branch or can we have it so committer (even if committer is

Re: development branches in git

2014-01-15 Thread Guozhang Wang
For mos of the JIRAs one person is mainly in charge of the patch. For large JIRAs that would need multiple sub-tickets we can just assign different people on sub-tasks. That said, I think it makes sense to create branch when the development period would take long ( 1 month, say), and hence

Review Request 16944: Use kafka-topics for system-test

2014-01-15 Thread Guozhang Wang
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/16944/ --- Review request for kafka. Bugs: KAFKA-1208

[jira] [Resolved] (KAFKA-1208) Update system test still to use kafka-topics instead of kafka-create-topics shell

2014-01-15 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao resolved KAFKA-1208. Resolution: Fixed Thanks for the patch. +1 and committed to trunk. Update system test still to use

Re: Review Request 16360: Fix the offset bug while adding fetchers

2014-01-15 Thread Jun Rao
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/16360/#review32002 --- Looks good. Just a couple of minor comments.

Re: Kafka server start from resource negotiator(s)

2014-01-15 Thread Jun Rao
Hi, Joe, Thanks for looking into this. Do you plan to add a dependency to Mesos in kafka jar? Jun On Wed, Jan 15, 2014 at 10:50 AM, Joe Stein joe.st...@stealth.ly wrote: Hi, I am working at adding some code to the kafka.Kafka.scala file. What I was thinking for the Utils.loadProps is to

[jira] [Updated] (KAFKA-1206) allow Kafka to start from a resource negotiator system

2014-01-15 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joe Stein updated KAFKA-1206: - Attachment: KAFKA-1206_2014-01-16_00:36:52.patch allow Kafka to start from a resource negotiator system

Re: Review Request 16923: Patch for KAFKA-1206

2014-01-15 Thread Joe Stein
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/16923/ --- (Updated Jan. 16, 2014, 5:37 a.m.) Review request for kafka. Bugs:

[jira] [Commented] (KAFKA-1206) allow Kafka to start from a resource negotiator system

2014-01-15 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13873063#comment-13873063 ] Joe Stein commented on KAFKA-1206: -- Updated reviewboard

[jira] [Updated] (KAFKA-1206) allow Kafka to start from a resource negotiator system

2014-01-15 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joe Stein updated KAFKA-1206: - Attachment: (was: KAFKA-1206.patch) allow Kafka to start from a resource negotiator system

Re: Review Request 16923: Patch for KAFKA-1206

2014-01-15 Thread Joe Stein
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/16923/ --- (Updated Jan. 16, 2014, 5:39 a.m.) Review request for kafka. Bugs:

[jira] [Updated] (KAFKA-1206) allow Kafka to start from a resource negotiator system

2014-01-15 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joe Stein updated KAFKA-1206: - Attachment: (was: KAFKA-1206_2014-01-16_00:36:52.patch) allow Kafka to start from a resource

Re: Review Request 16923: Patch for KAFKA-1206

2014-01-15 Thread Joe Stein
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/16923/ --- (Updated Jan. 16, 2014, 5:40 a.m.) Review request for kafka. Bugs:

[jira] [Updated] (KAFKA-1206) allow Kafka to start from a resource negotiator system

2014-01-15 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joe Stein updated KAFKA-1206: - Attachment: KAFKA-1206_2014-01-16_00:40:30.patch allow Kafka to start from a resource negotiator system

[jira] [Updated] (KAFKA-1206) allow Kafka to start from a resource negotiator system

2014-01-15 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joe Stein updated KAFKA-1206: - Attachment: (was: KAFKA-1206_2014-01-16_00:39:12.patch) allow Kafka to start from a resource

[jira] [Commented] (KAFKA-1206) allow Kafka to start from a resource negotiator system

2014-01-15 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13873065#comment-13873065 ] Joe Stein commented on KAFKA-1206: -- Updated reviewboard

[jira] [Updated] (KAFKA-1206) allow Kafka to start from a resource negotiator system

2014-01-15 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joe Stein updated KAFKA-1206: - Attachment: KAFKA-1206_2014-01-16_00:39:12.patch allow Kafka to start from a resource negotiator system

Re: Kafka server start from resource negotiator(s)

2014-01-15 Thread Joe Stein
Right now I am testing it that way. Once it is working and if that becomes a problem then moving it into a mesosFramework project is no problem. if we do that it would be beneficial if they were organized under some resource manager folder or something. The way I wrote

[jira] [Updated] (KAFKA-1207) Launch Kafka from within Apache Mesos

2014-01-15 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joe Stein updated KAFKA-1207: - Status: Patch Available (was: Open) Launch Kafka from within Apache Mesos

[jira] [Updated] (KAFKA-1207) Launch Kafka from within Apache Mesos

2014-01-15 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joe Stein updated KAFKA-1207: - Status: Open (was: Patch Available) Launch Kafka from within Apache Mesos

[jira] [Updated] (KAFKA-1206) allow Kafka to start from a resource negotiator system

2014-01-15 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joe Stein updated KAFKA-1206: - Status: Patch Available (was: Open) allow Kafka to start from a resource negotiator system