[jira] [Updated] (KAFKA-1414) Speedup broker startup after hard reset

2014-07-18 Thread Anton Karamanov (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anton Karamanov updated KAFKA-1414: --- Attachment: (was: KAFKA-1414-rev2.fixed.patch) Speedup broker startup after hard reset

[jira] [Updated] (KAFKA-1414) Speedup broker startup after hard reset

2014-07-18 Thread Anton Karamanov (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anton Karamanov updated KAFKA-1414: --- Attachment: KAFKA-1414-rev2.fixed.patch Speedup broker startup after hard reset

[jira] [Updated] (KAFKA-1414) Speedup broker startup after hard reset

2014-07-18 Thread Anton Karamanov (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anton Karamanov updated KAFKA-1414: --- Attachment: freebie.patch I would also like to throw in that little [patch|^freebie.patch].

[jira] [Commented] (KAFKA-1510) Force offset commits at a minimum interval when migrating consumer offsets from zookeeper to kafka

2014-07-18 Thread Nicolae Marasoiu (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1510?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14066294#comment-14066294 ] Nicolae Marasoiu commented on KAFKA-1510: - Hi, it sounds clear and simple enough,

[jira] [Commented] (KAFKA-1535) return all live brokers in TopicMetadataResponse

2014-07-18 Thread Nicolae Marasoiu (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14066307#comment-14066307 ] Nicolae Marasoiu commented on KAFKA-1535: - awesome, I see you applied the patch

[jira] [Commented] (KAFKA-1282) Disconnect idle socket connection in Selector

2014-07-18 Thread Nicolae Marasoiu (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14066315#comment-14066315 ] Nicolae Marasoiu commented on KAFKA-1282: - Right, the limitation is more critical

[jira] [Commented] (KAFKA-1509) Restart of destination broker after unreplicated partition move leaves partitions without leader

2014-07-18 Thread Nicolae Marasoiu (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14066319#comment-14066319 ] Nicolae Marasoiu commented on KAFKA-1509: - Is a fix still needed for this, do you

Re: [DISCUSS] Kafka Security Specific Features

2014-07-18 Thread Pramod Deshmukh
Hello Raja/Joe, When I turn on security, i still get out of memory error on producer. Is this something to do with keys? Is there any other way I can connect to broker? *producer log* [2014-07-17 15:38:14,186] ERROR OOME with size 352518400 (kafka.network. BoundedByteBufferReceive)

[jira] [Commented] (KAFKA-328) Write unit test for kafka server startup and shutdown API

2014-07-18 Thread BalajiSeshadri (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14066423#comment-14066423 ] BalajiSeshadri commented on KAFKA-328: -- Sure will do. Can you guys please verify my

[jira] [Updated] (KAFKA-1536) Change the status of the JIRA to Patch Available in the kafka-review-tool

2014-07-18 Thread Manikumar Reddy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikumar Reddy updated KAFKA-1536: --- Attachment: (was: KAFKA-1536.patch) Change the status of the JIRA to Patch Available in

[jira] [Commented] (KAFKA-1536) Change the status of the JIRA to Patch Available in the kafka-review-tool

2014-07-18 Thread Manikumar Reddy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14066424#comment-14066424 ] Manikumar Reddy commented on KAFKA-1536: Updated reviewboard

[jira] [Updated] (KAFKA-1536) Change the status of the JIRA to Patch Available in the kafka-review-tool

2014-07-18 Thread Manikumar Reddy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikumar Reddy updated KAFKA-1536: --- Attachment: KAFKA-1536_2014-07-18_20:41:40.patch Change the status of the JIRA to Patch

Re: Review Request 23440: addressing reviewer comments

2014-07-18 Thread Manikumar Reddy O
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/23440/ --- (Updated July 18, 2014, 3:13 p.m.) Review request for kafka. Summary

[jira] [Updated] (KAFKA-1536) Change the status of the JIRA to Patch Available in the kafka-review-tool

2014-07-18 Thread Manikumar Reddy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikumar Reddy updated KAFKA-1536: --- Assignee: Manikumar Reddy (was: Neha Narkhede) Status: Open (was: Patch Available)

[jira] [Updated] (KAFKA-1536) Change the status of the JIRA to Patch Available in the kafka-review-tool

2014-07-18 Thread Manikumar Reddy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikumar Reddy updated KAFKA-1536: --- Status: Patch Available (was: Open) Change the status of the JIRA to Patch Available in

[jira] [Updated] (KAFKA-1536) Change the status of the JIRA to Patch Available in the kafka-review-tool

2014-07-18 Thread Manikumar Reddy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikumar Reddy updated KAFKA-1536: --- Attachment: (was: KAFKA-1536_2014-07-18_20:36:29.patch) Change the status of the JIRA

Re: KAFKA-1150

2014-07-18 Thread Guozhang Wang
Hi Simon, Just commented on the ticket. Guozhang On Fri, Jul 18, 2014 at 4:56 AM, Simon Cooper simon.coo...@featurespace.co.uk wrote: There's been no recent movement on KAFKA-1150. We’re significantly affected by this bug, trying to achieve small-millisecond transfer latencies on a

[jira] [Commented] (KAFKA-1150) Fetch on a replicated topic does not return as soon as possible

2014-07-18 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14066435#comment-14066435 ] Guozhang Wang commented on KAFKA-1150: -- Simon, I am currently working on KAFKA-1430,

[jira] [Commented] (KAFKA-1535) return all live brokers in TopicMetadataResponse

2014-07-18 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14066439#comment-14066439 ] Jay Kreps commented on KAFKA-1535: -- To date we have not really used pull requests. Apache

[jira] [Commented] (KAFKA-1150) Fetch on a replicated topic does not return as soon as possible

2014-07-18 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14066440#comment-14066440 ] Jay Kreps commented on KAFKA-1150: -- Yeah, [~thecoop1984], can you verify that the patch

[jira] [Commented] (KAFKA-1451) Broker stuck due to leader election race

2014-07-18 Thread Neha Narkhede (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14066456#comment-14066456 ] Neha Narkhede commented on KAFKA-1451: -- Just checking the existence is not enough

[jira] [Commented] (KAFKA-1282) Disconnect idle socket connection in Selector

2014-07-18 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14066461#comment-14066461 ] Jay Kreps commented on KAFKA-1282: -- The goal is just to reduce server connection count.

Re: [DISCUSS] Kafka Security Specific Features

2014-07-18 Thread Joe Stein
Hi Pramod, Can you increase KAFKA_HEAP_OPTS to lets say -Xmx1G in the kafka-console-producer.sh to see if that gets you further along please in your testing? Thanks! /*** Joe Stein Founder, Principal Consultant Big Data Open Source Security LLC

[jira] [Commented] (KAFKA-1476) Get a list of consumer groups

2014-07-18 Thread Neha Narkhede (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14066467#comment-14066467 ] Neha Narkhede commented on KAFKA-1476: -- Thanks for the patch,

[jira] [Commented] (KAFKA-1476) Get a list of consumer groups

2014-07-18 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14066471#comment-14066471 ] Jay Kreps commented on KAFKA-1476: -- This looks good to me. One thing we should think

[jira] [Commented] (KAFKA-1414) Speedup broker startup after hard reset

2014-07-18 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14066477#comment-14066477 ] Jun Rao commented on KAFKA-1414: Thanks for patch v4. Some more comments. 40. LogManager:

[jira] [Commented] (KAFKA-1282) Disconnect idle socket connection in Selector

2014-07-18 Thread Nicolae Marasoiu (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14066481#comment-14066481 ] Nicolae Marasoiu commented on KAFKA-1282: - Beautiful, I can't wait to work this

[jira] [Commented] (KAFKA-1476) Get a list of consumer groups

2014-07-18 Thread Todd Palino (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14066488#comment-14066488 ] Todd Palino commented on KAFKA-1476: I tend to agree, ~jkreps. We currently have

JIRA problem

2014-07-18 Thread Jay Kreps
I can't seem to assign JIRAs to anyone but a few committer people. Does anyone know what causes this or how to fix it? Is this happening to anyone else? -Jay

Re: JIRA problem

2014-07-18 Thread Jarek Jarcec Cecho
You have to add those people as a contributors in JIRA project administration. Click on “roles” in the KAFKA project administration and find field “contributors”. Jarcec On Jul 18, 2014, at 9:32 AM, Jay Kreps jay.kr...@gmail.com wrote: I can't seem to assign JIRAs to anyone but a few

[jira] [Assigned] (KAFKA-1535) return all live brokers in TopicMetadataResponse

2014-07-18 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao reassigned KAFKA-1535: -- Assignee: nicu marasoiu (was: Jay Kreps) Nicu, Yes, your observation is correct. The way that we

Re: JIRA problem

2014-07-18 Thread Jarek Jarcec Cecho
I would assume that you will have to go to this page: https://issues.apache.org/jira/plugins/servlet/project-config/KAFKA/roles I don’t have access there, I’ve just replaced project name SQOOP with KAFKA :-) Jarcec On Jul 18, 2014, at 9:35 AM, Jarek Jarcec Cecho jar...@apache.org wrote: You

Re: JIRA problem

2014-07-18 Thread Joe Stein
Shouldn't we make sure that the people in the contributor group have signed and sent in their ICLA http://www.apache.org/licenses/icla.txt much like we do for confluence? This helps to control also that all contributors have signed an ICLA too. /*** Joe

Re: JIRA problem

2014-07-18 Thread Jarek Jarcec Cecho
To my best knowledge ICLA is required only for committers - people that do have commit bit on ASF repositories. Contributors can’t commit their patch themselves and hence they have to attach their patch to JIRA where they implicitly agree with all the legal stuff. There is some license

Re: JIRA problem

2014-07-18 Thread Jun Rao
I am not sure if an ICLA is required for contributing patches. Requiring that may make it harder for people who want to contribute. Currently, only Kafka PMC members can change the contributors list. Thanks, Jun On Fri, Jul 18, 2014 at 9:45 AM, Joe Stein joe.st...@stealth.ly wrote:

[jira] [Commented] (KAFKA-1510) Force offset commits at a minimum interval when migrating consumer offsets from zookeeper to kafka

2014-07-18 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1510?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14066532#comment-14066532 ] Guozhang Wang commented on KAFKA-1510: -- Hi Nicolae, Thanks for taking this ticket.

[jira] [Commented] (KAFKA-1535) return all live brokers in TopicMetadataResponse

2014-07-18 Thread nicu marasoiu (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14066538#comment-14066538 ] nicu marasoiu commented on KAFKA-1535: -- Sure do want:) Yes, that was my suggestion as

[jira] [Assigned] (KAFKA-1282) Disconnect idle socket connection in Selector

2014-07-18 Thread nicu marasoiu (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] nicu marasoiu reassigned KAFKA-1282: Assignee: nicu marasoiu Disconnect idle socket connection in Selector

[jira] [Commented] (KAFKA-1549) dead brokers coming in the TopicMetadataResponse

2014-07-18 Thread nicu marasoiu (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14066548#comment-14066548 ] nicu marasoiu commented on KAFKA-1549: -- test if i receive mails on this jira task

Re: [DISCUSS] Kafka Security Specific Features

2014-07-18 Thread Pramod Deshmukh
Thanks Joe, I don't see any Out of memory error. Now I get exception when Producer fetches metadata for a topic Here is how I created the topic and run producer pdeshmukh$ bin/kafka-topics.sh --create --zookeeper localhost:2181 --replication-factor 1 --partitions 1 --topic secureTopic Created

[jira] [Commented] (KAFKA-1509) Restart of destination broker after unreplicated partition move leaves partitions without leader

2014-07-18 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14066567#comment-14066567 ] Guozhang Wang commented on KAFKA-1509: -- Yes this is still a valid issue, but could

Re: JIRA problem

2014-07-18 Thread Jay Kreps
I think having people fax in permission slips to edit the wiki or get bugs assigned to them is a bit hostile to potential contributors. Is this a legal Apache restriction that we have to abide by or just the way our permissions defaulted? Can we change this? Would people be opposed to changing it?

Re: JIRA problem

2014-07-18 Thread Jarek Jarcec Cecho
I do see separate concerns here, so let me describe how we’re addressing them in other projects where I’m involved. It doesn’t mean that Kafka need to follow them, just sharing my experience. 1) Submitting a patch to JIRA No paper work required, all legalities are resolved implicitly by the

Re: JIRA problem

2014-07-18 Thread Joe Stein
Jay, I agree with you. This goes back to the spam fiasco that occurred on confluence and the pendulum swinging because of it. Re-reading that email there doesn't seem anything specific requiring us to have them sign the ICLA but it looks like that is a requirement if we wanted INFRA to assign

[jira] [Commented] (KAFKA-1476) Get a list of consumer groups

2014-07-18 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14066583#comment-14066583 ] Jay Kreps commented on KAFKA-1476: -- Cool, so [~balaji.seshadri] would you be willing to

Re: JIRA problem

2014-07-18 Thread Jay Kreps
Joe--that sounds great, let's do that! So I guess we should put something in the wiki about how to get added to that group? Jarek--thanks for the summary, that is very helpful. I will follow-up with the infra people on letting people assign JIRAs. -jay On Fri, Jul 18, 2014 at 10:36 AM, Joe

[jira] [Commented] (KAFKA-1476) Get a list of consumer groups

2014-07-18 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14066613#comment-14066613 ] Guozhang Wang commented on KAFKA-1476: -- 1. List groups: return the list of group ids.

Re: JIRA problem

2014-07-18 Thread Guozhang Wang
I once noticed Samza also had a similar problem and Jacob resolved it by talking to the Apache people. We can probably ask him how he gets it done. On Fri, Jul 18, 2014 at 10:36 AM, Joe Stein joe.st...@stealth.ly wrote: Jay, I agree with you. This goes back to the spam fiasco that occurred

Re: JIRA problem

2014-07-18 Thread Joe Stein
I have been assigning people on confluence (they granted us access at that time after some back and forth) we already have permission to-do that no reason to talk to INFRA. Everyone in the PMC should have access. /*** Joe Stein Founder, Principal

[jira] [Commented] (KAFKA-1476) Get a list of consumer groups

2014-07-18 Thread Balaji Seshadri (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14066695#comment-14066695 ] Balaji Seshadri commented on KAFKA-1476: I have completed 1 and 2,will work on

[jira] [Issue Comment Deleted] (KAFKA-1476) Get a list of consumer groups

2014-07-18 Thread Balaji Seshadri (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Balaji Seshadri updated KAFKA-1476: --- Comment: was deleted (was: ~jay.kreps ) Get a list of consumer groups

[jira] [Commented] (KAFKA-1476) Get a list of consumer groups

2014-07-18 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14066699#comment-14066699 ] Guozhang Wang commented on KAFKA-1476: -- You are already ahead of us, since the

[jira] [Commented] (KAFKA-1476) Get a list of consumer groups

2014-07-18 Thread Balaji Seshadri (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14066698#comment-14066698 ] Balaji Seshadri commented on KAFKA-1476: ~jay.kreps Get a list of consumer

[jira] [Commented] (KAFKA-1476) Get a list of consumer groups

2014-07-18 Thread Balaji Seshadri (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14066720#comment-14066720 ] Balaji Seshadri commented on KAFKA-1476: Which shell script should i change,i

[jira] [Commented] (KAFKA-1476) Get a list of consumer groups

2014-07-18 Thread BalajiSeshadri (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14066776#comment-14066776 ] BalajiSeshadri commented on KAFKA-1476: --- Please find patch attached after renaming

[jira] [Updated] (KAFKA-1476) Get a list of consumer groups

2014-07-18 Thread BalajiSeshadri (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BalajiSeshadri updated KAFKA-1476: -- Status: Patch Available (was: In Progress) Get a list of consumer groups

[jira] [Updated] (KAFKA-1476) Get a list of consumer groups

2014-07-18 Thread BalajiSeshadri (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BalajiSeshadri updated KAFKA-1476: -- Assignee: BalajiSeshadri Status: Patch Available (was: Open) Attaching updated patch

[jira] [Updated] (KAFKA-1476) Get a list of consumer groups

2014-07-18 Thread BalajiSeshadri (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BalajiSeshadri updated KAFKA-1476: -- Attachment: KAFKA-1476-RENAME.patch Get a list of consumer groups

[jira] [Updated] (KAFKA-1549) dead brokers coming in the TopicMetadataResponse

2014-07-18 Thread nicu marasoiu (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] nicu marasoiu updated KAFKA-1549: - Description: JunRao confirming my observation that brokers are only added to the metadataCache,

[jira] [Updated] (KAFKA-1549) dead brokers coming in the TopicMetadataResponse

2014-07-18 Thread nicu marasoiu (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] nicu marasoiu updated KAFKA-1549: - Affects Version/s: 0.8.2 dead brokers coming in the TopicMetadataResponse

[jira] [Assigned] (KAFKA-1510) Force offset commits at a minimum interval when migrating consumer offsets from zookeeper to kafka

2014-07-18 Thread nicu marasoiu (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] nicu marasoiu reassigned KAFKA-1510: Assignee: nicu marasoiu Force offset commits at a minimum interval when migrating

[jira] [Commented] (KAFKA-1549) dead brokers coming in the TopicMetadataResponse

2014-07-18 Thread nicu marasoiu (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14066784#comment-14066784 ] nicu marasoiu commented on KAFKA-1549: -- esepntially i will replace the list/map of

[jira] [Commented] (KAFKA-1535) return all live brokers in TopicMetadataResponse

2014-07-18 Thread nicu marasoiu (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14066791#comment-14066791 ] nicu marasoiu commented on KAFKA-1535: -- created KAFKA-1549 with Major priority. I

[jira] [Commented] (KAFKA-1510) Force offset commits at a minimum interval when migrating consumer offsets from zookeeper to kafka

2014-07-18 Thread Joel Koshy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1510?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14066792#comment-14066792 ] Joel Koshy commented on KAFKA-1510: --- I think it should be sufficient to force commit

[jira] [Comment Edited] (KAFKA-1535) return all live brokers in TopicMetadataResponse

2014-07-18 Thread nicu marasoiu (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14066791#comment-14066791 ] nicu marasoiu edited comment on KAFKA-1535 at 7/18/14 7:50 PM:

[jira] [Created] (KAFKA-1550) Patch review tool should use git format-patch to generate patch

2014-07-18 Thread Dong Lin (JIRA)
Dong Lin created KAFKA-1550: --- Summary: Patch review tool should use git format-patch to generate patch Key: KAFKA-1550 URL: https://issues.apache.org/jira/browse/KAFKA-1550 Project: Kafka Issue

[jira] [Updated] (KAFKA-1550) Patch review tool should use git format-patch to generate patch

2014-07-18 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated KAFKA-1550: Description: 1) kafka-patch-review.py uses git-diff to generate patch for jira ticket. The resulting

[jira] [Updated] (KAFKA-1550) Patch review tool should use git format-patch to generate patch

2014-07-18 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated KAFKA-1550: Description: 1) kafka-patch-review.py uses git-diff to generate patch for jira ticket. The resulting

Review Request 23692: Patch for KAFKA-1550

2014-07-18 Thread Dong Lin
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/23692/ --- Review request for kafka. Bugs: KAFKA-1550

[jira] [Commented] (KAFKA-1550) Patch review tool should use git format-patch to generate patch

2014-07-18 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14066871#comment-14066871 ] Dong Lin commented on KAFKA-1550: - Created reviewboard

[jira] [Updated] (KAFKA-1550) Patch review tool should use git format-patch to generate patch

2014-07-18 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated KAFKA-1550: Attachment: KAFKA-1550.patch Patch review tool should use git format-patch to generate patch

Improving the Kafka client ecosystem

2014-07-18 Thread Jay Kreps
A question was asked in another thread about what was an effective way to contribute to the Kafka project for people who weren't very enthusiastic about writing Java/Scala code. I wanted to kind of advocate for an area I think is really important and not as good as it could be--the client

Re: Review Request 23442: Patch for KAFKA-1330

2014-07-18 Thread Jun Rao
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/23442/#review48139 --- Ran unit tests twice. Saw the following failure twice.

Re: Review Request 23593: Fix KAFKA-1533: Address Jun's comments

2014-07-18 Thread Jun Rao
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/23593/#review48162 --- Neha also had a comment in the previous RB.

[jira] [Commented] (KAFKA-1414) Speedup broker startup after hard reset

2014-07-18 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14067014#comment-14067014 ] Jun Rao commented on KAFKA-1414: I can't think of better names. So that sounds good.

Review Request 23697: Fix KAFKA-1533: Address Jun and Neha's comments

2014-07-18 Thread Guozhang Wang
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/23697/ --- Review request for kafka. Bugs: KAFKA-1533

[jira] [Updated] (KAFKA-1533) transient unit test failure in ProducerFailureHandlingTest

2014-07-18 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-1533: - Attachment: KAFKA-1533.patch transient unit test failure in ProducerFailureHandlingTest

[jira] [Commented] (KAFKA-1533) transient unit test failure in ProducerFailureHandlingTest

2014-07-18 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14067028#comment-14067028 ] Guozhang Wang commented on KAFKA-1533: -- Created reviewboard

Re: Improving the Kafka client ecosystem

2014-07-18 Thread Jun Rao
Another important part of eco-system could be around the adaptors of getting data from other systems into Kafka and vice versa. So, for the ingestion part, this can include things like getting data from mysql, syslog, apache server log, etc. For the egress part, this can include putting Kafka data

Re: Review Request 23655: Patch for KAFKA-687

2014-07-18 Thread Joel Koshy
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/23655/ --- (Updated July 18, 2014, 10:55 p.m.) Review request for kafka. Summary

[jira] [Commented] (KAFKA-687) Rebalance algorithm should consider partitions from all topics

2014-07-18 Thread Joel Koshy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14067051#comment-14067051 ] Joel Koshy commented on KAFKA-687: -- Updated reviewboard

[jira] [Updated] (KAFKA-687) Rebalance algorithm should consider partitions from all topics

2014-07-18 Thread Joel Koshy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joel Koshy updated KAFKA-687: - Attachment: KAFKA-687_2014-07-18_15:55:15.patch Rebalance algorithm should consider partitions from all

Re: Review Request 23655: Patch for KAFKA-687

2014-07-18 Thread Joel Koshy
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/23655/ --- (Updated July 18, 2014, 10:57 p.m.) Review request for kafka. Bugs:

Re: Improving the Kafka client ecosystem

2014-07-18 Thread Jay Kreps
Basically my thought with getting a separate mailing list was to have a place specifically to discuss issues around clients. I don't see a lot of discussion about them on the main list. I thought perhaps this was because people don't like to ask questions which are about adjacent projects/code

[jira] [Commented] (KAFKA-1414) Speedup broker startup after hard reset

2014-07-18 Thread Anton Karamanov (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14067065#comment-14067065 ] Anton Karamanov commented on KAFKA-1414: But that would actually require changing

[jira] [Commented] (KAFKA-328) Write unit test for kafka server startup and shutdown API

2014-07-18 Thread BalajiSeshadri (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14067071#comment-14067071 ] BalajiSeshadri commented on KAFKA-328: -- Is this the kind of test you are expecting.

[jira] [Commented] (KAFKA-1535) return all live brokers in TopicMetadataResponse

2014-07-18 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14067074#comment-14067074 ] Jay Kreps commented on KAFKA-1535: -- [~nmarasoi] Totally up to you. return all live

Review Request 23699: Fix KAFKA-1430

2014-07-18 Thread Guozhang Wang
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/23699/ --- Review request for kafka. Bugs: KAFKA-1430

[jira] [Updated] (KAFKA-1430) Purgatory redesign

2014-07-18 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-1430: - Attachment: KAFKA-1430.patch Purgatory redesign -- Key:

[jira] [Commented] (KAFKA-1430) Purgatory redesign

2014-07-18 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14067182#comment-14067182 ] Guozhang Wang commented on KAFKA-1430: -- Created reviewboard

Review Request 23702: Patch for KAFKA-1070

2014-07-18 Thread Sriharsha Chintalapani
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/23702/ --- Review request for kafka. Bugs: KAFKA-1070

[jira] [Commented] (KAFKA-1070) Auto-assign node id

2014-07-18 Thread Sriharsha Chintalapani (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14067273#comment-14067273 ] Sriharsha Chintalapani commented on KAFKA-1070: --- Created reviewboard

[jira] [Commented] (KAFKA-1070) Auto-assign node id

2014-07-18 Thread Sriharsha Chintalapani (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14067274#comment-14067274 ] Sriharsha Chintalapani commented on KAFKA-1070: --- Thanks [~jkreps]

[jira] [Updated] (KAFKA-1070) Auto-assign node id

2014-07-18 Thread Sriharsha Chintalapani (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sriharsha Chintalapani updated KAFKA-1070: -- Attachment: KAFKA-1070.patch Auto-assign node id ---

[jira] [Commented] (KAFKA-1414) Speedup broker startup after hard reset

2014-07-18 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14067380#comment-14067380 ] Jun Rao commented on KAFKA-1414: Oh, I was thinking about the local var referenced in