[jira] [Commented] (KAFKA-1555) provide strong consistency with reasonable availability

2014-11-13 Thread saurabh agarwal (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14209866#comment-14209866 ] saurabh agarwal commented on KAFKA-1555: Thanks Gwen for implementation of this

[jira] [Commented] (KAFKA-1555) provide strong consistency with reasonable availability

2014-11-12 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14209151#comment-14209151 ] Jun Rao commented on KAFKA-1555: Thanks for the doc patch. Committed to svn after fixing a

[jira] [Commented] (KAFKA-1555) provide strong consistency with reasonable availability

2014-11-03 Thread Joel Koshy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14195029#comment-14195029 ] Joel Koshy commented on KAFKA-1555: --- Sounds good. In that case, can you modify it a bit?

[jira] [Commented] (KAFKA-1555) provide strong consistency with reasonable availability

2014-10-31 Thread Joel Koshy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14192223#comment-14192223 ] Joel Koshy commented on KAFKA-1555: --- Given the current implementation, I think the

[jira] [Commented] (KAFKA-1555) provide strong consistency with reasonable availability

2014-10-30 Thread Joel Koshy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14191196#comment-14191196 ] Joel Koshy commented on KAFKA-1555: --- Sorry for the late feedback. configuration.html: -

[jira] [Commented] (KAFKA-1555) provide strong consistency with reasonable availability

2014-10-30 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14191202#comment-14191202 ] Gwen Shapira commented on KAFKA-1555: - it is independent of the producer's ack config

[jira] [Commented] (KAFKA-1555) provide strong consistency with reasonable availability

2014-10-30 Thread Joel Koshy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14191239#comment-14191239 ] Joel Koshy commented on KAFKA-1555: --- Yeah what I wrote earlier was incorrect - sorry. It

[jira] [Commented] (KAFKA-1555) provide strong consistency with reasonable availability

2014-10-30 Thread Joel Koshy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14191241#comment-14191241 ] Joel Koshy commented on KAFKA-1555: --- ack never mind.. I see what you mean.

[jira] [Commented] (KAFKA-1555) provide strong consistency with reasonable availability

2014-10-25 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14184383#comment-14184383 ] Gwen Shapira commented on KAFKA-1555: - [~kbanker] Regarding the 3-4 typical scenarios:

[jira] [Commented] (KAFKA-1555) provide strong consistency with reasonable availability

2014-10-24 Thread Joel Koshy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14183086#comment-14183086 ] Joel Koshy commented on KAFKA-1555: --- Jun, you can just diff configuration.html,

[jira] [Commented] (KAFKA-1555) provide strong consistency with reasonable availability

2014-10-24 Thread Joel Koshy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14183304#comment-14183304 ] Joel Koshy commented on KAFKA-1555: --- Looks good - I just have a few minor edits to what

[jira] [Commented] (KAFKA-1555) provide strong consistency with reasonable availability

2014-10-24 Thread Kyle Banker (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14183382#comment-14183382 ] Kyle Banker commented on KAFKA-1555: The new durability docs looks great so far. Here

[jira] [Commented] (KAFKA-1555) provide strong consistency with reasonable availability

2014-10-24 Thread Kyle Banker (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14183393#comment-14183393 ] Kyle Banker commented on KAFKA-1555: I like the section on Availability and Durability

[jira] [Commented] (KAFKA-1555) provide strong consistency with reasonable availability

2014-10-24 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14183411#comment-14183411 ] Gwen Shapira commented on KAFKA-1555: - [~jjkoshy]: * I did not make the suggested

[jira] [Commented] (KAFKA-1555) provide strong consistency with reasonable availability

2014-10-13 Thread Sriram Subramanian (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14168996#comment-14168996 ] Sriram Subramanian commented on KAFKA-1555: --- [~gwenshap] +1 on your suggestion.

[jira] [Commented] (KAFKA-1555) provide strong consistency with reasonable availability

2014-10-13 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14169987#comment-14169987 ] Guozhang Wang commented on KAFKA-1555: -- One question I have while trying to rebase

[jira] [Commented] (KAFKA-1555) provide strong consistency with reasonable availability

2014-10-13 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14170002#comment-14170002 ] Guozhang Wang commented on KAFKA-1555: -- Another thought about the min.isr config: we

[jira] [Commented] (KAFKA-1555) provide strong consistency with reasonable availability

2014-10-13 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14170095#comment-14170095 ] Jun Rao commented on KAFKA-1555: When a client receives a

[jira] [Commented] (KAFKA-1555) provide strong consistency with reasonable availability

2014-10-13 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14170256#comment-14170256 ] Jun Rao commented on KAFKA-1555: Committed to 0.8.2 too. provide strong consistency with

[jira] [Commented] (KAFKA-1555) provide strong consistency with reasonable availability

2014-10-13 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14170272#comment-14170272 ] Guozhang Wang commented on KAFKA-1555: -- Created KAFKA-1704 for partition configs.

[jira] [Commented] (KAFKA-1555) provide strong consistency with reasonable availability

2014-10-12 Thread Neha Narkhede (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14168692#comment-14168692 ] Neha Narkhede commented on KAFKA-1555: -- bq. My vote would be to update our

[jira] [Commented] (KAFKA-1555) provide strong consistency with reasonable availability

2014-10-12 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14168930#comment-14168930 ] Gwen Shapira commented on KAFKA-1555: - Awesome. So I'm updating here:

[jira] [Commented] (KAFKA-1555) provide strong consistency with reasonable availability

2014-10-10 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14167057#comment-14167057 ] Jay Kreps commented on KAFKA-1555: -- w00t! provide strong consistency with reasonable

[jira] [Commented] (KAFKA-1555) provide strong consistency with reasonable availability

2014-10-10 Thread Sriram Subramanian (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14167113#comment-14167113 ] Sriram Subramanian commented on KAFKA-1555: --- Awesome. I suggest we document the

[jira] [Commented] (KAFKA-1555) provide strong consistency with reasonable availability

2014-10-10 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14167261#comment-14167261 ] Gwen Shapira commented on KAFKA-1555: - will be happy to do that. Is the wiki the right

[jira] [Commented] (KAFKA-1555) provide strong consistency with reasonable availability

2014-10-10 Thread Sriram Subramanian (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14167464#comment-14167464 ] Sriram Subramanian commented on KAFKA-1555: --- My vote would be to update our

[jira] [Commented] (KAFKA-1555) provide strong consistency with reasonable availability

2014-10-09 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14166147#comment-14166147 ] Jun Rao commented on KAFKA-1555: Also created a followup jira (KAFKA-1697) to remove the

[jira] [Commented] (KAFKA-1555) provide strong consistency with reasonable availability

2014-10-07 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14162833#comment-14162833 ] Jun Rao commented on KAFKA-1555: The patch that Gwen provided (using a min.isr topic level

[jira] [Commented] (KAFKA-1555) provide strong consistency with reasonable availability

2014-10-07 Thread Joel Koshy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14162942#comment-14162942 ] Joel Koshy commented on KAFKA-1555: --- +1 (took a quick look at it) We could improve the

[jira] [Commented] (KAFKA-1555) provide strong consistency with reasonable availability

2014-09-25 Thread Sriram Subramanian (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14147474#comment-14147474 ] Sriram Subramanian commented on KAFKA-1555: --- 1. Great. Not supporting all values

[jira] [Commented] (KAFKA-1555) provide strong consistency with reasonable availability

2014-09-25 Thread saurabh agarwal (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14147900#comment-14147900 ] saurabh agarwal commented on KAFKA-1555: Along with min.isr setting, the unclean

[jira] [Commented] (KAFKA-1555) provide strong consistency with reasonable availability

2014-09-25 Thread Joel Koshy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14147943#comment-14147943 ] Joel Koshy commented on KAFKA-1555: --- I'm +1 on the concept of min.isr and acks -1, 0, 1.

[jira] [Commented] (KAFKA-1555) provide strong consistency with reasonable availability

2014-09-25 Thread Sriram Subramanian (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14147967#comment-14147967 ] Sriram Subramanian commented on KAFKA-1555: --- ack = -1 with clean leader election

[jira] [Commented] (KAFKA-1555) provide strong consistency with reasonable availability

2014-09-25 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14148371#comment-14148371 ] Jay Kreps commented on KAFKA-1555: -- This is a good discussion, I am glad we are taking

Re: [jira] [Commented] (KAFKA-1555) provide strong consistency with reasonable availability

2014-09-25 Thread Robert Withers
Jay, thank you for the excellence. Regarding your point 6, I would just like to mention that with a partial function style interface facet for event listener registrations on top of FarRefs and RemotePromiseRefs, in ERights style distributed promises, it is easy to think about multiple

[jira] [Commented] (KAFKA-1555) provide strong consistency with reasonable availability

2014-09-25 Thread Sriram Subramanian (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14148407#comment-14148407 ] Sriram Subramanian commented on KAFKA-1555: --- Thank you for summarizing all the

[jira] [Commented] (KAFKA-1555) provide strong consistency with reasonable availability

2014-09-25 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14148450#comment-14148450 ] Gwen Shapira commented on KAFKA-1555: - Call me a control freak, but don't lose data is

[jira] [Commented] (KAFKA-1555) provide strong consistency with reasonable availability

2014-09-25 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14148483#comment-14148483 ] Jay Kreps commented on KAFKA-1555: -- 1. Yeah this may have been a mistake. I think

[jira] [Commented] (KAFKA-1555) provide strong consistency with reasonable availability

2014-09-25 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14148510#comment-14148510 ] Jun Rao commented on KAFKA-1555: a. I agree that unclean leader election is an orthogonal

[jira] [Commented] (KAFKA-1555) provide strong consistency with reasonable availability

2014-09-25 Thread Sriram Subramanian (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14148520#comment-14148520 ] Sriram Subramanian commented on KAFKA-1555: --- 2. I agree. I think what min_isr

[jira] [Commented] (KAFKA-1555) provide strong consistency with reasonable availability

2014-09-25 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14148542#comment-14148542 ] Jun Rao commented on KAFKA-1555: 4b or 4d has the same issue that the value of min.isr or

[jira] [Commented] (KAFKA-1555) provide strong consistency with reasonable availability

2014-09-25 Thread Neha Narkhede (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14148557#comment-14148557 ] Neha Narkhede commented on KAFKA-1555: -- Followed the discussion and want to share

[jira] [Commented] (KAFKA-1555) provide strong consistency with reasonable availability

2014-09-25 Thread Joel Koshy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14148795#comment-14148795 ] Joel Koshy commented on KAFKA-1555: --- This is an implementation detail but wrt the

[jira] [Commented] (KAFKA-1555) provide strong consistency with reasonable availability

2014-09-24 Thread saurabh agarwal (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14146173#comment-14146173 ] saurabh agarwal commented on KAFKA-1555: min.isr feature is critical for us. In

[jira] [Commented] (KAFKA-1555) provide strong consistency with reasonable availability

2014-09-24 Thread Sriram Subramanian (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14146751#comment-14146751 ] Sriram Subramanian commented on KAFKA-1555: --- Jun, I am not arguing that we

[jira] [Commented] (KAFKA-1555) provide strong consistency with reasonable availability

2014-09-24 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14147352#comment-14147352 ] Jun Rao commented on KAFKA-1555: Sriram, With this patch, I am thinking that the ack mode

[jira] [Commented] (KAFKA-1555) provide strong consistency with reasonable availability

2014-09-24 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14147353#comment-14147353 ] Joe Stein commented on KAFKA-1555: -- drop the support of ack 1 +1 provide strong

[jira] [Commented] (KAFKA-1555) provide strong consistency with reasonable availability

2014-09-24 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14147394#comment-14147394 ] Gwen Shapira commented on KAFKA-1555: - +1 for dropping ack 1 The whole Jira started

[jira] [Commented] (KAFKA-1555) provide strong consistency with reasonable availability

2014-09-24 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14147395#comment-14147395 ] Gwen Shapira commented on KAFKA-1555: - Also, attached a version of the patch with few

[jira] [Commented] (KAFKA-1555) provide strong consistency with reasonable availability

2014-09-23 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14144999#comment-14144999 ] Gwen Shapira commented on KAFKA-1555: - [~joestein] can you share your producer

[jira] [Commented] (KAFKA-1555) provide strong consistency with reasonable availability

2014-09-23 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14145096#comment-14145096 ] Joe Stein commented on KAFKA-1555: -- [~gwenshap] yup, in that case the issue was between

[jira] [Commented] (KAFKA-1555) provide strong consistency with reasonable availability

2014-09-23 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14145894#comment-14145894 ] Jun Rao commented on KAFKA-1555: Sriram, In my mind, min.isr can be 1 to n-1 where n is

[jira] [Commented] (KAFKA-1555) provide strong consistency with reasonable availability

2014-09-22 Thread Sriram Subramanian (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14142967#comment-14142967 ] Sriram Subramanian commented on KAFKA-1555: --- Sorry to be late here but I think

[jira] [Commented] (KAFKA-1555) provide strong consistency with reasonable availability

2014-09-22 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14143352#comment-14143352 ] Gwen Shapira commented on KAFKA-1555: - Hi Sriram, Thank you for raising these

[jira] [Commented] (KAFKA-1555) provide strong consistency with reasonable availability

2014-09-22 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14143486#comment-14143486 ] Joe Stein commented on KAFKA-1555: -- [~gwenshap] thanks for the patch! few initial

[jira] [Commented] (KAFKA-1555) provide strong consistency with reasonable availability

2014-09-22 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14143501#comment-14143501 ] Gwen Shapira commented on KAFKA-1555: - There is a review board

[jira] [Commented] (KAFKA-1555) provide strong consistency with reasonable availability

2014-09-22 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14143521#comment-14143521 ] Joe Stein commented on KAFKA-1555: -- ah, my bad. Any suggestions regarding the problem

[jira] [Commented] (KAFKA-1555) provide strong consistency with reasonable availability

2014-09-22 Thread Sriram Subramanian (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14143578#comment-14143578 ] Sriram Subramanian commented on KAFKA-1555: --- [~gwenshap] A key thing I would

[jira] [Commented] (KAFKA-1555) provide strong consistency with reasonable availability

2014-09-22 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14143622#comment-14143622 ] Joe Stein commented on KAFKA-1555: -- I agree with [~gwenshap] A business case for this

[jira] [Commented] (KAFKA-1555) provide strong consistency with reasonable availability

2014-09-22 Thread Sriram Subramanian (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14143628#comment-14143628 ] Sriram Subramanian commented on KAFKA-1555: --- Surviving the leader crash makes

[jira] [Commented] (KAFKA-1555) provide strong consistency with reasonable availability

2014-09-22 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14143701#comment-14143701 ] Joe Stein commented on KAFKA-1555: -- I am more interested in being able to specify why 2

[jira] [Commented] (KAFKA-1555) provide strong consistency with reasonable availability

2014-09-22 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14144101#comment-14144101 ] Gwen Shapira commented on KAFKA-1555: - Uploaded an updated patch addressing

[jira] [Commented] (KAFKA-1555) provide strong consistency with reasonable availability

2014-09-22 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14144378#comment-14144378 ] Joe Stein commented on KAFKA-1555: -- [~gwenshap] patch applied, tests passed however; I

[jira] [Commented] (KAFKA-1555) provide strong consistency with reasonable availability

2014-09-05 Thread saurabh agarwal (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14122771#comment-14122771 ] saurabh agarwal commented on KAFKA-1555: Jun, Yes. This approach works fine for

[jira] [Commented] (KAFKA-1555) provide strong consistency with reasonable availability

2014-09-03 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14120810#comment-14120810 ] Joe Stein commented on KAFKA-1555: -- Where have we ended up with this? Do we have an

[jira] [Commented] (KAFKA-1555) provide strong consistency with reasonable availability

2014-09-03 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14120815#comment-14120815 ] Gwen Shapira commented on KAFKA-1555: - If there's a consensus (or even a lazy

[jira] [Commented] (KAFKA-1555) provide strong consistency with reasonable availability

2014-09-03 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14120820#comment-14120820 ] Joe Stein commented on KAFKA-1555: -- +1 around the min.isr approach I would be happy to

[jira] [Commented] (KAFKA-1555) provide strong consistency with reasonable availability

2014-09-03 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14120944#comment-14120944 ] Jun Rao commented on KAFKA-1555: Gwen, Thanks for helping out. I think we can take the

[jira] [Commented] (KAFKA-1555) provide strong consistency with reasonable availability

2014-08-27 Thread saurabh agarwal (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14112208#comment-14112208 ] saurabh agarwal commented on KAFKA-1555: Sorry for following up late. Busy in

[jira] [Commented] (KAFKA-1555) provide strong consistency with reasonable availability

2014-08-27 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14112529#comment-14112529 ] Gwen Shapira commented on KAFKA-1555: - I agree that min.isr only makes sense with

[jira] [Commented] (KAFKA-1555) provide strong consistency with reasonable availability

2014-08-09 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14091787#comment-14091787 ] Jun Rao commented on KAFKA-1555: Another thought is that even with the min.isr topic level

[jira] [Commented] (KAFKA-1555) provide strong consistency with reasonable availability

2014-08-06 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14087795#comment-14087795 ] Gwen Shapira commented on KAFKA-1555: - We are talking about topic level, and I

[jira] [Commented] (KAFKA-1555) provide strong consistency with reasonable availability

2014-08-05 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14086750#comment-14086750 ] Gwen Shapira commented on KAFKA-1555: - Did we agree on implementing min.isr.size as

[jira] [Commented] (KAFKA-1555) provide strong consistency with reasonable availability

2014-08-05 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14086984#comment-14086984 ] Jay Kreps commented on KAFKA-1555: -- Hey [~gwenshap], to answer your question, the

[jira] [Commented] (KAFKA-1555) provide strong consistency with reasonable availability

2014-08-05 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14087243#comment-14087243 ] Jun Rao commented on KAFKA-1555: Since we can't always guarantee a message doesn't get

[jira] [Commented] (KAFKA-1555) provide strong consistency with reasonable availability

2014-08-05 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14087278#comment-14087278 ] Joe Stein commented on KAFKA-1555: -- So when we say property, are we saying a property in

[jira] [Commented] (KAFKA-1555) provide strong consistency with reasonable availability

2014-08-03 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14084033#comment-14084033 ] Gwen Shapira commented on KAFKA-1555: - If we go with the idea that ack=2 means at

[jira] [Commented] (KAFKA-1555) provide strong consistency with reasonable availability

2014-08-03 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14084265#comment-14084265 ] Jun Rao commented on KAFKA-1555: Gwen, I like what you suggested. We can introduce a new

[jira] [Commented] (KAFKA-1555) provide strong consistency with reasonable availability

2014-08-03 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14084280#comment-14084280 ] Gwen Shapira commented on KAFKA-1555: - Perfect. The producer can catch the error and

[jira] [Commented] (KAFKA-1555) provide strong consistency with reasonable availability

2014-08-01 Thread saurabh agarwal (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14082684#comment-14082684 ] saurabh agarwal commented on KAFKA-1555: Guozhang, The new semantic (ack = -2)

[jira] [Commented] (KAFKA-1555) provide strong consistency with reasonable availability

2014-08-01 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14083075#comment-14083075 ] Jay Kreps commented on KAFKA-1555: -- I think we may be confusing a few things: 1. The

[jira] [Commented] (KAFKA-1555) provide strong consistency with reasonable availability

2014-08-01 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14083141#comment-14083141 ] Guozhang Wang commented on KAFKA-1555: -- Agreed, ack=...,-2,-1,0,1,2,... with the

[jira] [Commented] (KAFKA-1555) provide strong consistency with reasonable availability

2014-07-31 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14080956#comment-14080956 ] Jun Rao commented on KAFKA-1555: Adding the check for ack=-2 shouldn't be too hard. We

[jira] [Commented] (KAFKA-1555) provide strong consistency with reasonable availability

2014-07-31 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14080970#comment-14080970 ] Gwen Shapira commented on KAFKA-1555: - I think the a property min.isr.required is

[jira] [Commented] (KAFKA-1555) provide strong consistency with reasonable availability

2014-07-31 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14081094#comment-14081094 ] Guozhang Wang commented on KAFKA-1555: -- Jiang, Saurabh, If your concern with ack=-1

[jira] [Commented] (KAFKA-1555) provide strong consistency with reasonable availability

2014-07-30 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14079373#comment-14079373 ] Jun Rao commented on KAFKA-1555: Instead of introducing a new property min.isr.required, I

[jira] [Commented] (KAFKA-1555) provide strong consistency with reasonable availability

2014-07-30 Thread saurabh agarwal (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14079494#comment-14079494 ] saurabh agarwal commented on KAFKA-1555: Excellent. Thanks. It works for us. We

[jira] [Commented] (KAFKA-1555) provide strong consistency with reasonable availability

2014-07-30 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14080210#comment-14080210 ] Joe Stein commented on KAFKA-1555: -- +1 to introduce a new semantic when ack = -2. The

[jira] [Commented] (KAFKA-1555) provide strong consistency with reasonable availability

2014-07-28 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14076286#comment-14076286 ] Jun Rao commented on KAFKA-1555: Hmm, I have to understand the semantics and the

[jira] [Commented] (KAFKA-1555) provide strong consistency with reasonable availability

2014-07-28 Thread saurabh agarwal (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14076758#comment-14076758 ] saurabh agarwal commented on KAFKA-1555: this seems more like the ack 1 case in

[jira] [Commented] (KAFKA-1555) provide strong consistency with reasonable availability

2014-07-27 Thread saurabh agarwal (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14075875#comment-14075875 ] saurabh agarwal commented on KAFKA-1555: There are two configuration parameters-

[jira] [Commented] (KAFKA-1555) provide strong consistency with reasonable availability

2014-07-25 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14074122#comment-14074122 ] Joe Stein commented on KAFKA-1555: -- The simplification and guarantee provided with ack=-1

[jira] [Commented] (KAFKA-1555) provide strong consistency with reasonable availability

2014-07-25 Thread Jiang Wu (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14074343#comment-14074343 ] Jiang Wu commented on KAFKA-1555: - Jun, We may need to tolerate more than R-1 failures

[jira] [Commented] (KAFKA-1555) provide strong consistency with reasonable availability

2014-07-25 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14074460#comment-14074460 ] Jun Rao commented on KAFKA-1555: Jiang, If you use controlled shutdown, we will make sure

[jira] [Commented] (KAFKA-1555) provide strong consistency with reasonable availability

2014-07-25 Thread Jiang Wu (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14074522#comment-14074522 ] Jiang Wu commented on KAFKA-1555: - Jun, In your example, what are tthe replication and

[jira] [Commented] (KAFKA-1555) provide strong consistency with reasonable availability

2014-07-25 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14074532#comment-14074532 ] Jun Rao commented on KAFKA-1555: In our current design, a message is considered committed

[jira] [Commented] (KAFKA-1555) provide strong consistency with reasonable availability

2014-07-25 Thread saurabh agarwal (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14075038#comment-14075038 ] saurabh agarwal commented on KAFKA-1555: Jun, I agree that ack=-1 works fine for

[jira] [Commented] (KAFKA-1555) provide strong consistency with reasonable availability

2014-07-25 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14075263#comment-14075263 ] Jun Rao commented on KAFKA-1555: So, you are suggesting to reject a message if current

[jira] [Commented] (KAFKA-1555) provide strong consistency with reasonable availability

2014-07-24 Thread Sudarshan Kadambi (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14073326#comment-14073326 ] Sudarshan Kadambi commented on KAFKA-1555: -- Neha and Jun: I want to make sure we

[jira] [Commented] (KAFKA-1555) provide strong consistency with reasonable availability

2014-07-24 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14074070#comment-14074070 ] Jun Rao commented on KAFKA-1555: Sudarshan, Our replication guarantees are the following.

  1   2   >