[jira] [Commented] (SOLR-5872) Eliminate overseer queue

2017-07-28 Thread Noble Paul (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-5872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16106028#comment-16106028 ] Noble Paul commented on SOLR-5872: -- bq.Is it really true that every Solr node subscribes/watches to ZK

[jira] [Commented] (SOLR-5872) Eliminate overseer queue

2017-07-28 Thread David Smiley (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-5872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16106025#comment-16106025 ] David Smiley commented on SOLR-5872: Is it really true that every Solr node subscribes/watches to ZK

[jira] [Commented] (SOLR-5872) Eliminate overseer queue

2017-03-15 Thread Noble Paul (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-5872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15927335#comment-15927335 ] Noble Paul commented on SOLR-5872: -- bq. When you suggest partitioning the queue, do you mean multiple ZK

[jira] [Commented] (SOLR-5872) Eliminate overseer queue

2017-03-15 Thread Joshua Humphries (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-5872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15927301#comment-15927301 ] Joshua Humphries commented on SOLR-5872: Right, but when a node comes up and changes replica states

[jira] [Commented] (SOLR-5872) Eliminate overseer queue

2017-03-15 Thread Noble Paul (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-5872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15927274#comment-15927274 ] Noble Paul commented on SOLR-5872: -- We actually try to batch the writes at overseer today if multiple

[jira] [Commented] (SOLR-5872) Eliminate overseer queue

2017-03-15 Thread Joshua Humphries (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-5872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15926351#comment-15926351 ] Joshua Humphries commented on SOLR-5872: I identified one issue with slowness in processing the

[jira] [Commented] (SOLR-5872) Eliminate overseer queue

2017-03-10 Thread albert vico oton (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-5872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15905254#comment-15905254 ] albert vico oton commented on SOLR-5872: Yea exactly, sorry if my comment was confusing but the

[jira] [Commented] (SOLR-5872) Eliminate overseer queue

2017-03-10 Thread Shawn Heisey (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-5872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15905224#comment-15905224 ] Shawn Heisey commented on SOLR-5872: I don't know how this issue escaped my attention, especially since

[jira] [Commented] (SOLR-5872) Eliminate overseer queue

2017-03-09 Thread albert vico oton (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-5872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15903961#comment-15903961 ] albert vico oton commented on SOLR-5872: thanks for the advice, I'll take a look but the problem we

[jira] [Commented] (SOLR-5872) Eliminate overseer queue

2017-03-09 Thread Shawn Heisey (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-5872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15903557#comment-15903557 ] Shawn Heisey commented on SOLR-5872: bq. We were doing our tests with solr 6.4.1 That version has

[jira] [Commented] (SOLR-5872) Eliminate overseer queue

2017-03-09 Thread albert vico oton (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-5872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15903394#comment-15903394 ] albert vico oton commented on SOLR-5872: Already did that, but nodes still notify its state change,

[jira] [Commented] (SOLR-5872) Eliminate overseer queue

2017-03-09 Thread Erick Erickson (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-5872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15903303#comment-15903303 ] Erick Erickson commented on SOLR-5872: -- bq: "Also, I do not see why collection A should be aware of

[jira] [Commented] (SOLR-5872) Eliminate overseer queue

2017-03-09 Thread albert vico oton (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-5872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15902928#comment-15902928 ] albert vico oton commented on SOLR-5872: We were doing our tests with solr 6.4.1 > Eliminate

[jira] [Commented] (SOLR-5872) Eliminate overseer queue

2017-03-07 Thread Mark Miller (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-5872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15900838#comment-15900838 ] Mark Miller commented on SOLR-5872: --- bq. Hello, we are currently trying to do a deploy of around 200

[jira] [Commented] (SOLR-5872) Eliminate overseer queue

2017-03-07 Thread Noble Paul (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-5872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15900731#comment-15900731 ] Noble Paul commented on SOLR-5872: -- it's time to split the "state" from "state.json" into a separate file.

[jira] [Commented] (SOLR-5872) Eliminate overseer queue

2017-03-01 Thread albert vico oton (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-5872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15890021#comment-15890021 ] albert vico oton commented on SOLR-5872: Hello, we are currently trying to do a deploy of around

[jira] [Commented] (SOLR-5872) Eliminate overseer queue

2015-08-17 Thread Shalin Shekhar Mangar (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-5872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14699051#comment-14699051 ] Shalin Shekhar Mangar commented on SOLR-5872: - bq. I see the lack of batching

[jira] [Commented] (SOLR-5872) Eliminate overseer queue

2015-08-17 Thread Scott Blum (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-5872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14700144#comment-14700144 ] Scott Blum commented on SOLR-5872: -- At the risk of creating two code paths, here's an

[jira] [Commented] (SOLR-5872) Eliminate overseer queue

2015-08-17 Thread Ramkumar Aiyengar (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-5872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14700181#comment-14700181 ] Ramkumar Aiyengar commented on SOLR-5872: - (1) sounds like a good idea.. On (2),

[jira] [Commented] (SOLR-5872) Eliminate overseer queue

2015-08-17 Thread Scott Blum (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-5872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14700191#comment-14700191 ] Scott Blum commented on SOLR-5872: -- Agreed. The idea behind #2 is to serve two very

[jira] [Commented] (SOLR-5872) Eliminate overseer queue

2015-08-15 Thread Noble Paul (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-5872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14698494#comment-14698494 ] Noble Paul commented on SOLR-5872: -- as [~andyetitmoves] said, batching offers serious

[jira] [Commented] (SOLR-5872) Eliminate overseer queue

2015-08-15 Thread Ramkumar Aiyengar (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-5872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14698435#comment-14698435 ] Ramkumar Aiyengar commented on SOLR-5872: - Though I haven't done serious

[jira] [Commented] (SOLR-5872) Eliminate overseer queue

2015-08-05 Thread Scott Blum (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-5872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14658807#comment-14658807 ] Scott Blum commented on SOLR-5872: -- Now that SOLR-5756 is close to landed, I want to take

[jira] [Commented] (SOLR-5872) Eliminate overseer queue

2014-03-19 Thread Mark Miller (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-5872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13940787#comment-13940787 ] Mark Miller commented on SOLR-5872: --- bq. Is that dead in the water now? No. It's got

[jira] [Commented] (SOLR-5872) Eliminate overseer queue

2014-03-18 Thread Shalin Shekhar Mangar (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-5872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13938943#comment-13938943 ] Shalin Shekhar Mangar commented on SOLR-5872: - {quote} bq. as we move the

[jira] [Commented] (SOLR-5872) Eliminate overseer queue

2014-03-18 Thread Mark Miller (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-5872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13939413#comment-13939413 ] Mark Miller commented on SOLR-5872: --- bq. is to move the replica states out into their

[jira] [Commented] (SOLR-5872) Eliminate overseer queue

2014-03-18 Thread Noble Paul (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-5872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13939422#comment-13939422 ] Noble Paul commented on SOLR-5872: -- bq.That is also how I first implemented the

[jira] [Commented] (SOLR-5872) Eliminate overseer queue

2014-03-18 Thread Ramkumar Aiyengar (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-5872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13939824#comment-13939824 ] Ramkumar Aiyengar commented on SOLR-5872: - Wasn't one of the ideas considered in

[jira] [Commented] (SOLR-5872) Eliminate overseer queue

2014-03-17 Thread Yonik Seeley (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-5872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13937842#comment-13937842 ] Yonik Seeley commented on SOLR-5872: bq. as we move the individual collection states

[jira] [Commented] (SOLR-5872) Eliminate overseer queue

2014-03-17 Thread Mark Miller (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-5872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13937901#comment-13937901 ] Mark Miller commented on SOLR-5872: --- I'm not fully sold on this yet. Compare and set is

[jira] [Commented] (SOLR-5872) Eliminate overseer queue

2014-03-17 Thread Jessica Cheng (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-5872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13938075#comment-13938075 ] Jessica Cheng commented on SOLR-5872: - Seems like everyone is worried about batching. I

[jira] [Commented] (SOLR-5872) Eliminate overseer queue

2014-03-17 Thread Mark Miller (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-5872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13938116#comment-13938116 ] Mark Miller commented on SOLR-5872: --- Thanks Jessica - your comment is more along the

[jira] [Commented] (SOLR-5872) Eliminate overseer queue

2014-03-17 Thread Noble Paul (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-5872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13938185#comment-13938185 ] Noble Paul commented on SOLR-5872: -- People suggest new changes to the system when /where

[jira] [Commented] (SOLR-5872) Eliminate overseer queue

2014-03-17 Thread Mark Miller (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-5872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13938498#comment-13938498 ] Mark Miller commented on SOLR-5872: --- {noformat} People suggest new changes to the system

[jira] [Commented] (SOLR-5872) Eliminate overseer queue

2014-03-17 Thread Mark Miller (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-5872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13938539#comment-13938539 ] Mark Miller commented on SOLR-5872: --- bq. With the overseer queues, each state update is

[jira] [Commented] (SOLR-5872) Eliminate overseer queue

2014-03-17 Thread Jessica Cheng (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-5872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13938670#comment-13938670 ] Jessica Cheng commented on SOLR-5872: - quoteFor further discussion around the change,

[jira] [Commented] (SOLR-5872) Eliminate overseer queue

2014-03-17 Thread Mark Miller (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-5872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13938687#comment-13938687 ] Mark Miller commented on SOLR-5872: --- {noformat} Some things that are in the clusterstate

[jira] [Commented] (SOLR-5872) Eliminate overseer queue

2014-03-17 Thread Noble Paul (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-5872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13938710#comment-13938710 ] Noble Paul commented on SOLR-5872: -- bq.There is a strong argument to be made that we

[jira] [Commented] (SOLR-5872) Eliminate overseer queue

2014-03-17 Thread Noble Paul (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-5872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13938717#comment-13938717 ] Noble Paul commented on SOLR-5872: -- bq.I'm not really fully up on external collections but

[jira] [Commented] (SOLR-5872) Eliminate overseer queue

2014-03-17 Thread Mark Miller (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-5872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13938751#comment-13938751 ] Mark Miller commented on SOLR-5872: --- If it's the issue about breaking up

[jira] [Commented] (SOLR-5872) Eliminate overseer queue

2014-03-17 Thread Noble Paul (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-5872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13938755#comment-13938755 ] Noble Paul commented on SOLR-5872: -- The external collection is just a name. It really does

[jira] [Commented] (SOLR-5872) Eliminate overseer queue

2014-03-17 Thread Mark Miller (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-5872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13938775#comment-13938775 ] Mark Miller commented on SOLR-5872: --- It's obviously just a name :) I didn't know that it

[jira] [Commented] (SOLR-5872) Eliminate overseer queue

2014-03-17 Thread Noble Paul (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-5872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13938796#comment-13938796 ] Noble Paul commented on SOLR-5872: -- bq. I think if we decide to split out the