[jira] [Commented] (SOLR-5381) Split Clusterstate and scale

2019-08-02 Thread David Smiley (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-5381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16899026#comment-16899026 ] David Smiley commented on SOLR-5381: Shall we mark this closed now? I see this as done, save for one

[jira] [Commented] (SOLR-5381) Split Clusterstate and scale

2013-11-07 Thread Mark Miller (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-5381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13815877#comment-13815877 ] Mark Miller commented on SOLR-5381: --- Noble and I have discussed his proposal above at

[jira] [Commented] (SOLR-5381) Split Clusterstate and scale

2013-10-30 Thread Noble Paul (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-5381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13809096#comment-13809096 ] Noble Paul commented on SOLR-5381: -- OK , here is the plan to split clusterstate on a per

[jira] [Commented] (SOLR-5381) Split Clusterstate and scale

2013-10-30 Thread Yago Riveiro (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-5381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13809184#comment-13809184 ] Yago Riveiro commented on SOLR-5381: {quote} There will be a separate thread for each

[jira] [Commented] (SOLR-5381) Split Clusterstate and scale

2013-10-30 Thread Noble Paul (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-5381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13809357#comment-13809357 ] Noble Paul commented on SOLR-5381: -- bq.Is it not possible have a pool with X threads (X

[jira] [Commented] (SOLR-5381) Split Clusterstate and scale

2013-10-24 Thread Noble Paul (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-5381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13804097#comment-13804097 ] Noble Paul commented on SOLR-5381: -- [~markrmil...@gmail.com] as the man who conceived

[jira] [Commented] (SOLR-5381) Split Clusterstate and scale

2013-10-24 Thread Mark Miller (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-5381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13804212#comment-13804212 ] Mark Miller commented on SOLR-5381: --- bq. Do we have a choice of not scaling to a VERY

[jira] [Commented] (SOLR-5381) Split Clusterstate and scale

2013-10-24 Thread Mark Miller (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-5381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13804221#comment-13804221 ] Mark Miller commented on SOLR-5381: --- P.S. Long term, of course I'd like to scale to

[jira] [Commented] (SOLR-5381) Split Clusterstate and scale

2013-10-24 Thread Yago Riveiro (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-5381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13804240#comment-13804240 ] Yago Riveiro commented on SOLR-5381: SolrCloud environment is young and has some bugs

[jira] [Commented] (SOLR-5381) Split Clusterstate and scale

2013-10-24 Thread Noble Paul (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-5381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13804385#comment-13804385 ] Noble Paul commented on SOLR-5381: -- [~markrmil...@gmail.com] Whatever we are building,

[jira] [Commented] (SOLR-5381) Split Clusterstate and scale

2013-10-24 Thread Jack Krupansky (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-5381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13804392#comment-13804392 ] Jack Krupansky commented on SOLR-5381: -- bq. You are missing the point that it's very

[jira] [Commented] (SOLR-5381) Split Clusterstate and scale

2013-10-24 Thread Noble Paul (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-5381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13804419#comment-13804419 ] Noble Paul commented on SOLR-5381: -- bq.isn't the most common query case going to query

[jira] [Commented] (SOLR-5381) Split Clusterstate and scale

2013-10-23 Thread Mark Miller (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-5381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13803056#comment-13803056 ] Mark Miller commented on SOLR-5381: --- I think this is just one of many issues you will hit

[jira] [Commented] (SOLR-5381) Split Clusterstate and scale

2013-10-23 Thread Mark Miller (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-5381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13803059#comment-13803059 ] Mark Miller commented on SOLR-5381: --- bq. size of clusterstate.json keeps going up and it

[jira] [Commented] (SOLR-5381) Split Clusterstate and scale

2013-10-23 Thread Noble Paul (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-5381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13803068#comment-13803068 ] Noble Paul commented on SOLR-5381: -- [~hakeber] The requirement is to scale to 100,000's of

[jira] [Commented] (SOLR-5381) Split Clusterstate and scale

2013-10-23 Thread Mark Miller (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-5381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13803077#comment-13803077 ] Mark Miller commented on SOLR-5381: --- We have not even nailed 1000 nails fully yet - seems

[jira] [Commented] (SOLR-5381) Split Clusterstate and scale

2013-10-23 Thread Noble Paul (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-5381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13803080#comment-13803080 ] Noble Paul commented on SOLR-5381: -- We need to eliminate the known bottlenecks if we need

[jira] [Commented] (SOLR-5381) Split Clusterstate and scale

2013-10-23 Thread Mark Miller (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-5381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13803109#comment-13803109 ] Mark Miller commented on SOLR-5381: --- bq. ZK documentation says 1mb is the recommended

[jira] [Commented] (SOLR-5381) Split Clusterstate and scale

2013-10-23 Thread Mark Miller (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-5381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13803110#comment-13803110 ] Mark Miller commented on SOLR-5381: --- I do agree that it becomes relevant once you are

[jira] [Commented] (SOLR-5381) Split Clusterstate and scale

2013-10-23 Thread Jack Krupansky (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-5381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13803347#comment-13803347 ] Jack Krupansky commented on SOLR-5381: -- It might be helpful to clarify the intended

[jira] [Commented] (SOLR-5381) Split Clusterstate and scale

2013-10-23 Thread Yago Riveiro (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-5381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13803499#comment-13803499 ] Yago Riveiro commented on SOLR-5381: I hit the ZK limit of 1M for node with more than

[jira] [Commented] (SOLR-5381) Split Clusterstate and scale

2013-10-23 Thread Mark Miller (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-5381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13803504#comment-13803504 ] Mark Miller commented on SOLR-5381: --- bq. If each collection had its own

[jira] [Commented] (SOLR-5381) Split Clusterstate and scale

2013-10-23 Thread Mark Miller (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-5381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13803537#comment-13803537 ] Mark Miller commented on SOLR-5381: --- bq. The first step is to store the shards

[jira] [Commented] (SOLR-5381) Split Clusterstate and scale

2013-10-23 Thread Noble Paul (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-5381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13803670#comment-13803670 ] Noble Paul commented on SOLR-5381: -- bq.We also are not constantly working with large files

[jira] [Commented] (SOLR-5381) Split Clusterstate and scale

2013-10-23 Thread Mark Miller (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-5381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13803672#comment-13803672 ] Mark Miller commented on SOLR-5381: --- bq. In a big enough cluster you can expect a state

[jira] [Commented] (SOLR-5381) Split Clusterstate and scale

2013-10-23 Thread Noble Paul (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-5381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13803674#comment-13803674 ] Noble Paul commented on SOLR-5381: -- [~jkrupan] bq.It might be helpful to clarify the

[jira] [Commented] (SOLR-5381) Split Clusterstate and scale

2013-10-23 Thread Mark Miller (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-5381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13803676#comment-13803676 ] Mark Miller commented on SOLR-5381: --- bq. The only instance when a node needs to know

[jira] [Commented] (SOLR-5381) Split Clusterstate and scale

2013-10-23 Thread Noble Paul (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-5381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13803677#comment-13803677 ] Noble Paul commented on SOLR-5381: -- The other bottleneck is the single work queue at the

[jira] [Commented] (SOLR-5381) Split Clusterstate and scale

2013-10-23 Thread Noble Paul (JIRA)
[ https://issues.apache.org/jira/browse/SOLR-5381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13803686#comment-13803686 ] Noble Paul commented on SOLR-5381: -- bq.t would like to know the state of the other shards