Re: Solr Admin core status - Index is not Current

2014-04-11 Thread Chris W
Any help on this is much appreciated. I cannot find any documentation around this and would be good to understand what this means Thanks On Thu, Apr 10, 2014 at 1:50 PM, Chris W chris1980@gmail.com wrote: Hi there I am using solrcloud (4.3). I am trying to get the status of a core

Re: Solr Admin core status - Index is not Current

2014-04-11 Thread Chris W
Thanks, Shawn. On Fri, Apr 11, 2014 at 11:11 AM, Shawn Heisey s...@elyograg.org wrote: On 4/10/2014 2:50 PM, Chris W wrote: Hi there I am using solrcloud (4.3). I am trying to get the status of a core from solr using (localhost:8000/solr/admin/cores?action=STATUScore=core) and i get

Solr Admin core status - Index is not Current

2014-04-10 Thread Chris W
Hi there I am using solrcloud (4.3). I am trying to get the status of a core from solr using (localhost:8000/solr/admin/cores?action=STATUScore=core) and i get the following output int name=numDocs100/int int name=maxDoc102/int int name=deletedDocs2/int long name=version20527/long int

What is Overseer?

2014-03-31 Thread Chris W
What is the role of an overseer in solrcloud? The documentation does not offer full details about it. What if an overseer node goes down? -- Best -- C

Re: Block until replication finishes

2014-03-28 Thread Chris W
Silva ferm...@olx.com wrote: Hi, that's what I'm trying. I'm however really cautious when it comes to a while (somethingIsTrue) { doSomething; sleep; } Is that safe? What if the slave hungs up, the network is slow/fails, etc? Thanks On Thu, Mar 27, 2014 at 1:40 PM, Chris W chris1980

Re: Block until replication finishes

2014-03-27 Thread Chris W
Hi You can use the details command to check the status of replication. http://localhost:8983/solr/core_name/replication?command=details The command returns an xml output and look out for the isReplicating field in the output. Keep running the command in a loop until the flag becomes false.

Re: Limit on # of collections -SolrCloud

2014-03-22 Thread Chris W
(7) On Fri, Mar 21, 2014 at 1:05 PM, Chris W chris1980@gmail.com wrote: Sorry for the piecemeal approach but had another question. I have a 3 zk ensemble. Does making 2 zk as observer roles help speed up bootup of solr (due to decrease in time it takes to decide leaders for shards

Re: Limit on # of collections -SolrCloud

2014-03-21 Thread Chris W
Thanks Tim. I would definitely try that next time. I have seen a few instances where the overseer_queue not getting processed but that looks like an existing bug which got fixed in 4.6 (overseer doesnt process requests when reload collection fails) One question: Assuming our cluster can tolerate

Re: Limit on # of collections -SolrCloud

2014-03-21 Thread Chris W
Sorry for the piecemeal approach but had another question. I have a 3 zk ensemble. Does making 2 zk as observer roles help speed up bootup of solr (due to decrease in time it takes to decide leaders for shards)? On Fri, Mar 21, 2014 at 11:49 AM, Chris W chris1980@gmail.com wrote: Thanks

Limit on # of collections -SolrCloud

2014-03-20 Thread Chris W
Hi there Is there a limit on the # of collections solrcloud can support? Can zk/solrcloud handle 1000s of collections? Also i see that the bootup time of solrcloud increases with increase in # of cores. I do not have any expensive warm up queries. How do i speedup solr startup? -- Best -- C

Re: Limit on # of collections -SolrCloud

2014-03-20 Thread Chris W
can't do much about 1 right now I think. For #2, you can keep your transaction logs smaller by a hard commit before shutdown. For #3 there is a leaderVoteWait settings but I'd rather not touch that unless it becomes a problem. On Fri, Mar 21, 2014 at 1:39 AM, Chris W chris1980@gmail.com

Re: Limit on # of collections -SolrCloud

2014-03-20 Thread Chris W
a bazillion replicas in aggregate. Hours is surprising. Best, Erick On Thu, Mar 20, 2014 at 2:17 PM, Chris W chris1980@gmail.com wrote: Thanks, Shalin. Making clusterstate.json on a collection basis sounds awesome. I am not having problems with #2 . #3 is a major

Re: Zookeeper exceptions - SEVERE

2014-03-19 Thread Chris W
. I was mistaken. On Wed, Mar 19, 2014 at 10:06 AM, Chris W chris1980@gmail.com wrote: Thanks, Shawn and Shalin How does the frequency of commit affect zookeeper? Thanks On Tue, Mar 18, 2014 at 9:12 PM, Shalin Shekhar Mangar shalinman...@gmail.com wrote: SolrCloud

Zookeeper exceptions - SEVERE

2014-03-18 Thread Chris W
I am running a 3 node zookeeper 3.4.5 Quorum. I am running into issues with Zookeeper transaction logs [myid:2] - ERROR [main:QuorumPeer@453] - Unable to load database on disk java.io.IOException: Unreasonable length = 1048587 at

Re: Zookeeper exceptions - SEVERE

2014-03-18 Thread Chris W
and during collection API commands. It doesn't correlate directly with indexing but is correlated with how frequently you call commit. On Wed, Mar 19, 2014 at 5:46 AM, Shawn Heisey s...@elyograg.org wrote: On 3/18/2014 5:46 PM, Chris W wrote: I am running a 3 node zookeeper 3.4.5 Quorum. I am

Re: Result merging takes too long

2014-03-16 Thread Chris W
Can you share a sample query ? Ensure you have filterquery, fl fields and query result cache settings well tuned To give you an example: A month ago I had an issue where a few of our queries were taking 3+seconds with 5 shards and as I added more shards the query was taking even longer. I figured

Re: Zookeeper latencies and pending requests - Solr 4.3

2014-03-13 Thread Chris W
Any help on this is much appreciated. Is it better to use more cores for zookeeper (as opposed to 1 core machine)? On Wed, Mar 12, 2014 at 4:28 PM, Chris W chris1980@gmail.com wrote: Hi Furkan Load on the network is very low when read workload is on the cluster. During indexing, a few

Re: Migration issues - Solr 4.3.0 to Solr 4.4.0

2014-03-12 Thread Chris W
We decided to go with the latest (it seems to have a lot more bug /performance fixes). The issue i mentioned was a red herring. I was able to successfully upgrade On Tue, Mar 11, 2014 at 2:09 PM, Chris W chris1980@gmail.com wrote: Moving 4 versions ahead may need much additional tests

Zookeeper latencies and pending requests - Solr 4.3

2014-03-12 Thread Chris W
Hi I have a 3 node zk ensemble . I see a very high latency for zk responses and also a lot of outstanding requests (in the order of 30-40) I also see that the requests are not going to all zookeeper nodes equally. One node has more requests/connections than the others. I see that CPU/Mem and

Re: Zookeeper latencies and pending requests - Solr 4.3

2014-03-12 Thread Chris W
architecture) Thanks; Furkan KAMACI 2014-03-13 0:57 GMT+02:00 Chris W chris1980@gmail.com: Hi I have a 3 node zk ensemble . I see a very high latency for zk responses and also a lot of outstanding requests (in the order of 30-40) I also see that the requests are not going to all

Migration issues - Solr 4.3.0 to Solr 4.4.0

2014-03-11 Thread Chris W
I am running solrcloud version 4.3.0 with a 10 m1.xlarge nodes and using zk to manage the state/data for collections and configs.I want to upgrade to version 4.4.0. When i deploy a 4.4 version of solrcloud in my test environment, none of the collections/configs (created using the 4.3 version of

Re: Migration issues - Solr 4.3.0 to Solr 4.4.0

2014-03-11 Thread Chris W
understand vetting requirements, but I thought I'd ask No use going through this twice if you can avoid it. On Tue, Mar 11, 2014 at 12:49 PM, Chris W chris1980@gmail.com wrote: I am running solrcloud version 4.3.0 with a 10 m1.xlarge nodes and using zk to manage the state/data