Re: Solr search and index rate optimization

2016-01-11 Thread Zap Org
hello dear thanks for replying it means 3 ZK instances are more than enough in my case On Fri, Jan 8, 2016 at 10:07 PM, Erick Erickson wrote: > Here's a longer form of Toke's answer: > >

Re: Solr search and index rate optimization

2016-01-11 Thread Zap Org
thanks for replying currently my machine specs are 32 GB RAM 4 core processor windows server 2008 64bit 500 GB HD 16 GB swap memorey now the already running machine with cpu usage not more than 10% already consumed all the RAM and now started to use swap memorey what my guess is my server will

Re: Solr search and index rate optimization

2016-01-10 Thread Erick Erickson
bq: Well, a good reason would be if you want your system to continue to operate if 2 ZK nodes lose communication with the rest of the cluster or go down completely My argument is usually that if you are losing 2 of 3 ZK nodes at the same time with any regularity, you probably have problems that

Re: Solr search and index rate optimization

2016-01-09 Thread Steve Davids
bq. There's no good reason to have 5 with a small cluster and by "small" I mean < 100s of nodes. Well, a good reason would be if you want your system to continue to operate if 2 ZK nodes lose communication with the rest of the cluster or go down completely. Just to be clear though, the ZK nodes

Re: Solr search and index rate optimization

2016-01-08 Thread Toke Eskildsen
On Fri, 2016-01-08 at 10:55 +0500, Zap Org wrote: > i wanted to ask that i need to index after evey 15 min with hard commit > (real time records) and currently have 5 zookeeper instances and 2 solr > instances in one machine serving 200 users with 32GB RAM. whereas i wanted > to serve more than

Re: Solr search and index rate optimization

2016-01-08 Thread Erick Erickson
Here's a longer form of Toke's answer: https://lucidworks.com/blog/2012/07/23/sizing-hardware-in-the-abstract-why-we-dont-have-a-definitive-answer/ BTW, on the surface, having 5 ZK nodes isn't doing you any real good. Zookeeper isn't really involved in serving queries or handling updates, it's

Solr search and index rate optimization

2016-01-07 Thread Zap Org
i wanted to ask that i need to index after evey 15 min with hard commit (real time records) and currently have 5 zookeeper instances and 2 solr instances in one machine serving 200 users with 32GB RAM. whereas i wanted to serve more than 10,000 users so what should be my machine specs and what