Disastor Scenario Question Regarding Tlog+pull solrcloud setup

Hi, My question is about the solrcloud cluster we are trying to have. We have a collection with Tlog and pull type replicas. We intend to keep all the tlogs on one node and use that for writing and pull replicas distributed on the remaining nodes. What we have noticed is that when the Tlog node

Re: StreamingSolrClients intermittent Error SolrCloud setup

Hi Abhi, Are all your Solr nodes and ZooKeepers in different machine? Regards, Edwin On Wed, 27 Feb 2019 at 02:19, abhishek_itengg wrote: > Hi, > > I am using SolrCloud setup with 3 SolrNodes. Intermittently we see errors > of > streaming solr clients on individual solr node lo

StreamingSolrClients intermittent Error SolrCloud setup

Hi, I am using SolrCloud setup with 3 SolrNodes. Intermittently we see errors of streaming solr clients on individual solr node logs. These error do resolved automatically but it comes back every now and then. We have 3 zookeepers and I verified that they have always maintained quorum

Re: Scoping SolrCloud setup

e're in the process of moving from 12 single-core collections (non-cloud Solr) on 3 VMs to a SolrCloud setup. Our collections aren't huge, ranging in size from 50K to 150K documents with one at 1.2M docs. Our max query frequency is rather low .. probably no more than 10-20/min. We do update freque

Re: Scoping SolrCloud setup

gt;>> load to multiple servers. >>>> It seems to me that there is no high indexing throughput requirement and >>>> the main criteria should be query latency. >>>> Here is another blog post talking about this subject: >>>> http://www.od-bits.com/2018/01/

Re: Scoping SolrCloud setup

01:01, Scott Prentice <s...@leximation.com> wrote: We're in the process of moving from 12 single-core collections (non-cloud Solr) on 3 VMs to a SolrCloud setup. Our collections aren't huge, ranging in size from 50K to 150K documents with one at 1.2M docs. Our max query frequency is rather low .. prob

Re: Scoping SolrCloud setup

amp; Elasticsearch Consulting Support Training - http://sematext.com/ >> >> >> >>> On 14 Mar 2018, at 01:01, Scott Prentice <s...@leximation.com> wrote: >>> >>> We're in the process of moving from 12 single-core collections (non-cloud >>> Solr) on

Re: Scoping SolrCloud setup

ing - http://sematext.com/ On 14 Mar 2018, at 01:01, Scott Prentice <s...@leximation.com> wrote: We're in the process of moving from 12 single-core collections (non-cloud Solr) on 3 VMs to a SolrCloud setup. Our collections aren't huge, ranging in size from 50K to 150K documents with one at 1.

Re: Scoping SolrCloud setup

com> wrote: We're in the process of moving from 12 single-core collections (non-cloud Solr) on 3 VMs to a SolrCloud setup. Our collections aren't huge, ranging in size from 50K to 150K documents with one at 1.2M docs. Our max query frequency is rather low .. probably no more than 10-20/min. We do

Re: Scoping SolrCloud setup

.@leximation.com> wrote: > > We're in the process of moving from 12 single-core collections (non-cloud > Solr) on 3 VMs to a SolrCloud setup. Our collections aren't huge, ranging in > size from 50K to 150K documents with one at 1.2M docs. Our max query > frequency is rather low .. p

Re: Scoping SolrCloud setup

lr) on 3 VMs to a SolrCloud setup. Our collections aren't huge, ranging > in size from 50K to 150K documents with one at 1.2M docs. Our max query > frequency is rather low .. probably no more than 10-20/min. We do update > frequently, maybe 10-100 documents every 10 mins. > > Our prototype s

Scoping SolrCloud setup

We're in the process of moving from 12 single-core collections (non-cloud Solr) on 3 VMs to a SolrCloud setup. Our collections aren't huge, ranging in size from 50K to 150K documents with one at 1.2M docs. Our max query frequency is rather low .. probably no more than 10-20/min. We do update

Re: Solrcloud setup

Stop optimizing call and see if that resolves the problem. Also how are you indexing? (point 3 above). Are you using CloudSolrClient or manually sending requests to any node? Thanks, Susheel On Tue, Aug 22, 2017 at 9:27 AM, Shreya Kampli wrote: > Hi, > > I have setup a

Solrcloud setup

Hi, I have setup a solrcloud with 1 shard and 3 replicas on solr 6.6. Every index operation makes an explicit commit so that the documents are available immediately. The indexing happens every 5 minutes for few 100's of documents. My problem is that I see that the replica nodes are frequently

Re: SolrCloud setup

and Regards, Preeti -Original Message- From: John Bickerstaff [mailto:j...@johnbickerstaff.com] Sent: Thursday, September 22, 2016 9:19 AM To: solr-user@lucene.apache.org Subject: Re: SolrCloud setup I found it to be way less than intuitive when I first started to get going. I wished for an example

RE: SolrCloud setup

, September 22, 2016 9:19 AM To: solr-user@lucene.apache.org Subject: Re: SolrCloud setup I found it to be way less than intuitive when I first started to get going. I wished for an example or step by step (including zookeeper) Pulling it all together from the docs wasn't straightforward although I

Re: SolrCloud setup

I found it to be way less than intuitive when I first started to get going. I wished for an example or step by step (including zookeeper) Pulling it all together from the docs wasn't straightforward although I guess the info is still there. I'll send you my rough notes in case they're

Re: SolrCloud setup

Setting up SolrCloud on multiple hosts is exactly the same as a single host. You just install Solr on all the hosts you care about and start it up. As long as the hosts can talk to each other via HTTP, it's all magic. The "glue" is Zookeeper. All the Solrs are started up with the same ZK ensemble

SolrCloud setup

Can someone point me to a tutorial or blog to setup SolrCloud on multiple hosts? LucidWorks just have a trivial single host example. I searched around but only found some blogs for older versions (2014 or earlier). thanks.

Re: how to change configurations in solrcloud setup

On 3/11/2015 10:45 PM, Aman Tandon wrote: You may need to manually remove the 127.0.1.1 entries from zookeeper after you fix the IP address problem. How to do that? The zkcli script included with Solr should have everything you need -- getfile, putfile, and clear ... but that would be a

Re: how to change configurations in solrcloud setup

Hi, Thanks Nitin for replying, isn't it will be costly operation to restart all nodes. What i am doing in this is uploading the configurations again to zookeeper and then reloading my core. And it is working well. So am i missing something? With Regards Aman Tandon On Wed, Mar 11, 2015 at

Re: how to change configurations in solrcloud setup

On 3/11/2015 12:43 AM, Aman Tandon wrote: Thanks Nitin for replying, isn't it will be costly operation to restart all nodes. What i am doing in this is uploading the configurations again to zookeeper and then reloading my core. And it is working well. So am i missing something? Yes, that

Re: how to change configurations in solrcloud setup

Thanks Shawn. except that you should reload the collection, which will reload all cores for that collection So i could reload a collection via Collection API's http://localhost:8983/solr/admin/collections?action=RELOADname=newCollection right? With Regards Aman Tandon On Wed, Mar 11,

Re: how to change configurations in solrcloud setup

Hi Shawn, I make the changes in my schema.xml uploaded the configuration from one of my server, which is now visible in all other servers (I confirmed it by checking from admin interface). *My Solr Cloud arch is :* I have two collections, mcat intent in my external zookeeper ensemble of 3.

Re: how to change configurations in solrcloud setup

On 3/11/2015 6:32 AM, Aman Tandon wrote: I restart my complete cluster but the problem still present. Please help. *Here is the screenshot url:* *http://i.imgur.com/QFdg89S.png http://i.imgur.com/tS0yTNh.png The first screenshot actually shows the problem, but it may not be immediately

Re: how to change configurations in solrcloud setup

Hi Shawn, As suggested i gave the -Dhost=192.168.5.236 in command line for the server which was showing 127.0.0.1. *./solr start -c -z 192.168.6.217:2181 http://192.168.6.217:2181,192.168.5.81:2181 http://192.168.5.81:2181,192.168.5.236:2181 http://192.168.5.236:2181 -p 4567 -Dhost=192.168.5.236

Re: how to change configurations in solrcloud setup

Hi Aman, You can apply configuration on solr cloud by using this command - sudo path_of_solr/solr_folder_name/example/scripts/cloud-scripts/zkcli.sh -zkhost localhost:9983 -cmd upconfig -confdir path_of_solr/solr_folder_name/example/solr/collection1/conf -confname default and

Re: how to change configurations in solrcloud setup

Please help. With Regards Aman Tandon On Sat, Mar 7, 2015 at 9:58 PM, Aman Tandon amantandon...@gmail.com wrote: Hi, Please tell me what is best way to apply configuration changes in solr cloud and how to do that. Thanks in advance. With Regards Aman Tandon

how to change configurations in solrcloud setup

Hi, Please tell me what is best way to apply configuration changes in solr cloud and how to do that. Thanks in advance. With Regards Aman Tandon

Re: SolrCloud setup guidance

partition strategy ) that index size of 150-200 GB can fit into two nodes memory. Thanks, Susheel -Original Message- From: Priti Solanki [mailto:pritiatw...@gmail.com] Sent: Friday, March 07, 2014 12:50 AM To: solr-user@lucene.apache.org Subject: Re: SolrCloud setup guidance Thanks

Re: SolrCloud setup guidance

) that index size of 150-200 GB can fit into two nodes memory. Thanks, Susheel -Original Message- From: Priti Solanki [mailto:pritiatw...@gmail.com] Sent: Friday, March 07, 2014 12:50 AM To: solr-user@lucene.apache.org Subject: Re: SolrCloud setup guidance Thanks Susheel

Re: SolrCloud setup guidance

memory. Thanks, Susheel -Original Message- From: Priti Solanki [mailto:pritiatw...@gmail.com] Sent: Friday, March 07, 2014 12:50 AM To: solr-user@lucene.apache.org Subject: Re: SolrCloud setup guidance Thanks Susheel, But this index will keep on growing

Re: SolrCloud setup guidance

-Original Message- From: Priti Solanki [mailto:pritiatw...@gmail.com] Sent: Thursday, March 06, 2014 10:51 AM To: solr-user@lucene.apache.org Subject: SolrCloud setup guidance Hello Everyone, I would like to take you guidance of following I have a single core with 124 GB

RE: SolrCloud setup guidance

have some partition strategy ) that index size of 150-200 GB can fit into two nodes memory. Thanks, Susheel -Original Message- From: Priti Solanki [mailto:pritiatw...@gmail.com] Sent: Friday, March 07, 2014 12:50 AM To: solr-user@lucene.apache.org Subject: Re: SolrCloud setup guidance

Re: SolrCloud setup guidance

your single node to 128GB of memory(vertical scaling) to see the difference. Thanks, Susheel -Original Message- From: Priti Solanki [mailto:pritiatw...@gmail.com] Sent: Thursday, March 06, 2014 10:51 AM To: solr-user@lucene.apache.org Subject: SolrCloud setup guidance

SolrCloud setup guidance

Hello Everyone, I would like to take you guidance of following I have a single core with 124 GB of index data size. Indexing and Reading both are very slow as I have 7 GB RAM to support this huge data. Almost 8 million of documents. Hence, we thought of going to SolrCloud so that we can

RE: SolrCloud setup guidance

[mailto:pritiatw...@gmail.com] Sent: Thursday, March 06, 2014 10:51 AM To: solr-user@lucene.apache.org Subject: SolrCloud setup guidance Hello Everyone, I would like to take you guidance of following I have a single core with 124 GB of index data size. Indexing and Reading both are very slow as I have 7

Re: SolrCloud setup guidance

...@gmail.com] Sent: Thursday, March 06, 2014 10:51 AM To: solr-user@lucene.apache.org Subject: SolrCloud setup guidance Hello Everyone, I would like to take you guidance of following I have a single core with 124 GB of index data size. Indexing and Reading both are very slow as I have 7 GB RAM

Re: SolrCloud setup - any advice?

Good point. I'd seen docValues and wondered whether they might be of use in this situation. However, as I understand it they require a value to be set for all documents until Solr 4.5. Is that true or was I imagining reading that? On 25 September 2013 11:36, Erick Erickson

Re: SolrCloud setup - any advice?

I think you're right, but you can specify a default value in your schema.xml to at least see if this is a good path to follow. Best, Erick On Fri, Sep 27, 2013 at 3:46 AM, Neil Prosser neil.pros...@gmail.com wrote: Good point. I'd seen docValues and wondered whether they might be of use in

Re: SolrCloud setup - any advice?

H, I confess I haven't had a chance to play with this yet, but have you considered docValues for some of your fields? See: http://wiki.apache.org/solr/DocValues And just to tantalize you: Since Solr4.2 to build a forward index for a field, for purposes of sorting, faceting, grouping,

Re: SolrCloud setup - any advice?

Shawn: unfortunately the current problems are with facet.method=enum! Erick: We already round our date queries so they're the same for at least an hour so thankfully our fq entries will be reusable. However, I'll take a look at reducing the cache and autowarming counts and see what the effect on

Re: SolrCloud setup - any advice?

About caches. The queryResultCache is only useful when you expect there to be a number of _identical_ queries. Think of this cache as a map where the key is the query and the value is just a list of N document IDs (internal) where N is your window size. Paging is often the place where this is

Re: SolrCloud setup - any advice?

Sorry, my bad. For SolrCloud soft commits are enabled (every 15 seconds). I do a hard commit from an external cron task via curl every 15 minutes. The version I'm using for the SolrCloud setup is 4.4.0. Document cache warm-up times are 0ms. Filter cache warm-up times are between 3 and 7 seconds

Re: SolrCloud setup - any advice?

will temporarily drop that server from the available pool. I'm aware that this is your old setup, so we'll put it aside for now so we can concentrate on your SolrCloud setup. Most of our documents have upwards of twenty fields. We use different fields to store territory variant (we have around 30 territories

SolrCloud setup - any advice?

Apologies for the giant email. Hopefully it makes sense. We've been trying out SolrCloud to solve some scalability issues with our current setup and have run into problems. I'd like to describe our current setup, our queries and the sort of load we see and am hoping someone might be able to spot

Re: SolrCloud setup - any advice?

Hi Neil, Although you haven't mentioned it, just wanted to confirm - do you have soft commits enabled? Also what's the version of solr you are using for the solr cloud setup? 4.0.0 had lots of memory and zk related issues. What's the warmup time for your caches? Have you tried disabling the

Re: SolrCloud setup - any advice?

Hi Neil, Consider using G1 instead. See http://blog.sematext.com/?s=g1 If that doesn't help, we can play with various JVM parameters. The latest version of SPM for Solr exposes information about sizes and utilization of JVM memory pools, which may help you understand which JVM params you need

Schema/config changes and re-indexing in a SolrCloud setup

Hi Solr community I'm in the process of getting my mind set straight on SolrCloud; more specifically: trying to design a feasible workflow for a use-case where we currently use master/slave replication. First, the use case: We want to 1. separate indexing workload from query workload 2.

Re: Schema/config changes and re-indexing in a SolrCloud setup

On Feb 7, 2013, at 5:23 PM, Steffen Elberg Godskesen steffen.godske...@gmail.com wrote: Re (1): Am I right in thinking that a given update is sent to every replica of the shard to which it belongs for analysis and indexing? And that there is no immediate way to separate indexing from

Re: solrcloud setup using tomcat, single machine

into, and where I'm going with this so that you have enough information to base suggestions/answers on. Thanks! - Jesse -- View this message in context: http://lucene.472066.n3.nabble.com/solrcloud-setup-using-tomcat-single-machine-tp4006041.html Sent from the Solr - User mailing list

solrcloud setup using tomcat, single machine

into, and where I'm going with this so that you have enough information to base suggestions/answers on. Thanks! - Jesse -- View this message in context: http://lucene.472066.n3.nabble.com/solrcloud-setup-using-tomcat-single-machine-tp4006041.html Sent from the Solr - User mailing list archive at Nabble.com.