Re: Request routing / load-balancing TLOG & PULL replica types

2018-02-14 Thread Ere Maijala
A patch is now available: https://issues.apache.org/jira/browse/SOLR-11982 --Ere Greg Roodt kirjoitti 12.2.2018 klo 22.06: Thanks Ere. I've taken a look at the discussion here: http://lucene.472066.n3.nabble.com/Limit-search-queries-only-to-pull-replicas-td4367323.html This is how I was imagini

Re: Request routing / load-balancing TLOG & PULL replica types

2018-02-12 Thread Ere Maijala
2. In my experience using PULL replicas can have a significant positive effect on the server load. It depends of course on your analysis chain, but we do some fairly expensive analysis, and not having to do the same work X times does have a benefit. Unfortunately we need multiple shards so we c

Re: Request routing / load-balancing TLOG & PULL replica types

2018-02-12 Thread Greg Roodt
Thanks so much again Tomas! You've answered my questions and I clearly understand now. Great work! On 13 February 2018 at 09:13, Tomas Fernandez Lobbe wrote: > > > > On Feb 12, 2018, at 12:06 PM, Greg Roodt wrote: > > > > Thanks Ere. I've taken a look at the discussion here: > > http://lucene.4

Re: Request routing / load-balancing TLOG & PULL replica types

2018-02-12 Thread Tomas Fernandez Lobbe
> On Feb 12, 2018, at 12:06 PM, Greg Roodt wrote: > > Thanks Ere. I've taken a look at the discussion here: > http://lucene.472066.n3.nabble.com/Limit-search-queries-only-to-pull-replicas-td4367323.html > This is how I was imagining TLOG & PULL replicas would wor, so if this > functionality doe

Re: Request routing / load-balancing TLOG & PULL replica types

2018-02-12 Thread Greg Roodt
Thanks Ere. I've taken a look at the discussion here: http://lucene.472066.n3.nabble.com/Limit-search-queries-only-to-pull-replicas-td4367323.html This is how I was imagining TLOG & PULL replicas would wor, so if this functionality does get developed, it would be useful to me. I still have 2 quest

Re: Request routing / load-balancing TLOG & PULL replica types

2018-02-12 Thread Ere Maijala
Your question about directing queries to PULL replicas only has been discussed on the list. Look for topic "Limit search queries only to pull replicas". What I'd like to see is something similar to the preferLocalShards parameter. It could be something like "preferReplicaTypes=TLOG,PULL". Tomás

Re: Request routing / load-balancing TLOG & PULL replica types

2018-02-11 Thread Greg Roodt
Thank you both for your very detailed answers. This is great to know. I knew that SolrJ had the cluster aware knowledge (via zookeeper), but I was wondering what something like curl would do. Great to know that internally the cluster will proxy queries to the appropriate place regardless. I am ru

Re: Request routing / load-balancing TLOG & PULL replica types

2018-02-11 Thread Tomas Fernandez Lobbe
On the last question: For Writes: Yes. Writes are going to be sent to the shard leader, and since PULL replicas can’t be leaders, it’s going to be a TLOG replica. If you are using CloudSolrClient, then this routing will be done directly from the client (since it will send the update to the lead

Re: Request routing / load-balancing TLOG & PULL replica types

2018-02-11 Thread Erick Erickson
Talking a little out of my depth here as I haven't ben in that code, so if there are corrections they're welcome. In general, there's nothing special between TLOG and PULL replicas in terms of query routing. For that matter, nothing special about either of these .vs. NRT replicas for _queries_. S