Re: No space left on device - When I execute suggester component.

2017-12-19 Thread Fiz Newyorker
Thank You Erick & Shawn for your response. I tried df -h , during suggest.build command. Size. Used Avail Use% Mounted on 63G 17G 44G 28% /ngs/app /ngs/app/razord/LWSearch/solr-6.5.0/bin - My Solr Server . I believe 44G is enough for running suggest.build. Please let me know wh

Re: Solr 7.1 Solrcloud dynamic/automatic replicas

2017-12-19 Thread Greg Roodt
Ok, thanks. I'll take a look into using the ADDREPLICA API. I've found a few examples of the znode format. It seems to be IP:PORT_solr (where I presume _solr is the name of the context or something?). Is there a way to discover what a znode is? i.e. Can my new node determine what it's znode is? O

Re: No space left on device - When I execute suggester component.

2017-12-19 Thread Shawn Heisey
On 12/19/2017 7:07 PM, Fiz Newyorker wrote: Yes I checked the Disk usage. using this command du -sh and I have enough space on the Disk. 2017-12-20 02:05:53.910 ERROR (qtp401424608-16) [ x:User_Data] o.a.s.s.HttpSolrCall null:java.io.IOException: No space left on device The error that

Re: No space left on device - When I execute suggester component.

2017-12-19 Thread Erick Erickson
How much is "enough"? You're going to be building and storing the resultant structure on disk since you have suggest.build=true. It seems simple enough to give yourself some more disk space and try again. While you do that, monitor the disk space while the suggester builds and see. Best, Erick On

Re: No space left on device - When I execute suggester component.

2017-12-19 Thread Fiz Newyorker
Hi , Yes I checked the Disk usage. using this command du -sh and I have enough space on the Disk. I am using this Query : *http://rn.com/solr/User_Data/suggest?suggest=true&suggest.build=true&suggest.dictionary=fuzzySuggester&wt=json&suggest.q=Jerry

Re: No space left on device - When I execute suggester component.

2017-12-19 Thread Jamie Jackson
Have you checked disk consumption on the box yet? On Dec 19, 2017 8:46 PM, "Fiz Newyorker" wrote: > Hello Solr Experts, > > Good Evening ! > > I have an issue , Whenever I run the Auto Suggest component , > > http://lapp81.rno.com:8989/solr/Data/suggest?suggest= > true&suggest.build=true&sugges

Re: Learning to Rank (LTR) with grouping

2017-12-19 Thread Roopa Rao
Hi Diego, Thank you for looking into it further. We recently ported over to 6.6 version solely to use LTR feature as it is critical for us. Since its not working with grouping in the base version, I am trying to evaluate if there is any alternative way to make it work in 6.6 versus upgrading to 7

No space left on device - When I execute suggester component.

2017-12-19 Thread Fiz Newyorker
Hello Solr Experts, Good Evening ! I have an issue , Whenever I run the Auto Suggest component , http://lapp81.rno.com:8989/solr/Data/suggest?suggest=true&suggest.build=true&suggest.dictionary=fuzzySuggester&wt=json&suggest.q=Jerry I am getting the following Error . {"responseHeader":{"statu

Re: Solr 7.1 Solrcloud dynamic/automatic replicas

2017-12-19 Thread Erick Erickson
Yes, ADDREPLICA is mostly equivalent, it's also supported going forward LegacyCloud should work temporarily, I'd change it going forward though. Finally, you'll want to add a "node" parameter to insure your replica is placed on the exact node you want, see the livenodes znode for the format..

Re: Solr 7.1 Solrcloud dynamic/automatic replicas

2017-12-19 Thread Greg Roodt
Thanks for the reply. So it sounds like the method that I'm using to automatically add replicas on Solr 6.2 is not recommended and not going to be supported in future versions. A couple of follow up questions then: * Do you know if running with legacyCloud=true will make this behaviour work "for n

Re: start with techproducts example in docker

2017-12-19 Thread Rick Leir
Christine I think this is a long-lived docker container , meaning that it does not all terminate after the command you showed. If so, you should be able to start a console or ssh session to it. Have a look at the solr.log. Better still, start the techproducts example within this ssh session, and

Re: Solr 7.1 Solrcloud dynamic/automatic replicas

2017-12-19 Thread Shawn Heisey
On 12/19/2017 3:06 PM, Greg Roodt wrote: > Thanks for your reply Erick. > > This is what I'm doing at the moment with Solr 6.2 (I was mistaken, before > I said 6.1). > > 1. A new instance comes online > 2. Systemd starts solr with a custom start.sh script > 3. This script creates a core.properties

Re: start with techproducts example in docker

2017-12-19 Thread Shawn Heisey
On 12/19/2017 3:20 PM, Buckler, Christine wrote: > What is the correct syntax to start the techproducts example in docker? > > I am using > “$ docker run --name tech-demo -d -p 8983:8983 -t solr –e techproducts“ > which immediately exits. As I said before, the Solr project has not produced any doc

start with techproducts example in docker

2017-12-19 Thread Buckler, Christine
What is the correct syntax to start the techproducts example in docker? I am using “$ docker run --name tech-demo -d -p 8983:8983 -t solr –e techproducts“ which immediately exits.

Re: Solr 7.1 Solrcloud dynamic/automatic replicas

2017-12-19 Thread Greg Roodt
Thanks for your reply Erick. This is what I'm doing at the moment with Solr 6.2 (I was mistaken, before I said 6.1). 1. A new instance comes online 2. Systemd starts solr with a custom start.sh script 3. This script creates a core.properties file that looks like this: ``` name=blah shard=shard1 `

Re: Learning to Rank (LTR) with grouping

2017-12-19 Thread Diego Ceccarelli
Hi Roopa, unfortunately I can't port the patch to the branch_6_6, but soon I'll update to upstream. Sorry about that. On Mon, Dec 18, 2017 at 7:52 PM, Roopa Rao wrote: > Hi - > > I merged the code from the bloomberg master-solr-8776 branch to branch_6_6 > on Solr. > > When I tried to compile the

Re: How to restrict the fields solr returns?

2017-12-19 Thread Diego Ceccarelli
Instead of putting this into Solr, did you consider adding this logic into the service that will call Solr? On Tue, Dec 19, 2017 at 4:41 PM, Solrmails wrote: > Thank you for your answer. I'd like to restrict the returned fields > dynamicaly based on a permission system. I think modifieng the "ge

Re: CDCR configuration in solrconfig

2017-12-19 Thread Elaine Cario
Thanks everyone for your suggestions - I will definitely take a look at the Config API. We are building more automation into our deployment processes, and I think we could fit API calls into that. On Mon, Dec 18, 2017 at 4:16 PM, Webster Homer wrote: > We also have the same configurations used

Re: OOM spreads to other replica's/HA when OOM

2017-12-19 Thread David Hastings
We put nginx servers in front of our three solr stand alone servers and three node gallera cluster, it works very well and the amount of control it gives you is really helpful. On Tue, Dec 19, 2017 at 10:58 AM, Walter Underwood wrote: > > On Dec 19, 2017, at 7:38 AM, Toke Eskildsen wrote: > > >

Re: OOM spreads to other replica's/HA when OOM

2017-12-19 Thread Walter Underwood
> On Dec 19, 2017, at 7:38 AM, Toke Eskildsen wrote: > > Let's say we change Solr, so that it does not re-issue queries that > caused nodes to fail. Unfortunately that does not solve your problem as > the user will do what users do on an internal server error: Press > reload. That would work, be

Re: How to restrict the fields solr returns?

2017-12-19 Thread Solrmails
Thank you for your answer. I'd like to restrict the returned fields dynamicaly based on a permission system. I think modifieng the "getParams" collection to add fl within the 'handleRequestBody'(CustomSearchHandler) should do the work? Sent with [ProtonMail](https://protonmail.com) Secure Email.

Re: OOM spreads to other replica's/HA when OOM

2017-12-19 Thread Toke Eskildsen
On Mon, 2017-12-18 at 15:56 -0500, Susheel Kumar wrote: > Technically I agree Shawn with you on fixing OOME cause, Infact it is > not an issue any more but I was testing for HA when planing for any > failures. > Same time it's hard to convince Business folks that HA wouldn't be > there in case of O

Solr 7 - Issue with index replication to PULL replicas after schema/config change

2017-12-19 Thread Samuel Tatipamula
Hi everyone, We are running a SolrCloud (Solr 7.1.0) with 2 NRT, 2 TLOG, and 20 PULL replicas. Recently we have observed that, after a schema push to the Zookeeper (3.4.6), and upon hitting the collection RELOAD api, index has stopped replicating to all the PULL replicas, and they went out of sync

Solr 7 - Issue with index replication to PULL replicas after schema/config change

2017-12-19 Thread Samuel Tatipamula
Hi everyone, We are running a SolrCloud (Solr 7.1.0) with 2 NRT, 2 TLOG, and 20 PULL replicas. Recently we have observed that, after a schema push to the Zookeeper (3.4.6), and upon hitting the collection RELOAD api, index has stopped replicating to all the PULL replicas, and they went out of sync

RE: ICUTransformFilter with traditional to simplified Chinese

2017-12-19 Thread Eyal Naamati
Thanks! I actually did ready the Stanford posts when we implemented our index, it was very helpful! -Original Message- From: Shawn Heisey [mailto:apa...@elyograg.org] Sent: Tuesday, December 19, 2017 1:31 AM To: solr-user@lucene.apache.org Subject: Re: ICUTransformFilter with traditiona

Re: How to restrict the fields solr returns?

2017-12-19 Thread Emir Arnautović
In addition to that, you can use invariants to disallow overriding it. Emir -- Monitoring - Log Management - Alerting - Anomaly Detection Solr & Elasticsearch Consulting Support Training - http://sematext.com/ > On 19 Dec 2017, at 14:23, Diego Ceccarelli wrote: > > If you need to return only

Re: index fields with custom gaps between terms

2017-12-19 Thread Shawn Heisey
On 12/19/2017 4:16 AM, Amin Raeiszadeh wrote: i solve this problem by developing of DocumentBuilder.toDocument() and DocumentBuilder.addField() functions.i don't use multiValue feature and in shcema i change the condition of check for multi value fields(skip it in colde) then in necessary positio

Re: recurring Solr warning messages

2017-12-19 Thread Shawn Heisey
On 12/19/2017 5:36 AM, Ritesh wrote: Hello,Can you help on the below issue please?My solr box keep on giving warnings about every 30 seconds: WARN null ServletHandler /solr/sitecore/select org.apache.solr.common.SolrException: application/x-www-form-urlencoded invalid: missing key It looks li

Re: How to restrict the fields solr returns?

2017-12-19 Thread Diego Ceccarelli
If you need to return only a subset of the fields for each request you can set them as default in the solrconfig.xml. On Dec 19, 2017 13:45, "Solrmails" wrote: > I found a solution: I created a custom Search Handler and overridden > 'handleRequestBody'. Then I modify the "getParams" collection w

Re: recurring Solr warning messages

2017-12-19 Thread Ritesh
Hello,Can you help on the below issue please?My solr box keep on giving warnings about every 30 seconds: WARN null ServletHandler /solr/sitecore/select org.apache.solr.common.SolrException: application/x-www-form-urlencoded invalid: missing key Can you please provide more information/resolution o

Re: How to restrict the fields solr returns?

2017-12-19 Thread Solrmails
I found a solution: I created a custom Search Handler and overridden 'handleRequestBody'. Then I modify the "getParams" collection within 'handleRequestBody' to enforce the fl param. Sent with [ProtonMail](https://protonmail.com) Secure Email. > Original Message > Subject: Re:

Re: How to restrict the fields solr returns?

2017-12-19 Thread Rick Leir
The fl parameter is used for this. On December 19, 2017 3:22:59 AM EST, Solrmails wrote: >Hey > >I'm using a custom "QParserPlugin" to restrict which documents are >returned to the user. >Now I'd like to restrict also the fields that are returned with a >document. I couldn't find a good entry poi

Re: How to restrict the fields solr returns?

2017-12-19 Thread Emir Arnautović
Hi, You could write custom search component that can be included in your request handler. HTH, Emir -- Monitoring - Log Management - Alerting - Anomaly Detection Solr & Elasticsearch Consulting Support Training - http://sematext.com/ > On 19 Dec 2017, at 09:22, Solrmails wrote: > > Hey > >

Re: Span queries

2017-12-19 Thread Emir Arnautović
Hi Sreenivas, If you go extreme and accept that you want to return even if slop is large, you could utilize edismax: use mm to define how much terms must match and pf and ps and pf2/3 and ps2/3 to boost results that match slop requirements. Maybe you can see if extending edismax might be simpler

Trouble with mm and SynonymQuery and KeywordRepeatFilter

2017-12-19 Thread Markus Jelsma
Hello, I have an interesting issue with mm and SynonymQuery and KeywordRepeatFilter. We do query time synonym expansion and use KeywordRepeat for not only finding stemmed tokens. Our synonyms are already preprocessed and contain only stemmed tokens. Synonym file contains: traject,verbind So, a

Re: index fields with custom gaps between terms

2017-12-19 Thread Amin Raeiszadeh
i solve this problem by developing of DocumentBuilder.toDocument() and DocumentBuilder.addField() functions.i don't use multiValue feature and in shcema i change the condition of check for multi value fields(skip it in colde) then in necessary position i put my custom gap as a value for textField.

Re: OOM spreads to other replica's/HA when OOM

2017-12-19 Thread Emir Arnautović
Hi Susheel, If a single query can cause node to fail and if retry cause replicas to be affected (still to be confirmed) then preventing retry logic on Solr side can only partially solve that issue - retry logic can exist on client side and it will result in replicas’ OOM. Again, not sure if Solr

How to restrict the fields solr returns?

2017-12-19 Thread Solrmails
Hey I'm using a custom "QParserPlugin" to restrict which documents are returned to the user. Now I'd like to restrict also the fields that are returned with a document. I couldn't find a good entry point to do such a restriction. Maybe I could missuse a "QueryResponseWriter" plugin but that so