Re: Limit Solr to search for only 500 records based on the search criteria

2016-06-16 Thread Erick Erickson
What is? You have to separate getting the response from rendering, so first I'd measure with curl or similar. Second, returning 1,000 records is usually a bad idea, when returning that many rows you may want to use the export handler. Sent from my phone On Jun 16, 2016 3:25 AM, "Thrinadh Kuppili"

Re: [SolrCloud] shard hash ranges changed after restoring backup

2016-06-16 Thread Erick Erickson
In essence, no. The data is, at best, in the wrong shard and at worst nowhere. Sent from my phone On Jun 16, 2016 8:26 AM, "Gary Yao" wrote: > Hi Erick, > > I should add that our Solr cluster is in production and new documents > are constantly indexed. The new cluster has

Re: Long STW GCs with Solr Cloud

2016-06-16 Thread Cas Rusnov
Hey thanks for your reply. Looks like running the suggested CMS config from Shawn, we're getting some nodes with 30+sec pauses, I gather due to large heap, interestingly enough while the scenario Jeff talked about is remarkably similar (we use field collapsing), including the performance aspects

Re: [E] Re: Stemming

2016-06-16 Thread Aurélien MAZOYER
No problem :-) Aurélien Le 16/06/2016 22:36, Jamal, Sarfaraz a écrit : Oh, is this what you meant? content_stemming I changed it to content_stemming and now it seems to work :) - It was _text_ before - Thanks! I will update if I discover anything amiss

RE: [E] Re: Stemming

2016-06-16 Thread Jamal, Sarfaraz
Oh, is this what you meant? content_stemming I changed it to content_stemming and now it seems to work :) - It was _text_ before - Thanks! I will update if I discover anything amiss Thanks again so much =) Sas -Original Message- From: Aurélien MAZOYER

RE: [E] Re: Stemming

2016-06-16 Thread Jamal, Sarfaraz
Hello =) Just to be safe and make sure it's happening at indexing time AS WELL as QUERYING time - I modified it to be like so:

Re: [E] Re: Stemming

2016-06-16 Thread Aurélien MAZOYER
Hi, I was just wondering if you are sure that you query only that field (or fields that use your text_stem analyzer) and not other fields (in your qf for example is you use edismax) that can give you uncorrect results. Regards, Aurélien Le 16/06/2016 22:29, Jamal, Sarfaraz a écrit : Hello

Re: Stemming

2016-06-16 Thread Aurélien MAZOYER
Hi, Yes you should have the same resultset. Are you sure that you reindex all the data after changing your schema? Are you sure that you put your analyzer both at indexing and querying? Are you sure you query only one field? Regards, Aurélien Le 16/06/2016 21:13, Jamal, Sarfaraz a écrit :

Re: Long STW GCs with Solr Cloud

2016-06-16 Thread Jeff Wartes
Check your gc log for CMS “concurrent mode failure” messages. If a concurrent CMS collection fails, it does a stop-the-world pause while it cleans up using a *single thread*. This means the stop-the-world CMS collection in the failure case is typically several times slower than a concurrent

RE: [E] Re: Stemming

2016-06-16 Thread Jamal, Sarfaraz
HI Ahmet, Thanks for your guidance. I just tried the following two configurations: And

Re: ConcurrentMergeScheduler options not exposed

2016-06-16 Thread Shawn Heisey
On 6/16/2016 2:35 AM, Michael McCandless wrote: > > Hmm, merging can't read at 800 MB/sec and only write at 20 MB/sec for > very long ... unless there is a huge percentage of deletes. Also, by > default CMS doesn't throttle forced merges (see > CMS.get/setForceMergeMBPerSec). Maybe capture >

Re: Stemming

2016-06-16 Thread Ahmet Arslan
Hi Jamal, Snowball requires lowercase filter above it. This is documented in javadocs but it is a small but important detail. Please use a lowercase filter after the whitescpace tokenizer. Ahmet On Thursday, June 16, 2016 10:13 PM, "Jamal, Sarfaraz"

tlogs not deleting as usual in Solr 5.5.1?

2016-06-16 Thread Chris Morley
The repetition below is on purpose to show the contrast between solr versions. In Solr 4.10.3, we have autocommits disabled. We do a dataimport of a few hundred thousand records and have a tlog that grows to ~1.2G. In Solr 5.5.1, we have autocommits disabled. We do a dataimport of a

Stemming

2016-06-16 Thread Jamal, Sarfaraz
Hi Guys, I have enabled stemming: In the Admin Analysis, I type in running or runs and they both break down to run. However when I search for run, runs, or running with an actual query - It brings back three different

Re: Solr 6.1.x Release Date ??

2016-06-16 Thread Steve Rowe
Tomorrow-ish. -- Steve www.lucidworks.com > On Jun 16, 2016, at 4:14 AM, Ramesh shankar wrote: > > Hi, > > Yes, i used the solr-6.1.0-79 nightly builds and [subquery] transformer is > working fine in, any idea of the expected release date for 6.1 ? > > Regards > Ramesh >

Core Admin API: Create Solr core if it does not exist

2016-06-16 Thread Andreas Hubold
Hi, we're still using Solr 4.10.4 without SolrCloud and create cores dynamically using the Core Admin API. We have multiple applications that access a core and create it if it doesn't exist. To this end, we use the STATUS action to see if a required core exists and if it doesn't, create it

Re: Boosting exact match fields.

2016-06-16 Thread elisabeth benoit
In addition to what was proposed We use the technic described here https://github.com/cominvent/exactmatch and it works quite well. Best regards Elisabeth 2016-06-15 16:32 GMT+02:00 Alessandro Benedetti : > In addition to what Erick correctly proposed, > are you

Strange highlighting on search

2016-06-16 Thread Tom Evans
Hi all I'm investigating a bug where by every term in the highlighted field gets marked for highlighting instead of just the words that match the fulltext portion of the query. This is on Solr 5.5.0, but I didn't see any bug fixes related to highlighting in 5.5.1 or 6.0 release notes. The query

Re: [SolrCloud] shard hash ranges changed after restoring backup

2016-06-16 Thread Gary Yao
Hi Erick, I should add that our Solr cluster is in production and new documents are constantly indexed. The new cluster has been up for three weeks now. The problem was discovered only now because in our use case Atomic Updates and RealTime Gets are mostly performed on new documents. With almost

Re: solr spellcheck suggest correct word when FileBasedSpellChecker

2016-06-16 Thread Alessandro Benedetti
Taking a look into the code : The spellcheck.alternativeTermCount Parameter Specify the number of suggestions to return for each query term existing in the index and/or dictionary. Presumably, users will want fewer suggestions for words with docFrequency>0. Also setting this value turns "on"

Re: ConcurrentMergeScheduler options not exposed

2016-06-16 Thread Michael McCandless
Hmm, merging can't read at 800 MB/sec and only write at 20 MB/sec for very long ... unless there is a huge percentage of deletes. Also, by default CMS doesn't throttle forced merges (see CMS.get/setForceMergeMBPerSec). Maybe capture IndexWriter.setInfoStream output? Mike McCandless

Re: Solr 6.1.x Release Date ??

2016-06-16 Thread Ramesh shankar
Hi, Yes, i used the solr-6.1.0-79 nightly builds and [subquery] transformer is working fine in, any idea of the expected release date for 6.1 ? Regards Ramesh -- View this message in context: http://lucene.472066.n3.nabble.com/Solr-6-1-x-Release-Date-tp4280945p4282562.html Sent from the Solr

SOLR war for SOLR 6

2016-06-16 Thread Bharath Kumar
Hi, I was trying to generate a solr war out of the solr 6 source, but even after i create the war, i was not able to get it deployed correctly on jboss. Wanted to know if anyone was able to successfully generate solr war and deploy it on tomcat or jboss? Really appreciate your help on this. --

Re: Limit Solr to search for only 500 records based on the search criteria

2016-06-16 Thread Thrinadh Kuppili
Thanks Eric, Can you please elaborate "I'd also suggest that your response times are tunable" ?? I have set the start to 0 and rows to 1000 initially and entered a search field as below CompanyName : private limited when i clicked on search button in the UI it is not responsive at all. When i

ghost dynamic fileds: *____amount_raw and *____currency

2016-06-16 Thread scott.chu
I installsolr 6.0.1 and create a core with my own config (copied and modified from those in basic_config). Then enable classic index. All the dynamicField tags are comment out in my schema.xml. However, when I click 'schema' menu item of my core in admin UI. I see it listed these two ghost