Re: Need help with query syntax

2017-08-10 Thread Dave
Eric you going to vegas next month? > On Aug 10, 2017, at 7:38 PM, Erick Erickson wrote: > > Omer: > > Solr does not implement pure boolean logic, see: > https://lucidworks.com/2011/12/28/why-not-and-or-and-not/. > > With appropriate parentheses it can give the same

Re: Issue with delta import

2017-08-10 Thread vrindavda
refer this : http://lucene.472066.n3.nabble.com/Number-of-requests-spike-up-when-i-do-the-delta-Import-td4338162.html#a4339168 -- View this message in context: http://lucene.472066.n3.nabble.com/Issue-with-delta-import-tp4347680p4350157.html Sent from the Solr - User mailing list archive at

Re: Need help with query syntax

2017-08-10 Thread Erick Erickson
Omer: Solr does not implement pure boolean logic, see: https://lucidworks.com/2011/12/28/why-not-and-or-and-not/. With appropriate parentheses it can give the same results as you're discovering. Best Erick On Thu, Aug 10, 2017 at 3:00 PM, OTH wrote: > Thanks for the

Re: Need help with query syntax

2017-08-10 Thread OTH
Thanks for the help! That's resolved the issue. On Fri, Aug 11, 2017 at 1:48 AM, David Hastings < hastings.recurs...@gmail.com> wrote: > type:value AND (name:america^1+name:state^1+name:united^1) > > but in reality what you want to do is use the fq parameter with type:value > > On Thu, Aug 10,

Re: Problem loading custom similarity class via blob API

2017-08-10 Thread Webster Homer
The blob store api is indeed severely limited (near useless) by this: https://issues.apache.org/jira/browse/SOLR-9175 On Thu, Aug 10, 2017 at 4:08 PM, Webster Homer wrote: > I have a need to override the default behavior of the BM25Similarty class. > It was trivial to

Problem loading custom similarity class via blob API

2017-08-10 Thread Webster Homer
I have a need to override the default behavior of the BM25Similarty class. It was trivial to create the class. My problem is that I cannot load it, at least via the blob api as described here: https://cwiki.apache.org/confluence/display/solr/Adding+Custom+Plugins+in+SolrCloud+Mode I set

Re: Need help with query syntax

2017-08-10 Thread David Hastings
type:value AND (name:america^1+name:state^1+name:united^1) but in reality what you want to do is use the fq parameter with type:value On Thu, Aug 10, 2017 at 4:36 PM, OTH wrote: > Hello, > > I have the following use case: > > I have two fields (among others); one is

Need help with query syntax

2017-08-10 Thread OTH
Hello, I have the following use case: I have two fields (among others); one is 'name' and the other is 'type'. 'Name' is the field I need to search, whereas, with 'type', I need to make sure that it has a certain value, depending on the situation. Often, when I search the 'name' field, the

Re: Token "states" not getting lemmatized by Solr?

2017-08-10 Thread OTH
Hello - Sorry, I obviously made a mistake here. I said earlier that it seems to me that the word 'united' is being lemmatized (to 'unite'). But it seems that's not the case. It seems that there isn't any lemmatization or stemming being done. I had previously assumed that the default

Re: Token "states" not getting lemmatized by Solr?

2017-08-10 Thread Erick Erickson
First, if you turn off the "verbose" checkbox, it'll reduce a lot of the clutter. The important point is that when you hover over those abbreviations, it tells you exactly what class did the associated transformation the analysis chain on the tokens. You'll note that StandardTokenizer breaks the

Re: Token "states" not getting lemmatized by Solr?

2017-08-10 Thread Ahmet Arslan
Hi Omer, Your analysis chain does not include a stem filter (lemmatizer) Assuming you are dealing with English text, you can use KStemFilterFactory or SnowballFilterFactory. Ahmet On Thursday, August 10, 2017, 9:33:08 PM GMT+3, OTH wrote: Hi, Regarding 'analysis

Re: Token "states" not getting lemmatized by Solr?

2017-08-10 Thread OTH
Hi, Regarding 'analysis chain': I'm using Solr 6.4.1, and in the managed-schema file, I find the following: Regarding the Admin UI >> Analysis page: I just tried that, and to be honest, I can't seem to get much useful

which class is: o.a.s.c.S.Request

2017-08-10 Thread Nawab Zada Asad Iqbal
Hi I see logs from this class 'o.a.s.c.S.Request', and I am able to tune this log by going to the logging webpage (Solr -> Request), but I cannot find the full class name in code. What should I put in the log properties file to disable this log? Thanks Nawab

Re: Token "states" not getting lemmatized by Solr?

2017-08-10 Thread Erick Erickson
saying the field is "text_general" is not sufficient, please post the analysis chain defined in your schema. Also the admin UI>>analysis page will help you figure out exactly what part of the analysis chain does what. Best, Erick On Thu, Aug 10, 2017 at 8:37 AM, OTH

Re: SolrDispatchFilter Request Consumption

2017-08-10 Thread Chris Ulicny
We're using version 6.3.0 with the jetty container provided. The full log message is included below and is consistently the same. We only find this log message when there is extended high update load on the solrcloud (usually of small documents). Shorter bursts do not generate the same messages.

Token "states" not getting lemmatized by Solr?

2017-08-10 Thread OTH
Hello, It seems for me that the token "states" is not getting lemmatized to "state" by Solr. Eg, I have a document with the value "united states of america". This document is not returned when the following query is issued: q=name:state^1+name:america^1+name:united^1 However, all documents which

Re: Solr LTR with high rerankDocs

2017-08-10 Thread Erick Erickson
I have to confess that I know very little about the mechanics of LTR, but I can talk a little bit about compression. When a stored values is retrieved for a document it is read from the *.fdt file which is a compressed, verbatim copy of the field. DocValues can bypass this stored data and read

RE: Is there a way to determine fields available for faceting for a search without doing the faceting?

2017-08-10 Thread Markus Jelsma
solr/search/admin/luke?show=schema=json=true gives you schema information. Look for all fields that are string, int etc and test if they are either indexed are have docValues. -Original message- > From:Michael Joyner > Sent: Thursday 10th August 2017 16:12 > To:

Re: How to remove Scripts and Styles in content of SOLR Indexes[content field] while indexed through URL?

2017-08-10 Thread Steve Rowe
Hi Daniel, HTMLStripCharFilterFactory in your index analyzer should do the trick: -- Steve www.lucidworks.com > On Aug 10, 2017, at 4:13 AM, Daniel von der Helm >

Re: SolrDispatchFilter Request Consumption

2017-08-10 Thread Shawn Heisey
On 8/10/2017 7:31 AM, Chris Ulicny wrote: > I've noticed that there are quite a few INFO log entries of the form: > > "...o.a.s.s.SolrDispatchFilter Could not consume full client request" > > Should we be worried about these, or is there something wrong with the > requests we're making? > > We

How to remove Scripts and Styles in content of SOLR Indexes[content field] while indexed through URL?

2017-08-10 Thread Daniel von der Helm
Hi, if a fetched HTML page (using SimplePostTool: -Ddata=web) contains

Is there a way to determine fields available for faceting for a search without doing the faceting?

2017-08-10 Thread Michael Joyner
Hey all! Is there a way to determine fields available for faceting (those with data) for a search without actually doing the faceting for the fields? -Mike/NewsRx

Solr LTR with high rerankDocs

2017-08-10 Thread Sebastian Klemke
Hi, we're currently experimenting with LTR reranking on large rerank windows (rerankDocs=1000+). On a >500M documents SolrCloud collection, we were only able to get sub-second response times with FieldValueFeature. Therefore we created a custom feature extractor that matches field values with

SolrDispatchFilter Request Consumption

2017-08-10 Thread Chris Ulicny
Hi all, I've noticed that there are quite a few INFO log entries of the form: "...o.a.s.s.SolrDispatchFilter Could not consume full client request" Should we be worried about these, or is there something wrong with the requests we're making? We aren't noticing anything unexpected in what data

Re: Move index directory to another partition

2017-08-10 Thread Mahmoud Almokadem
Thanks all for your commits. I followed Shawn steps (rsync) cause everything on that volume (ZooKeeper, Solr home and data) and everything went great. Thanks again, Mahmoud On Sun, Aug 6, 2017 at 12:47 AM, Erick Erickson wrote: > bq: I was envisioning a scenario

RE: 6.6.0 getNumShards() NPE?!

2017-08-10 Thread Markus Jelsma
I can now reproduce it on the two shard, two replica cluster. It does NOT happen on the collection_shard1_replica1 and collection_shard2_replica1 nodes. It happens consistently on the collection_shard1_replica2 and collection_shard2_replica2 nodes. Any ideas? -Original message- >

6.6.0 getNumShards() NPE?!

2017-08-10 Thread Markus Jelsma
Hello, Having trouble, again, with CloudDescriptor and friend, getting the number of shards of the collection. It sometimes returns 1 for a collection of two shards. Having this code: cloudDescriptor = core.getCoreDescriptor().getCloudDescriptor(); return

Getting solr source count without using search query every time

2017-08-10 Thread Selvam Raman
​Hi All, ​I am using solr cloud environment to search and index the data. Example Source_field_s: A, B, C, etc ​Expected result: A(100) B(200) C(50), etc ​ Data stored in solr. Every second or 10 seconds i need to get source ​ ​ ​facet( A,B,C)​ to produce statistics. I do not