Re: Need help with match contains query in SOLR

2018-03-01 Thread Emir Arnautović
Hi, Is the size of phrases in index arbitrary or only two words? Do you need to apply some standardisations on individual words? Depending on the answers indexing will be different, but the goal is to index phrase as a single token (might need some custom token filter). At search time, you do

Re: is it appropriate to use external cache for whole shards

2018-03-01 Thread park
Thank you for answer. We will improve our system based on what you said. -- Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f472068.html

Re: SolrCloud 7.2.1 - UnsupportedOperationException thrown after query on specific environments

2018-03-01 Thread Erick Erickson
bq: These errors only occur when we run this job from our remote job server Maybe your remote job server is using a different set of jars than your local one? How does the remote job server work? No log snippets came through BTW, so I'm guessing a bit. The Apache mail server is quite aggressive

Re: Solr thread problems

2018-03-01 Thread Shawn Heisey
On 3/1/2018 4:31 AM, 苗海泉 wrote: My question is, what is the relationship between the number of threads in the commitScheduler thread pool and what? The number of searcherExecutor thread pool and the above have a relationship, why so much, thank you! I don't understand this question.  Can you

Re: statistics in hitlist

2018-03-01 Thread Joel Bernstein
The field type will also need to be in the schema: Joel Bernstein http://joelsolr.blogspot.com/ On Thu, Mar 1, 2018 at 8:00 PM, Joel Bernstein wrote: > You'll need to have this field in your schema: > > > > I'll check to see if the default schema used with solr start

Re: statistics in hitlist

2018-03-01 Thread Joel Bernstein
You'll need to have this field in your schema: I'll check to see if the default schema used with solr start -c has this field, if not I'll add it. Thanks for pointing this out. I checked and right now the random expression is only accepting one fq, but I consider this a bug. It should accept

Word / PDF document snippet rendering in search

2018-03-01 Thread T Wild
I'm interested in building a software system which will connect to various document sources, extract the content from the documents contained within each source, and make the extracted content available to a search engine such Solr. This search engine will serve as the back-end for a web-based

Re: Need help with match contains query in SOLR

2018-03-01 Thread bbarani
The problem with pf2 is that it will return the document if it matches loosely too and then I need to do a comparison to see whether the match was a complete phrase match OR not before actually using the result. It would become a 2 step process.. -- Sent from:

Re: solr src 6.0 ant error

2018-03-01 Thread 苗海泉
thank you Erick Erickson 于2018年3月1日 周四23:40写道: > Ant 1.10.1 works as well, it's a bug in ant... > > On Mar 1, 2018 06:27, "苗海泉" wrote: > > > thank you for reply,i'm try and everything is ok. > > > > 2018-03-01 22:06 GMT+08:00 thunderz.solr

Re: Need help with match contains query in SOLR

2018-03-01 Thread Rick Leir
Hi Would a pf2 boost suit your needs? You would match loosely on any term, and your results containing bigrams would be at the top. HTH -- Rick On March 1, 2018 11:54:19 AM EST, bbarani wrote: >Hi, > >I want to do a complete "phrase contain" match. > >For ex: Value is

Re: statistics in hitlist

2018-03-01 Thread John Smith
Joel, thanks for the pointers to the streaming feature. I had no idea solr had that (and also just discovered the very intersting sql feature! I will be sure to investigate that in more detail in the future). However I'm having some trouble getting basic streaming functions working. I've already

SolrCloud 7.2.1 - UnsupportedOperationException thrown after query on specific environments

2018-03-01 Thread Andy Jolly
We are receiving an UnsupportedOperationException after making certain requests. The requests themselves do not seem to be causing the issue as when we run the job that makes these requests locally against the same SolrCloud cluster where the errors are being thrown, there are no errors. These

Re: Synonym not working in 4.10 / CDH 5.14

2018-03-01 Thread Abhi Basu
Thanks for your help. Abhi On Thu, Mar 1, 2018 at 2:06 PM, Steve Rowe wrote: > Yes, either type “text_general” or some other TextField-based field type > that includes a synonym filter. > > -- > Steve > www.lucidworks.com > > > On Mar 1, 2018, at 3:02 PM, Abhi Basu

Re: Synonym not working in 4.10 / CDH 5.14

2018-03-01 Thread Steve Rowe
Yes, either type “text_general” or some other TextField-based field type that includes a synonym filter. -- Steve www.lucidworks.com > On Mar 1, 2018, at 3:02 PM, Abhi Basu <9000r...@gmail.com> wrote: > > Yes, agreed. Just tested and it works. :) > > I will have a lot more fields, so every

Re: Synonym not working in 4.10 / CDH 5.14

2018-03-01 Thread Abhi Basu
Yes, agreed. Just tested and it works. :) I will have a lot more fields, so every field I need a synonym feature for will have to be type "text_general", right? On Thu, Mar 1, 2018 at 1:57 PM, Steve Rowe wrote: > I think you want type=“text_general” > > -- > Steve >

Re: Synonym not working in 4.10 / CDH 5.14

2018-03-01 Thread Steve Rowe
I think you want type=“text_general” -- Steve www.lucidworks.com > On Mar 1, 2018, at 2:19 PM, Abhi Basu <9000r...@gmail.com> wrote: > > Should it be defined as this instead? > > stored="true" docValues="true"/> > > > > On Thu, Mar 1, 2018 at 1:16 PM, Abhi Basu <9000r...@gmail.com> wrote:

Re: Indexing timeout issues with SolrCloud 7.1

2018-03-01 Thread Tom Peters
Thanks Erick. I found an older mailing list thread online where someone had similar issues to what I was experiencing (http://lucene.472066.n3.nabble.com/SolrCloud-delete-by-query-performance-td4206726.html

Re: Synonym not working in 4.10 / CDH 5.14

2018-03-01 Thread Abhi Basu
Should it be defined as this instead? On Thu, Mar 1, 2018 at 1:16 PM, Abhi Basu <9000r...@gmail.com> wrote: > What should PropertyAddressState type be in order to be caught into the > text_general config below? > > I have remeoved the copyfield now. > > docValues="true"/> > > > > >

Re: Synonym not working in 4.10 / CDH 5.14

2018-03-01 Thread Abhi Basu
What should PropertyAddressState type be in order to be caught into the text_general config below? I have remeoved the copyfield now. On Thu, Mar 1, 2018 at 1:12 PM, Steve Rowe wrote: > Hi Abhi, > >

Re: Synonym not working in 4.10 / CDH 5.14

2018-03-01 Thread Steve Rowe
Hi Abhi, PropertyAddressState is of type “string”, which has no analysis applied. Since you copyfield to “text” field, which has the analysis you expect, you could try querying it instead. -- Steve www.lucidworks.com > On Mar 1, 2018, at 12:23 PM, Abhi Basu <9000r...@gmail.com> wrote: > >

Re: Synonym not working in 4.10 / CDH 5.14

2018-03-01 Thread Abhi Basu
I am testing the index analyzer first. Do I need to turn on the query analyzer too? synonyms.txt Alabama, AL Alaska, AK Arizona, AZ Arkansas, AR California, CA Colorado, CO Connecticut, CT Delaware, DE Florida, FL Georgia, GA Hawaii, HI Idaho, ID Illinois, IL Indiana, IN Iowa, IA etc ... On

Re: Synonym not working in 4.10 / CDH 5.14

2018-03-01 Thread Alessandro Hoss
How's your synonyms declared in the file? That xml comment () in the synonym filter section isn't there in your running solr schema.xml, right? :) On Thu, Mar 1, 2018 at 2:53 PM Abhi Basu <9000r...@gmail.com> wrote: > Yes have tested with PA and NY, nothing works. > > On Thu, Mar 1, 2018 at

Re: Synonym not working in 4.10 / CDH 5.14

2018-03-01 Thread Abhi Basu
Yes have tested with PA and NY, nothing works. On Thu, Mar 1, 2018 at 11:38 AM, Alessandro Hoss wrote: > Have you tested with another state? > > I'm asking because maybe solr is considering "OR" as a clause separator > instead of a search term, and in this case the problem is

Re: Synonym not working in 4.10 / CDH 5.14

2018-03-01 Thread Alessandro Hoss
Have you tested with another state? I'm asking because maybe solr is considering "OR" as a clause separator instead of a search term, and in this case the problem is not with synonym, it is with your query. On Thu, Mar 1, 2018 at 2:24 PM Abhi Basu <9000r...@gmail.com> wrote: > Can someone

Solr Collection Loosing Leader

2018-03-01 Thread Aaryan Reddy
Hello All, I am running into frequent issue where the leader shard in solr cloud stays active but does not acknowledge as "leader" . This brings down the other replicas as they go into to recovery mode and eventually fail trying to sync up. The error seen in "solr.log" is below: { this also

Synonym not working in 4.10 / CDH 5.14

2018-03-01 Thread Abhi Basu
Can someone please help me? Schema.xml Synonyms.txt has been populated with State abbreviations and names. When searching for PropertyAddressState:"Oregon", I do not find docs with "OR". What am I missing? Thanks, Abhi

Re: Need help with match contains query in SOLR

2018-03-01 Thread bbarani
Hi, I want to do a complete "phrase contain" match. For ex: Value is stored as below in the multivalued field 1 transfer responsibility transfer account *Positive cases: (when it should return this document)* searchTerms:how to transfer responsibility searchTerms:show me ways to transfer

Re: solr src 6.0 ant error

2018-03-01 Thread Erick Erickson
Ant 1.10.1 works as well, it's a bug in ant... On Mar 1, 2018 06:27, "苗海泉" wrote: > thank you for reply,i'm try and everything is ok. > > 2018-03-01 22:06 GMT+08:00 thunderz.solr : > > > 苗海泉 wrote > > > I encountered a problem, when I was in the

ShingleFilterFactory - multiple fields with an OR operator

2018-03-01 Thread damian.pawski
Hi I have two fields on which I have applied *ShingleFilterFactory*, when I am searching against each field separately everything is working fine, but when I try to combine two searches with an *OR* statement then I am getting wrong results. For an example /FieldOne:(business analysts) I am

Re: solr src 6.0 ant error

2018-03-01 Thread 苗海泉
thank you for reply,i'm try and everything is ok. 2018-03-01 22:06 GMT+08:00 thunderz.solr : > 苗海泉 wrote > > I encountered a problem, when I was in the process of compiling solr6.0 > > source error, I have installed the ant and ivy, and then solr6 source > code > >

Re: solr src 6.0 ant error

2018-03-01 Thread thunderz.solr
苗海泉 wrote > I encountered a problem, when I was in the process of compiling solr6.0 > source error, I have installed the ant and ivy, and then solr6 source code > catalog Executive eclipse ant eclipse would like to generate a project > error as follows " > Buildfile: D: \ solr-6.0.0-src \

Solr thread problems

2018-03-01 Thread 苗海泉
I jstack through the analysis of our solr thread found that the total number of threads 1169 of which 1037 threads are the wait state, the 1037 threads, there are two types of threads is very large, 486 threads with same trace trace searcherExecutor-5694-thread -1, searcherExecutor-5694-thread-1

Re: When the number of collections exceeds one thousand, the construction of indexing speed drops sharply

2018-03-01 Thread 苗海泉
Thank you for your advice on gc tools, what do you suggest to me? 2018-02-28 23:57 GMT+08:00 Shawn Heisey : > On 2/28/2018 2:53 AM, 苗海泉 wrote: > >> Thanks for your detailed advice, the monitor product you are talking about >> is good, but our solr system is running on a