Re: SQL-like queries (with percent character) - matching an exact substring, with parts of words

2017-02-02 Thread Mikhail Khludnev
Have anybody tried to tweak AnalysingSuggester with ngram token filter to expand such infix queries? On Thu, Feb 2, 2017 at 6:55 PM, Shawn Heisey wrote: > On 2/2/2017 8:15 AM, Maciej Ł. PCSS wrote: > > regardless of the value of such a use-case, there is another thing > >

Re: Solr 6 Facet range query over streaming API

2017-02-02 Thread Joel Bernstein
Currently you would have to supply some custom Streaming Expressions to do the kind of range faceting you are doing above. There are two aggregation Streaming Expressions currently: rollup: Does a MapReduce rollup over buckets. This means all tuples matching a query are sorted and partitioned

Re: Solr querying nested documents with ChildDocTransformerFactory, get “Parent query yields document which is not matched by parents filter”

2017-02-02 Thread Mikhail Khludnev
David, I hardly get the way which IDs are assigned, but beware that repeating uniqueKey value causes deleting former occurrence. In case of block join index it corrupts block structure: parent can't be deleted and left children orphans (.. so touching, I'm sorry). Just make sure that number of

Re: Solr querying nested documents with ChildDocTransformerFactory, get “Parent query yields document which is not matched by parents filter”

2017-02-02 Thread David Kramer
Yes, think of the starving orphan records… Ours is an eCommerce system, selling mostly shoes. We have three levels of nested objects representing what we sell: - Product: Mostly title and description - Item: A specific color and some other attributes, including price. Products have 1 or more

Re: How long for autoAddReplica?

2017-02-02 Thread Hendrik Haddorp
Hi, are you using HDFS? According to the documentation the feature should be only available if you are using HDFS. For me it did however also fail on that. See the thread "Solr on HDFS: AutoAddReplica does not add a replica" from about two weeks ago. regards, Hendrik On 02.02.2017 07:21,

Re: 6.4.0 collection leader election and recovery issues

2017-02-02 Thread Ravi Solr
Following up on my previous email, the intermittent server unavailability seems to be linked to the interaction between Solr and Zookeeper. Can somebody help me understand what this error means and how to recover from it. 2017-02-02 09:44:24.648 ERROR

Re: How to train the model using user clicks when use ltr(learning to rank) module?

2017-02-02 Thread Koji Sekiguchi
Hi, NLP4L[1] has not only Learning-to-Rank module but also a module which calculates click model and converts it into pointwise annotation data. NLP4L has a comprehensive manual[2], but you may want to read "Click Log Analysis" section[3] first to see if it suits your requirements. Hope this

Solr 6.4.0 and deprecated SynonymFilterFactory

2017-02-02 Thread Ere Maijala
Hi, on startup Solr 6.4.0 logs the following warning: o.a.s.c.SolrResourceLoader Solr loaded a deprecated plugin/analysis class [solr.SynonymFilterFactory]. Please consult documentation how to replace it accordingly. What documentation? As far as I can see, there's nothing at

Re: 6.4.0 collection leader election and recovery issues

2017-02-02 Thread Hendrik Haddorp
Might be that your overseer queue overloaded. Similar to what is described here: https://support.lucidworks.com/hc/en-us/articles/203959903-Bringing-up-downed-Solr-servers-that-don-t-want-to-come-up If the overseer queue gets too long you get hit by this:

Re: Solr querying nested documents with ChildDocTransformerFactory, get “Parent query yields document which is not matched by parents filter”

2017-02-02 Thread Mikhail Khludnev
David, Can you make sure your index doesn't have deleted docs? This can be seen in SolrAdmiun. And can you merge index to avoid having them in the index? On Thu, Feb 2, 2017 at 12:29 AM, David Kramer wrote: > > > Some background: > · The data involved is

solr query help

2017-02-02 Thread deepak . ghayal
Hello Sir, I am writting query for getting response from specific index content first. eg. http://192.168.200.14:8983/solr/mypgmee/select?q=*blood*=id:(*/939/* OR **)=id=json=true In above query I am getting response, Means suppose I Get 4 result for course "939" out of 10. It works fine by

Re: Arabic words search in solr

2017-02-02 Thread Steve Rowe
Hi Mohan, I ran your Case #1 through Solr 4.9.0’s Admin UI Analysis pane and I can see the analyzer for the field type “text_ar" analyzer does not remove all diacritics: Indexed original: المؤسسة التجارية العمانية Indexed analyzed: مؤسس تجار عمان Query original: الموسسة التجارية Query

Re: 6.4.0 collection leader election and recovery issues

2017-02-02 Thread Ravi Solr
When i try to rollback from 6.4.0 to my original version of 6.0.1 it now throws another issue. Now I cant go to 6.4.0 nor can I roll back to 6.0.1 Could not load codec 'Lucene62'. Did you forget to add lucene-backward-codecs.jar? at

Solr 6 Facet range query over streaming API

2017-02-02 Thread yauza
While migrating from Solr legacy faceting to Solr streaming API, how to implement the below parameters: = true = {!key=age_ranges}age = 0 = 100 = 10 = {!key=price_ranges}price = 0 = 1000 = 50 = a_field = 1 How can I implement these parameters using the new facet streaming with

Re: Solr 6.4 new SynonymGraphFilter help for multi-word synonyms

2017-02-02 Thread Shawn Heisey
On 2/2/2017 7:36 AM, Cliff Dickinson wrote: > The SynonymGraphFilter API documentation contains the following statement > at the end: > > "To get fully correct positional queries when your synonym replacements are > multiple tokens, you should instead apply synonyms using this TokenFilter > at

Re: SQL-like queries (with percent character) - matching an exact substring, with parts of words

2017-02-02 Thread Maciej Ł. PCSS
Hi Erick, All, regardless of the value of such a use-case, there is another thing that stays unknown for me. Does SOLR support a simple and silly 'exact substring match'? I mean, is it possible to search for (actually filter by) a raw substring without tokenization and without any kind of

Re: Collection will not replicate

2017-02-02 Thread tedsolr
Can I assume that without a leader the shard will not respond to write requests? I can search on the collection. If I can't update docs or add any new docs then this becomes an emergency. Erick Erickson wrote > It's worth a try to take down your entire cluster. Bring one machine > back up at a

Re: 6.4.0 collection leader election and recovery issues

2017-02-02 Thread Ravi Solr
Thanks Hendrik. Iam baffled as to why I did not hit this issue prior to moving to 6.4.0. On Thu, Feb 2, 2017 at 7:58 AM, Hendrik Haddorp wrote: > Might be that your overseer queue overloaded. Similar to what is described > here: >

Re: solr query help

2017-02-02 Thread Shawn Heisey
On 2/2/2017 6:16 AM, deepak.gha...@mediawide.com wrote: > I am writting query for getting response from specific index content first. > eg. > http://192.168.200.14:8983/solr/mypgmee/select?q=*blood*=id:(*/939/* OR > **)=id=json=true > > In above query I am getting response, Means suppose I Get

Solr 6.4 new SynonymGraphFilter help for multi-word synonyms

2017-02-02 Thread Cliff Dickinson
I've been eagerly awaiting the release of the new SynonymGraphFilter in Solr 6.4. We have the need to support multi-word synonyms, which were always problematic with the old SynonymFilterFactory. I've upgraded to Solr 6.4 and replaced the old filter with the new one, but am not seeing the

Re: 6.4.0 collection leader election and recovery issues

2017-02-02 Thread Shawn Heisey
On 2/2/2017 7:23 AM, Ravi Solr wrote: > When i try to rollback from 6.4.0 to my original version of 6.0.1 it now > throws another issue. Now I cant go to 6.4.0 nor can I roll back to 6.0.1 > > Could not load codec 'Lucene62'. Did you forget to add > lucene-backward-codecs.jar? > at

Re: Collection will not replicate

2017-02-02 Thread Erick Erickson
Yes. If indexing went through you'd lose docs so indexing will fail. Querying will fail too unless you set shards.tolerant. You really wouldn't want your docs lost is the reasoning. On Feb 2, 2017 6:56 AM, "tedsolr" wrote: > Can I assume that without a leader the shard

Re: Solr querying nested documents with ChildDocTransformerFactory, get “Parent query yields document which is not matched by parents filter”

2017-02-02 Thread David Kramer
Thanks, for responding. Mikhail. There are no deleted documents. Since I’m fairly new to Solr, one of the things I’ve been paranoid about is I have no way of validating my schema.xml, or know whether Solr is even using it (I have evidence it’s not, more below). So for each test, I’ve wiped

Re: SQL-like queries (with percent character) - matching an exact substring, with parts of words

2017-02-02 Thread Erick Erickson
Well, the *whatever* syntax will work. (that's asterisk-whatever-asterisk if funky bolding happens). You'd use it on a "string" field (unanalyzed, case sensitive) or perhaps on some field with KeywordTokenizerFactory possibly followed by LowercaseFilterFactory if you wanted case-insensitive

Re: SQL-like queries (with percent character) - matching an exact substring, with parts of words

2017-02-02 Thread Shawn Heisey
On 2/2/2017 8:15 AM, Maciej Ł. PCSS wrote: > regardless of the value of such a use-case, there is another thing > that stays unknown for me. > > Does SOLR support a simple and silly 'exact substring match'? I mean, > is it possible to search for (actually filter by) a raw substring > without

Re: Solr 6.4 new SynonymGraphFilter help for multi-word synonyms

2017-02-02 Thread Cliff Dickinson
Steve and Shawn, thanks for your replies/explanations! I eagerly await the completion of the Solr JIRA ticket referenced above in a future release. Many thanks for addressing this challenge that has had me banging my head against my desk off and on for the last couple years! Cliff On Thu, Feb

Re: 6.4.0 collection leader election and recovery issues

2017-02-02 Thread Ravi Solr
Thanks Shawn. Yes I did index some docs after moving to 6.4.0. The release notes did not mention anything about format being changed so I thought it would be backward compatible. Yeah my only recourse is to re-index data. Apart from that it was weird problems overall with 6.4.0. I was excited

Re: How long for autoAddReplica?

2017-02-02 Thread Kevin Risden
> > so migrating by replacing nodes is going to be a bother. Not sure what you mean by migrating and replacing nodes, but these two new actions on the Collections API as of Solr 6.2 may be of use: -

Solr JOIN - Self join within core not working

2017-02-02 Thread Muhammad Zahid Iqbal
Hi, I have a Solr instance setup with one core named as Book (contains total 100 records and a field isprimary:1 has 50 records) When I querying, bring me accurate results (50), its simple I know: http://localhost:7161/solr/Book/select?q=%3A=IsPrimary%3A1=10=xml=true But When I query like this

Re: How long for autoAddReplica?

2017-02-02 Thread Walter Underwood
Oh, missed that limitation. Seems like something that would be very handy in all installations. I don’t see a way to add replicas through the UI, so migrating by replacing nodes is going to be a bother. wunder Walter Underwood wun...@wunderwood.org http://observer.wunderwood.org/ (my blog)

Re: How long for autoAddReplica?

2017-02-02 Thread Erick Erickson
bq: I don’t see a way to add replicas through the UI, so migrating by replacing nodes is going to be a bother There's a lot of improvements in the admin UI for SolrCloud that I'd love to see. Drag/drop replicas would be really cool for instance. At present though using

Re: Solr 6.4 new SynonymGraphFilter help for multi-word synonyms

2017-02-02 Thread Steve Rowe
Hi Cliff, The Solr query parsers (standard/“Lucene” and e/dismax anyway) have a problem that prevents SynonymGraphFilter from working: the text fed to your query analyzer is first split on whitespace. So e.g. a query containing “United States” will never match multi-word synonym “United