Re: solr is using TLS1.0

2018-11-29 Thread Anchal Sharma2
Hi Hendrick This did the trick .Overriding default TLS version for IBM Java enabled TLS 1.2 for solr . Thank you Hendrick /Shawn for your help and suggestions. Thanks & Regards, - Anchal Sharma From: Hendrik Haddorp To:

Re: Time-Routed Alias Not Distributing Wrongly Placed Docs

2018-11-29 Thread Gus Heck
Hi John, TRA's really do require that you index via the alias. Internally the code is wrapping the Distributed Update Processor with an additional processor to handle the time routing when (and only when) the TRA alias is detected. If the alias is not used, none of the TRA code runs (by design,

Re: solr optimize command

2018-11-29 Thread Erick Erickson
Here's the scoop on optimize: https://lucidworks.com/2017/10/13/segment-merging-deleted-documents-optimize-may-bad/ Note the link to how Solr 7.5 is different. Best, Erick On Thu, Nov 29, 2018 at 3:53 PM Shawn Heisey wrote: > > On 11/29/2018 4:41 PM, Christopher Schultz wrote: > > When mine

Re: solr optimize command

2018-11-29 Thread Shawn Heisey
On 11/29/2018 4:41 PM, Christopher Schultz wrote: When mine returned (with wait=true as a request parameter), I got a JSON response telling me how long it took. That's what I would expect. If you have to explicitly include parameters like "wait" or "waitSearcher" to make it block until the

Dataimport UI - shows green even when import fails

2018-11-29 Thread Shawn Heisey
I'm looking into a problem where the admin UI dataimport screen has a green status summary bar even though an import has failed. Here's a screenshot: https://www.dropbox.com/s/94baej11nn75746/dih-green-import-failed.png?dl=0 What I did to get this: Downloaded 7.5.0. Extracted the archive. On

Re: solr optimize command

2018-11-29 Thread Christopher Schultz
-BEGIN PGP SIGNED MESSAGE- Hash: SHA256 Shawn, On 11/29/18 17:56, Shawn Heisey wrote: > On 11/28/2018 6:22 PM, Wei wrote: >> I use the following http request to start solr index >> optimization: >> >> http://localhost:8983/solr//update?skipError=true -F >> stream.body=' ' >> >> The

Re: Similarity plugins which are normalized

2018-11-29 Thread Tanya Bompi
Thanks a lot Doug. Maybe setting more importance to certain fields is the way to go in conjunction with the overall match. Tanu On Thu, Nov 29, 2018 at 1:52 PM Doug Turnbull < dturnb...@opensourceconnections.com> wrote: > The usual advice is relevance scores don’t exist on a scale where a >

RE: KeywordRepeat, stemming, (single term) synonyms and minimum should match (edismax)

2018-11-29 Thread Markus Jelsma
Hello, Sorry for trying this once more. Is there anyone around who can help me, and perhaps others, on this subject and the linked Jira ticket and failing test? I could really need some help from someone who is really familiar with edismax code and the underlying QueryBuilder parts that are

Re: solr optimize command

2018-11-29 Thread Shawn Heisey
On 11/28/2018 6:22 PM, Wei wrote: I use the following http request to start solr index optimization: http://localhost:8983/solr//update?skipError=true -F stream.body=' ' The request returns status code 200 shortly, but when looking at the solr instance I noticed that actual optimization has

Re: Documentation on SolrJ

2018-11-29 Thread Shawn Heisey
On 11/29/2018 2:01 PM, Thomas L. Redman wrote: Hi! I am wanting to do nested facets/Grouping/Expand-Collapse using SolrJ, and I can find no API for that. I see I can add a pivot field, I guess to a query in general, but that doesn’t seem to work at all, I get an NPE. The documentation on

Re: Similarity plugins which are normalized

2018-11-29 Thread Doug Turnbull
The usual advice is relevance scores don’t exist on a scale where a threshold is useful. As these are just heuristics used for ranking , not a confidence level. I would instead focus on what attributes of a document consider it relevant or not (strong match in certain fields). A couple of things

Similarity plugins which are normalized

2018-11-29 Thread Tanya Bompi
Hi, As I am tuning the relevancy of my query parser, I see that 2 different queries with phrase matches get very different scores primarily influenced by the Term Frequency component. Since I am using a threshold to filter the results for a matched record based off the SOLR score, a somewhat

Documentation on SolrJ

2018-11-29 Thread Thomas L. Redman
Hi! I am wanting to do nested facets/Grouping/Expand-Collapse using SolrJ, and I can find no API for that. I see I can add a pivot field, I guess to a query in general, but that doesn’t seem to work at all, I get an NPE. The documentation on SolrJ is sorely lacking, the documentation I have

Re: REBALANCELEADERS is not reliable

2018-11-29 Thread Atita Arora
Indeed, I tried that on 7.4 & 7.5 too, indeed did not work for me as well, even with the preferredLeader property as recommended in the documentation. I handled it with a little hack but certainly this dint work as expected. I can provide more details if there's a ticket. On Thu, Nov 29, 2018 at

Re: REBALANCELEADERS is not reliable

2018-11-29 Thread Aman Tandon
++ correction On Fri, Nov 30, 2018, 01:10 Aman Tandon For me today, I deleted the leader replica of one of the two shard > collection. Then other replicas of that shard wasn't getting elected for > leader. > > After waiting for long tried the setting addreplicaprop preferred leader > on one of

Re: REBALANCELEADERS is not reliable

2018-11-29 Thread Aman Tandon
For me today, I deleted the leader replica of one of the two shard collection. Then other replica of that shard was getting elected for leader. After waiting for long tried the setting addreplicaprop preferred leader on one of the replica then tried FORCELEADER but no luck. Then also tried

Re: Streaming Expressions GET vs POST

2018-11-29 Thread Gus Heck
Related... https://issues.apache.org/jira/browse/SOLR-9759 On Sat, Nov 24, 2018, 3:38 PM Jan Høydahl Filed SOLR-13014 > > -- > Jan Høydahl, search solution architect > Cominvent AS - www.cominvent.com > > > 23. nov. 2018 kl. 16:03 skrev Jan

Re: Flatten term frequency

2018-11-29 Thread Vincenzo D'Amore
Hi, an update: I've found another alternative while reading the valuable post written by Doug. In short, I should split the field "title" in two fields: title_notf and title_phrase. title_notf is without term frequency (with omitTermFreqAndPositions=true) for matching queries and title_phrase

Re: Enquiry about scheduling for re-indexing

2018-11-29 Thread Shawn Heisey
On 11/29/2018 6:00 AM, Alexandre Rafalovitch wrote: Solr does not have a built-in scheduler for triggering indexing. Only for triggering commits and purging auto-expiring records. So, if you want to trigger DIH indexing, you need to use an external scheduling mechanism for that. What

Re: Flatten term frequency

2018-11-29 Thread Vincenzo D'Amore
Yep, that makes sense. And given that an omitTermFreq parameter does not exist, if I use omitTermFreqAndPositions then phrase queries won't work. So it seems there are no chances, the only way is write own similarity class. On Thu, Nov 29, 2018 at 4:15 PM Alexandre Rafalovitch wrote: > You are

Re: solr wiki

2018-11-29 Thread Shawn Heisey
On 11/29/2018 5:58 AM, Gary Sieling wrote: Can I be added to the Solr wiki contributors list? Username: garysieling Done.

Re: Advisory questions

2018-11-29 Thread Shawn Heisey
On 11/29/2018 5:27 AM, Ana Mercan (RO) wrote: I have tried to subscribe to general forums but i wasn't able to, hence i would appreciate if we can keep this thread and have the replies over email. The project does not have forums.  Only mailing lists and an IRC channel.  There are third

Solr5.4: Trouble to use Xml Nested Documents

2018-11-29 Thread Bruno Mannina
Dear Solr Users, I would like to use solr to do searches on a hierarchical structure (for knowers CPC and IPC). Constraint: I use SOLR5.4 and I can't upgrade it. I succeed to import my xml source file (see at the end of this post for the xml file) I succeed to search into. But I always

Re: Flatten term frequency

2018-11-29 Thread Alexandre Rafalovitch
You are trying to use this in the field list, but the documentation only talks about this being valid in the query clause itself. Which perhaps makes it a bit less useful for your case, but does not look like a bug. Regards, Alex. On Thu, 29 Nov 2018 at 10:06, Vincenzo D'Amore wrote: > > Hi

Re: Flatten term frequency

2018-11-29 Thread Vincenzo D'Amore
Hi thanks for your prompt reply :) I thought the constant score should be the easiest way, unexpectedly when I tried to specify constant score in qf field an exception has been raised. So I've configured the constant score into solrconfig.xml file : combiField

Solr Cloud in AWS

2018-11-29 Thread Pavel Micka
Hi, Is there any well established vendor offering Solr Cloud as a service in different AWS regions? Or what is the easiest way to get Solr Cloud running in AWS? We already have K8s with Helm, but unfortunately it seems that there is no Helm Chart available... Thanks, Pavel

Re: solr optimize command

2018-11-29 Thread Christopher Schultz
-BEGIN PGP SIGNED MESSAGE- Hash: SHA256 Wei, On 11/28/18 20:22, Wei wrote: > Hi, > > I use the following http request to start solr index optimization: > > http://localhost:8983/solr//update?skipError=true -F > stream.body=' ' > > > The request returns status code 200 shortly, but

Re: is SearchComponent the correct way?

2018-11-29 Thread Mikhail Khludnev
@Override public void collect(int doc) throws IOException { docNumsByIds.put(context.reader().doc(doc).getField("id"), doc); // don't call delegate } @Override protected void doSetNextReader(LeafReaderContext context) throws IOException { flush(); // strictly before the

Re: Flatten term frequency

2018-11-29 Thread Doug Turnbull
I think the similarity way (setting k1 to 0) or a constant score query are probably the best ways. Omitting term freqs and position will also remove positions meaning phrase queries won’t work. This blog article might be useful for your use case. I discuss a similar prob.

solr wiki

2018-11-29 Thread Gary Sieling
Can I be added to the Solr wiki contributors list? Username: garysieling Thanks Gary

Re: Enquiry about scheduling for re-indexing

2018-11-29 Thread Alexandre Rafalovitch
Solr does not have a built-in scheduler for triggering indexing. Only for triggering commits and purging auto-expiring records. So, if you want to trigger DIH indexing, you need to use an external scheduling mechanism for that. Regards, Alex. On Thu, 29 Nov 2018 at 01:03, Ma Man wrote: > >

Re: Flatten term frequency

2018-11-29 Thread Alexandre Rafalovitch
Perhaps constant score would be useful here: http://lucene.apache.org/solr/guide/7_5/the-standard-query-parser.html#constant-score-with Also, all the options like omitTermFreqAndPositions are described here:

Advisory questions

2018-11-29 Thread Ana Mercan (RO)
Hello, I have tried to subscribe to general forums but i wasn't able to, hence i would appreciate if we can keep this thread and have the replies over email. I want to have more background about the dependencies of solr/zookeeper services and the task schedulers -ful/incremental indexing. So in

Re: is SearchComponent the correct way?

2018-11-29 Thread John Thorhauer
So my understanding is that the DelegatingCollector.collect() method has access to a single doc. At that point I must choose to either call super.collect() or not. So this is the point at which I have to check redis for security data for a single doc and determine if this doc should be allowed

Flatten term frequency

2018-11-29 Thread Vincenzo D'Amore
Hi all, I have a relevancy problem, I suppose to know a solution for this problem but I would like to know if in your experience there is a better one. For example I have two documents which have the "termA" in their field "title", the former has the "termA" repeated more times but the latter