The Impact of the Number of Collections on Indexing Performance in Solr 6.0

2018-03-09 Thread 苗海泉
hello,We found a problem. In solr 6.0, the indexing speed of solr is influenced by the number of solr collections. The speed is normal before the limit is reached. If the limit is reached, the indexing speed will decrease by 50 times. In our environment, there are 49 solr nodes. If each

Re: HDInsight with Solr 4.9.0 Create Collection

2018-03-09 Thread Shawn Heisey
On 3/9/2018 10:41 AM, Abhi Basu wrote: > That was due to a folder not being present. Is this something to do with > version? > > http://hn0-esohad.mzwz3dh4pb1evcdwc1lcsddrbe.jx.internal.cloudapp.net:8983/solr/admin/collections?action=CREATE=ems-collection2=2=2=1 > >

Re: Setting Up Solr Authentication/Authorization

2018-03-09 Thread Shawn Heisey
On 3/9/2018 9:27 AM, Terry Steichen wrote: > I'm trying to set up basic authentication/authorization with solr 6.6.0. > > The documentation says to create a security.json file and describes the > content as: > > { > "authentication":{ >"class":"solr.BasicAuthPlugin", >

Re: Altering the query if query contains all stopwods

2018-03-09 Thread Rick Leir
Tav, Ryan Now you have me wondering, should it be returning *:* or some general landing page. Suppose you had typeahead or autocomplete, it should ignore any stopwords list. By the way, people on this list have had good reasons why we should stop using stopwords. Cheers -- Rick On March 9,

Re: CDCR performance issues

2018-03-09 Thread Erick Erickson
John: _What_ did you try and how did it fail? Please follow the instructions here: http://lucene.apache.org/solr/community.html#mailing-lists-irc . You must use the _exact_ same e-mail as you used to subscribe. If the initial try doesn't work and following the suggestions at the "problems"

Re: LTR Model size

2018-03-09 Thread Erick Erickson
Spoonerk: Please follow the instructions here: http://lucene.apache.org/solr/community.html#mailing-lists-irc . You must use the _exact_ same e-mail as you used to subscribe. If the initial try doesn't work and following the suggestions at the "problems" link doesn't work for you, let us know.

Re: HDInsight with Solr 4.9.0 Create Collection

2018-03-09 Thread john spooner
would be nice to not get this email. On 3/9/2018 1:23 PM, Abhi Basu wrote: This has been resolved! Turned out to be schema and config file version diff between 4.10 and 4.9. Thanks, Abhi On Fri, Mar 9, 2018 at 11:41 AM, Abhi Basu <9000r...@gmail.com> wrote: That was due to a folder not

Re: HDInsight with Solr 4.9.0 Create Collection

2018-03-09 Thread Abhi Basu
This has been resolved! Turned out to be schema and config file version diff between 4.10 and 4.9. Thanks, Abhi On Fri, Mar 9, 2018 at 11:41 AM, Abhi Basu <9000r...@gmail.com> wrote: > That was due to a folder not being present. Is this something to do with > version? > >

Re: LTR Model size

2018-03-09 Thread Roopa Rao
Is there a way to patch the fix to use a external model to Solr 6.6 ? Thanks, Roopa On Fri, Mar 9, 2018 at 1:30 PM, tapan1707 wrote: > Could you elaborate a little bit more? Otherwise, I think that you might be > experiencing the same issue reported in >

Re: CDCR performance issues

2018-03-09 Thread john spooner
please unsubscribe i tried to manaually unsubscribe On 3/9/2018 12:59 PM, Tom Peters wrote: Thanks. This was helpful. I did some tcpdumps and I'm noticing that the requests to the target data center are not batched in any way. Each update comes in as an independent update. Some follow-up

Re: CDCR performance issues

2018-03-09 Thread Tom Peters
Thanks. This was helpful. I did some tcpdumps and I'm noticing that the requests to the target data center are not batched in any way. Each update comes in as an independent update. Some follow-up questions: 1. Is it accurate that updates are not actually batched in transit from the source to

Re: LTR Model size

2018-03-09 Thread spoonerk
Please unsubscribe me. I have tried and tried but still get emails On Mar 9, 2018 10:19 AM, "Roopa Rao" wrote: > what is the way to configure the model size for LTR? We have about 3MB > model and Solr is not holding this model as a ManagedResource. > > How can this be

Re: LTR Model size

2018-03-09 Thread Roopa Rao
Thank you, this is exactly what I am facing. There is a mention of increasing jute.maxbuffer in the Jira I will try that option. Thanks, Roopa On Fri, Mar 9, 2018 at 1:30 PM, tapan1707 wrote: > Could you elaborate a little bit more? Otherwise, I think that you might be

Re: Large number of HTTP requests to Solr-5.2.1 throwing errors

2018-03-09 Thread Shawn Heisey
On 3/8/2018 1:21 PM, Deeksha Sharma wrote: > Version of Solr : Solr-5.2.1 > I am sending large number of HTTP GET requests to Solr server for querying > indexes. These requests to Solr are generated via a Node.js service. > > When the number of requests to Solr are ~250, I am intermittently

Re: LTR Model size

2018-03-09 Thread tapan1707
Could you elaborate a little bit more? Otherwise, I think that you might be experiencing the same issue reported in https://issues.apache.org/jira/browse/SOLR-11049 . Default zookeeper znode limit is 1mb, so I think it might not be able to handle the size of your model. Correct me if I

LTR Model size

2018-03-09 Thread Roopa Rao
what is the way to configure the model size for LTR? We have about 3MB model and Solr is not holding this model as a ManagedResource. How can this be configured? Thanks, Roopa

Re: Altering the query if query contains all stopwods

2018-03-09 Thread tapan1707
Hello Ryan, Solr has a Filter class called solr.SuggestStopFilterFactory, which basically works similar to solr.StopFilterFactory but with a slight modification that if all of the words are present in stopwords.txt then it won't remove the last one. I am not sure about wildcard search but if all

Re: Matching Queries with Wildcards and Numbers

2018-03-09 Thread tapan1707
Hello Rakesh, As pointed out by Erick, changing *catenateAll* from 0 to 1 should work. What this means is that, generateWordParts="1" generates tokens for words for e.g. in the case of i-pad, it generates i, pad and ipad.and generateNumberParts="1" generates tokens for numbers for e.g in the case

Re: HDInsight with Solr 4.9.0 Create Collection

2018-03-09 Thread Abhi Basu
That was due to a folder not being present. Is this something to do with version? http://hn0-esohad.mzwz3dh4pb1evcdwc1lcsddrbe.jx.internal.cloudapp.net:8983/solr/admin/collections?action=CREATE=ems-collection2=2=2=1 org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException:Error

Re: Matching Queries with Wildcards and Numbers

2018-03-09 Thread rakeshaspl
Do you find any solution for above issue ? -- Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f472068.html

Re: Matching Queries with Wildcards and Numbers

2018-03-09 Thread rakeshaspl
Hi, Do you find any solution for above issue? Br, Rakesh -- Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f472068.html

Re: HDInsight with Solr 4.9.0 Create Collection

2018-03-09 Thread Abhi Basu
Ok, so I tried the following: /usr/hdp/current/solr/example/scripts/cloud-scripts/zkcli.sh -cmd upconfig -zkhost zk0-esohad.mzwz3dh4pb1evcdwc1lcsddrbe.jx.internal.cloudapp.net:2181 -confdir /home/sshuser/abhi/ems-collection/conf -confname ems-collection And got this exception:

Re: HDInsight with Solr 4.9.0 Create Collection

2018-03-09 Thread Abhi Basu
Thanks for the reply, this really helped me. For Solr 4.9, what is the actual zkcli command to upload config? java -classpath example/solr-webapp/WEB-INF/lib/* org.apache.solr.cloud.ZkCLI -cmd upconfig -zkhost 127.0.0.1:9983 -confdir example/solr/collection1/conf -confname conf1 -solrhome

Setting Up Solr Authentication/Authorization

2018-03-09 Thread Terry Steichen
I'm trying to set up basic authentication/authorization with solr 6.6.0. The documentation says to create a security.json file and describes the content as: { "authentication":{ "class":"solr.BasicAuthPlugin", "credentials":{"solr":"IV0EHq1OnNrj6gvRCwvFwTrZ1+z1oBbnQdiVC3otuq0=

RE: CDCR performance issues

2018-03-09 Thread Davis, Daniel (NIH/NLM) [C]
These are general guidelines, I've done loads of networking, but may be less familiar with SolrCloud and CDCR architecture. However, I know it's all TCP sockets, so general guidelines do apply. Check the round-trip time between the data centers using ping or TCP ping. Throughput tests may