Creating 100000 dynamic fields in solr

2020-05-10 Thread Vignan Malyala
Hi Is it good idea to create 10 dynamic fields of time pint in solr? I have that many fields to search on actually which come upon based on users. Thanks in advance! And I'm using Solr Cloud in real-time. Regards, Sai Vignan M

Re: Response Time Diff between Collection with low deletes

2020-05-10 Thread matthew sporleder
Why so many shards? > On May 10, 2020, at 9:09 PM, Ganesh Sethuraman > wrote: > > We are using dedicated host, Cent OS in EC2 r5.12xlarge (48 CPU, ~360GB > RAM), 2 nodes. Swapiness set to 1. With General purpose 2T EBS SSD volume. > JVM size of 18gb, with G1 GC enabled. About 92 collection

Re: Response Time Diff between Collection with low deletes

2020-05-10 Thread Ganesh Sethuraman
We are using dedicated host, Cent OS in EC2 r5.12xlarge (48 CPU, ~360GB RAM), 2 nodes. Swapiness set to 1. With General purpose 2T EBS SSD volume. JVM size of 18gb, with G1 GC enabled. About 92 collection with average of 8 shards and 2 replica each. Most of updates over daily batch updates.

Re: Secure communication between Solr and Zookeeper

2020-05-10 Thread ChienHuaWang
Hi Jan, Could you advise more detail in step by step how we setup between Solr & Zookeeper? Do we need to put jetty-all.jar of Zookeeper 3.5.5 to the classpath of Solr? or it has been taken care? What's the configuration we need for SSL-enabled Zookeeper to communicate with Solr? -- Sent

Re: Response Time Diff between Collection with low deletes

2020-05-10 Thread Shawn Heisey
On 5/10/2020 4:48 PM, Ganesh Sethuraman wrote: The additional info is that when we execute the test for longer (20mins) we are seeing better response time, however for a short test (5mins) and rerun the test after an hour or so we are seeing slow response times again. Note that we don't update

Re: Response Time Diff between Collection with low deletes

2020-05-10 Thread Ganesh Sethuraman
Here is a quick update based on your question, and few additional information that will help The additional info is that when we execute the test for longer (20mins) we are seeing better response time, however for a short test (5mins) and rerun the test after an hour or so we are seeing slow

Re: Secure communication between Solr and Zookeeper

2020-05-10 Thread Jan Høydahl
Not documented yet, see https://issues.apache.org/jira/browse/SOLR-7893 Jan Høydahl > 10. mai 2020 kl. 12:48 skrev ChienHuaWang : > > Hi, > Does anyone figure how to handle the TLS between Solr and Zookeeper? > From Solr doc, I only find the Solr internal communication, no specific > detail

Re: Which solrconfig.xml and schema file should I start with?

2020-05-10 Thread Jan Høydahl
Choose whichever example is closest to what you want to do. Then strip it down removing everything you don’t use. Note that _default configset has schema guessing enabled which you don’t want in production. Jan Høydahl > 9. mai 2020 kl. 22:34 skrev Steven White : > > Hi everyone, > > There

Re: solr suggest is not replicated

2020-05-10 Thread Walter Underwood
I wrote some Python for updating a collection config. An optional part of that is to go to each replica and start a suggester build. If your collection is sharded and you load from a dictionary, you’ll also need to add distrib=false to the queries, otherwise you’ll get suggest results from

Re: Response Time Diff between Collection with low deletes

2020-05-10 Thread Erick Erickson
Do not, repeat NOT expungeDelete after each deleteByQuery, it is a very expensive operation. Perhaps after the nightly batch, but I doubt that’ll help much anyway. 30% deleted docs is quite normal, and should definitely not change the response time by a factor of 100! So there’s some other issue

Re: Secure communication between Solr and Zookeeper

2020-05-10 Thread ChienHuaWang
Hi, Does anyone figure how to handle the TLS between Solr and Zookeeper? >From Solr doc, I only find the Solr internal communication, no specific detail about how zookeeper should be handled. Appreciate any suggestion, thanks. -- Sent from:

solr suggest is not replicated

2020-05-10 Thread morph3us87
Hello, I want to use solr suggest (https://lucene.apache.org/solr/guide/8_2/suggester.html) in a solr cloud with replication. We are using solr cloud with 2 nodes. To build up the suggest I have to call "suggest.buildAll=true". I do it this way: - Ask Zookeeper for a Solr Node, it will