Re: Multiple solr instances per host vs Multiple cores in same solr instance

There was no real bottleneck. I just started with 30QPS and after that just doubled the QPS. But as you mentioned I used my specific data and analysis, and also used SWD (german keyword norm data) dictionary for querying. Regards, Bernd Am 27.08.2018 um 15:41 schrieb Jan Høydahl: What was

Re: “solr.data.dir” can only config a single directory

Every _replica_ can point to a different disk. When you do an ADDREPLICA, then you can supply whatever path to the data you desire. And you can have as many replicas per Solr instance as makes sense. Best, Erick On Mon, Aug 27, 2018 at 8:48 PM zhenyuan wei wrote: > > @Christopher Schultz > So

Re: “solr.data.dir” can only config a single directory

@Christopher Schultz So you mean that one 4TB disk is the same as four 1TB disks ? HDFS、cassandra、ES can do so, multi data path maybe maximize indexing throughput in same cases. click links with some explain

Re: “solr.data.dir” can only config a single directory

Is there any issue exists already？my all solr instances (30 or more in the future ) maybe using this feature because all host will be 4 or more mounted disks. I am interesting to watching this feature, and make a contribution to that in some way if possiable. Shawn Heisey 于2018年8月28日周二

Spring Content Error in Plugin

Hi, We have a custom java plugin that leverages the UpdateRequestProcessorFactory to push data to multiple cores when a single core is written to. We are building the plugin with maven, deploying it to /solr/lib and sourcing the jar via a lib directive in our solr config. It currently works

Re: “solr.data.dir” can only config a single directory

-BEGIN PGP SIGNED MESSAGE- Hash: SHA256 Shawn, On 8/27/18 22:37, Shawn Heisey wrote: > On 8/27/2018 8:29 PM, zhenyuan wei wrote: >> I found the “solr.data.dir” can only config a single directory. >> I think it is necessary to be config multi dirs，such as >>

Re: “solr.data.dir” can only config a single directory

On 8/27/2018 8:29 PM, zhenyuan wei wrote: I found the “solr.data.dir” can only config a single directory. I think it is necessary to be config multi dirs，such as ”solr.data.dir:/mnt/disk1,/mnt/disk2,/mnt/disk3" ， due to one disk overload or capacity limitation. Any reason to support

“solr.data.dir” can only config a single directory

Hi all, I found the “solr.data.dir” can only config a single directory. I think it is necessary to be config multi dirs，such as ”solr.data.dir:/mnt/disk1,/mnt/disk2,/mnt/disk3" ， due to one disk overload or capacity limitation. Any reason to support why not do so？ Best, TinsWzy

Re: An exception when running Solr on HDFS，why a solr server can not recognize the write.lock file is created by itself before？

@Shawn Heisey Yeah, delete "write.lock" files manually is ok finally。 @Walter Underwood Have some performace evaluation about Solr on HDFS vs LocalFS recently? Shawn Heisey 于2018年8月28日周二 上午4:10写道： > On 8/26/2018 7:47 PM, zhenyuan wei wrote: > > I found an exception when running Solr on

Re: [help!] java.lang.NoSuchMethodError: org.apache.solr.client.solrj.request.schema.SchemaRequest

Thanks for letting us know about the source of the problem. -- Steve www.lucidworks.com > On Aug 27, 2018, at 3:15 PM, yx zhou wrote: > > i found the root cause, it is my setting > > >org.noggit >noggit > > > It's has duplicate (version conflict) in my

cloud disk space utilization

Hi, We have six Solr nodes with ~1TiB disk space on each mounted as ext4. The indexers sometimes update the collections and create new ones if update wouldn't be faster than scratch indexing. (up to around 5 million documents are indexed for each collection) On average there are around 130

Re: unique() in the JSON facets doesn’t count all the different values in a field

I just found out reading the Solr ref. guide for 7.1 that: > • JSON Facet API now uses hyper-log-log for numBuckets cardinality > calculation and calculates cardinality Unfortunately the HTML ref. guide for version 7.1 didn’t contain any documentation regarding the JSON facet API. I’ve checked

Re: Multiple solr instances per host vs Multiple cores in same solr instance

Thanks Bernd. Do you have preferLocalShards=true in both cases? Do you notice CPU/memory utilization difference between the two deployments? How many servers did you use in total? I am curious what's the bottleneck for the one instance and 3 cores configuration. Thanks, Wei On Mon, Aug 27,

unique() in the JSON facets doesn’t count all the different values in a field

Hi all, We’re running a SolrCloud 7.1 instance in our service and I’ve come across at a disagreement when trying to find out the different values a field has: Using the JSON facets API with unique(): 3385 Using the JSON facets API with terms: 3388 Using the stats component: countDistinct

RE: Authorization Non- Admin user - SOLR

Please find attached below : -- { "authentication":{ "blockUnknown":true, "class":"solr.BasicAuthPlugin", "credentials":{ "solr":"IV0EHq1OnNrj6gvRCwvFwTrZ1+z1oBbnQdiVC3otuq0= Ndd7LKvVBAaZIF0QAVi1ekCfAJXr1GGfLtRUXhgrF8c=",

Re: Permission Denied when trying to connect to Solr running on a different server

It was a config issue. The SELinux on the machine was not allowing apache to talk to port 8983. I verified this by temporarily turning off the enforcement (setenforce 0). Once I did this I was able to run search as expected. I then turned the enforcement back on (setenforce 1) and added a rule for

Re: An exception when running Solr on HDFS，why a solr server can not recognize the write.lock file is created by itself before？

On 8/26/2018 7:47 PM, zhenyuan wei wrote: I found an exception when running Solr on HDFS。The detail is： Running solr on HDFS，and update doc was running always， then，kill -9 solr JVM or reboot linux os/shutdown linux os，then restart all. If you use "kill -9" to stop a Solr instance, the

Re: [help!] java.lang.NoSuchMethodError: org.apache.solr.client.solrj.request.schema.SchemaRequest

i found the root cause, it is my setting org.noggit noggit It's has duplicate (version conflict) in my dependency. On Mon, Aug 27, 2018 at 11:22 AM yx zhou wrote: > Hi Steve > > Thank your reply. > My solr server is from >

Re: [help!] java.lang.NoSuchMethodError: org.apache.solr.client.solrj.request.schema.SchemaRequest

Hi Steve Thank your reply. My solr server is from http://archive.apache.org/dist/lucene/solr/7.0.1/, and my SolrJ client is org.apache.solr solr-solrj 7.0.1 org.slf4j jcl-over-slf4j

Issue with adding an extra Solr Slave

Hi, I'm running Solr 5.3 in one of our applications. Currently, we have one Solr Master and one Solr slave running on AWS EC2 instances. I'm trying to add an additional Solr slave. I'm using an Elastic LoadBalancer (ELB) in front of my Slaves. I see the following error in the logs after adding

Re: An exception when running Solr on HDFS，why a solr server can not recognize the write.lock file is created by itself before？

I accidentally put my Solr indexes on NFS once about ten years ago. It was 100X slower. I would not recommend that. wunder Walter Underwood wun...@wunderwood.org http://observer.wunderwood.org/ (my blog) > On Aug 27, 2018, at 1:39 AM, zhenyuan wei wrote: > > Thanks for your answer! @Erick

Re: Multiple solr instances per host vs Multiple cores in same solr instance

What was your bottleneck when maxing on 30QPS on 3 node cluster? I expect such tests to vary quite much between use cases, so a good approach is to do just as you did: benchmark on your specific data and usage. -- Jan Høydahl, search solution architect Cominvent AS - www.cominvent.com > 27.

Re: Multiple solr instances per host vs Multiple cores in same solr instance

My tests with many combinations (instance, node, core) on a 3 server cluster with SolrCloud pointed out that highest performance is with multiple solr instances and shards and replicas placed by rules so that you get advantage from preferLocalShards=true. The disadvantage ist the handling of the

Re: An exception when running Solr on HDFS，why a solr server can not recognize the write.lock file is created by itself before？

Thanks for your answer! @Erick Erickson So, It's not recommended to run Solr on NFS ( like HDFS) now? Maybe because of crash error or performance problem. I have a look at SOLR-8335, there is no good solution for this now， And maybe manual removal is the best option? Erick Erickson

Re: SOLR zookeeper connection timeout during startup is hardcoded to 10000ms

Hi, We also experimenting time-out issues from time to time. I sent this message one month ago, by mistake in the dev list. Why use hardcoded values just in ZkClientClusterStateProvider.java file while there are existing parameters for these time-out ? Regards Dominique

Re: Multiple solr instances per host vs Multiple cores in same solr instance

Hi, I would start with one instance per host and add more shards to that one. As long as you stay below 32G heap this would be a preferred setup. It is a common mistake to think that you need more JVM heap than necessary. In fact you should try to minimize your heap and leave more free RAM for

Re: Authorization Non- Admin user - SOLR

Hi, The mailing list does not accept attachments, please copy/paste or use a file sharing service. -- Jan Høydahl, search solution architect Cominvent AS - www.cominvent.com > 27. aug. 2018 kl. 05:05 skrev Rathor, Piyush (US - Philadelphia) > : > > Hi Jan, > > Please find attached