Re: Almost nodes in Solrcloud dead suddently

2020-06-23 Thread Dario Rigolin
What about a network issue? Il giorno mar 23 giu 2020 alle ore 01:37 Tran Van Hoan ha scritto: > > dear all, > > I have a solr cloud 8.2.0 with 6 instance per 6 server (64G RAM), each > instance has xmx = xms = 30G. > > Today almost nodes in the solrcloud were dead 2 times from 8:00AM (5/6 >

Re: Query takes more time in Solr 8.5.1 compare to 6.1.0 version

2020-06-23 Thread vishal patel
Is there any other option? Sent from Outlook From: Mikhail Khludnev Sent: Sunday, May 24, 2020 3:24 AM To: solr-user Subject: Re: Query takes more time in Solr 8.5.1 compare to 6.1.0 version Unfortunately {!terms} doesn't let one

Sorting in other collection in Solr 8.5.1

2020-06-23 Thread vishal patel
Hi I am upgrading Solr 8.5.1. I have created 2 shards and each has one replica. I have created 2 collection one is form and second is actionscomment.forms related data are stored in form collection and actions of that forms are stored in actionscomment collection. There are 10 lakh documents in

Retrieve disk usage & release disk space after delete

2020-06-23 Thread ChienHuaWang
Hi Solr users, Q1: Wondering if there is any way to retrieve disk usage by host? Could we get thru metrics API or any other methods? I know the data shows in Solr Admin UI, but have other approach for this kind of data. Q2: After delete the collections, it seems not physically removed from the

Re: Sorting in other collection in Solr 8.5.1

2020-06-23 Thread Erick Erickson
You have two separate collections with dissimilar data, so what does “sorting them in the same order” mean? Your example sorts on title, so why can’t you sort them both on title? That won’t work of course for any field that isn’t identical in both collections. These are actually pretty small

Re: Index file on Windows fileshare..

2020-06-23 Thread Erick Erickson
The program I pointed you to should take about an hour to make work. But otherwise, you can try the post tool: https://lucene.apache.org/solr/guide/7_2/post-tool.html Best, Erick > On Jun 23, 2020, at 8:45 AM, Fiz N wrote: > > Thanks Erick. Is there easy way of doing this? Index files from

Re: Index file on Windows fileshare..

2020-06-23 Thread Fiz N
Thanks Erick. Is there easy way of doing this? Index files from windows share folder to SOLR. This is for POC only. Thanks Nadian. On Mon, Jun 22, 2020 at 3:54 PM Erick Erickson wrote: > Consider running Tika in a client and indexing the docs to Solr. > At that point, you have total control

Unable to set preferred leader

2020-06-23 Thread Karl Stoney
Hey, We have a SolrCloud collection with 8 replicas, and one of those replicas has the `property.preferredleader: true` set. However when we perform a `REBALANCELEADERS` we get: ``` { "responseHeader": { "status": 0, "QTime": 62268 }, "Summary": { "Failure": "Not all active

Re: Retrieve disk usage & release disk space after delete

2020-06-23 Thread Erick Erickson
Q1: If you’re talking about disk space used up by deleted documents, then yes, optimize or expungeDeletes will recover it. The former will recover it all, the latter will rewrite segments with > 10% deleted documents. HOWEVER: optimize is an expensive operation, and can have

RE: Log4J Logging to Http

2020-06-23 Thread Krönert Florian
Hi Radu, thanks for your response. Your different approach is very valuable to me, so thanks for suggesting it. I'll take a look at the different tools you suggested. I hope there is some small and efficient solution for doing this, since throwing a whole Logstash, ElasticSearch and Kibana

Re: Unable to set preferred leader

2020-06-23 Thread Erick Erickson
First of all, unless you have a lot of shards worrying about which one is the leader is not worth the effort. That code was put in there to deal with a situation where there were 100s of shards and when the system was cold-started they all could have their leader be on the same node. The extra

RE: Log4J Logging to Http

2020-06-23 Thread Krönert Florian
Hi Shawn, thanks for your response, I'll take a look, it seems the slf4j jars are missing in there. The filesystem is not really something that I am going to tweak inside that Docker container, so I might take a look at different approaches as well. Kind Regards, Florian Krönert Senior

Re: Almost nodes in Solrcloud dead suddently

2020-06-23 Thread Tran Van Hoan
I checked node exporter metrics and saw network no problem On Tuesday, June 23, 2020, 8:37:41 PM GMT+7, Tran Van Hoan wrote: I check node exporter, no problem with OS, hardware and network.I attached images about solr metrics 7 days and 12h. On Tuesday, June 23, 2020, 2:23:05

Re: Retrieve disk usage & release disk space after delete

2020-06-23 Thread Walter Underwood
We get disk usage on volumes using Telegraf. I’m planning on writing something that gathers size info (docs and bytes) by getting core info from the CLUSTERSTATUS request then using the CoreAdmin API to get the detailed info about cores. It doesn’t look hard, just complicated. Fire up Python and

replica deleted but directory remains

2020-06-23 Thread Odysci
Hi, I've got a solrcloud configuration with 2 shards and 2 replicas each. For some unknown reason, one of the replicas was on "recovery" mode forever, so I decided to create another replica, which went fine. Then I proceeded to delete the old replica (using the SOlr UI). After a while the

Re: [EXTERNAL] Getting rid of Master/Slave nomenclature in Solr

2020-06-23 Thread Tomás Fernández Löbbe
I agree in general with what Trey and Jan said and have suggested. I personally like to use "leader/follower". It's true that somewhat collides with SolrCloud terminology, but that's not a problem IMO, now that replica types exist, the “role” of the replica (leader vs. non-leader/follower) doesn’t

Re: [EXTERNAL] Getting rid of Master/Slave nomenclature in Solr

2020-06-23 Thread Noble Paul
Do we even call it the master/slave mode? I thought we had 2 modes * Standalone mode * SolrCloud mode On Wed, Jun 24, 2020 at 3:00 AM Tomás Fernández Löbbe wrote: > > I agree in general with what Trey and Jan said and have suggested. I > personally like to use "leader/follower". It's true that

solr fq with contains not returning any results

2020-06-23 Thread yaswanth kumar
I am using solr 8.2 And when trying to do fq=auto_nsallschools:*bostonschool*, the data is not being returned. But if I do the same in solr 5.5 (which I already have and we are in process of migrating to 8.2 ) its returning results. if I do fq=auto_nsallschools:bostonschool or

Re: Retrieve disk usage & release disk space after delete

2020-06-23 Thread ChienHuaWang
Q1: I'm looking for the disk usage data in Solr admin - Solr Cloud/Nodes. Any way to get the Node data in table thru API call? Q2: Thanks for helpful information about deleting the data. The main issue I have now is for deleting collections, even if I delete by admin UI, this suppose not to hang

Restored collection cluster status rendering some values as Long (as opposed to String for other collections)

2020-06-23 Thread Aliaksandr Asiptsou
Hello Solr experts, Our team noticed the below behavior: 1. A collection is restored from a backup, and a replication factor is specified within the restore command: /solr/admin/collections?action=RESTORE=backup_name=/backups/solr=collection_name=config_name=1=1 2. Collection restored

Re: replica deleted but directory remains

2020-06-23 Thread Erick Erickson
In a word, “yes”. What it looks like is that the information in Zookeeper has been updated to reflect the deletion. But since node for some mysterious reason wasn’t available when the replica was deleted, the data couldn’t be removed. Best, Erick > On Jun 23, 2020, at 12:58 PM, Odysci wrote: >