Re: off-heap OOM

2020-04-29 Thread Raji N
Thanks so much Jan. Will try your suggestions , yes we are also running solr inside docker. Thanks, Raji On Wed, Apr 29, 2020 at 1:46 PM Jan Høydahl wrote: > I have seen the same, but only in Docker. > I think it does not relate to Solr’s off-heap usage for filters and other > data structures,

Re: SolrCloud degraded during backup and batch CSV update

2020-04-29 Thread matthew sporleder
You can add something like this to SOLR_OPTS -DzkClientTimeout=3 in your init script or adjust solr.xml ${zkClientTimeout:15000} On Wed, Apr 29, 2020 at 5:41 PM Sethuraman, Ganesh wrote: > > 3 Zookeeper ensemble are all in 3 separate boxes (EC2 instances). Each have > separate transactional

RE: SolrCloud degraded during backup and batch CSV update

2020-04-29 Thread Sethuraman, Ganesh
3 Zookeeper ensemble are all in 3 separate boxes (EC2 instances). Each have separate transactional logs directory (separate EBS volume, separate disk), as this was zookeeper best practices. It feels ZK timeout is more of symptom and Solr slowness is the cause. Having said that, do you

Re: off-heap OOM

2020-04-29 Thread Jan Høydahl
I have seen the same, but only in Docker. I think it does not relate to Solr’s off-heap usage for filters and other data structures, but rather how Docker treats memory-mapped files as virtual memory. As you know, when using MMapDirectoryFactory, you actually let Linux handle the loading and

Re: off-heap OOM

2020-04-29 Thread matthew sporleder
What does the message look like, exactly, from solr.log ? On Wed, Apr 29, 2020 at 1:27 PM Raji N wrote: > > Thank you for your reply. When OOM happens somehow it doesn't generate > dump file. So we have hourly heaps running to diagnose this issue. Heap is > around 700MB and threads around 150.

Re: Solr Ref Guide Redesign coming in 8.6

2020-04-29 Thread Cassandra Targett
> This design still has a minor annoyance that I have noted in the past: > in the table of contents pane it is easy to open a subtree, but the > only way to close it is to open another one. Obviously not a big > deal. Thanks for pointing that out, it helped me find a big problem which was that I

Re: off-heap OOM

2020-04-29 Thread Raji N
Thank you for your reply. When OOM happens somehow it doesn't generate dump file. So we have hourly heaps running to diagnose this issue. Heap is around 700MB and threads around 150. But 29GB of native memory is used up, it is consumed by java.io.DirectBufferR (27GB major consumption) and

Re: off-heap OOM

2020-04-29 Thread Shawn Heisey
On 4/29/2020 2:07 AM, Raji N wrote: Has anyone encountered off-heap OOM. We are thinking of reducing heap further and increasing the hardcommit interval . Any other suggestions? . Please share your thoughts. It sounds like it's not heap memory that's running out. When the OutOfMemoryError is

Re: Solr fields mapping

2020-04-29 Thread Audrey Lorberfeld - audrey.lorberf...@ibm.com
Hi, Sam! Have you tried creating a copyField? https://builds.apache.org/view/L/view/Lucene/job/Solr-reference-guide-8.x/javadoc/copying-fields.html Best, Audrey On 4/28/20, 1:07 PM, "sambasivarao giddaluri" wrote: Hi All, Is there a way we can map fields in a single field? Ex:

Re: SolrCloud degraded during backup and batch CSV update

2020-04-29 Thread matthew sporleder
FWIW I've had some luck with strategy 3 (increase zk timeout) when you overwhelm the connection to zk or the disk on zk. Is zk on the same boxes as solr? On Tue, Apr 28, 2020 at 10:15 PM Sethuraman, Ganesh wrote: > > Hi > > We are using SolrCloud 7.2.1 with 3 node Zookeeper ensemble. We have 92

Re: Solr Ref Guide Redesign coming in 8.6

2020-04-29 Thread Mark H. Wood
At first glance, I have no big issues. It looks clean and functional, and I like that. I think it will work well enough for me. This design still has a minor annoyance that I have noted in the past: in the table of contents pane it is easy to open a subtree, but the only way to close it is to

Re: Solr Ref Guide Redesign coming in 8.6

2020-04-29 Thread Cassandra Targett
To respond to the feedback so far: Version picker: This is more complex than it may be initially assumed because of the way we publish the site. Since we use a static site generator, each page is a standalone HTML file. To add a version picker to an older version that includes all the latest

Re: Delete on 8.5.1

2020-04-29 Thread Joe Obernberger
Hi - I also tried deleting from solrj (8.5.1) using CloudSolrClient.deleteByQuery. This results in: Error: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://paradigm8:9100/solr/PROCESSOR_LOGS: Async exception during distributed update: Error

Adding several new fields to managed-schema by sorlj

2020-04-29 Thread Szűcs Roland
Hi folks, I am using solr 8.5.0 in standalone mode and use the CoreAdmin API and Schema API of solrj to create new core and its fields in managed-schema Is there any way to add several fields to managed-schema by solrj without processing each by each? The following two rows make the job done by

RE: IdleTimeout setting in Jetty (Solr 7.7.1)

2020-04-29 Thread Kommu, Vinodh K.
Thanks Raji, let me try it. On the other hand, I'm trying socketTimeout and connTimeout properties as well. Thanks & Regards, Vinodh -Original Message- From: Raji N Sent: Wednesday, April 29, 2020 2:59 PM To: solr-user@lucene.apache.org Subject: Re: IdleTimeout setting in Jetty (Solr

Re: IdleTimeout setting in Jetty (Solr 7.7.1)

2020-04-29 Thread Raji N
Try starting like this. bin/solr start -Dsolr.jetty.threads.idle.timeout=2000 -z localhost:2181 Hope this helps Raji On Sun, Apr 26, 2020 at 11:24 PM Kommu, Vinodh K. wrote: > Can someone shed some idea on below requirement? > > Thanks & Regards, > Vinodh > > From: Kommu, Vinodh K. >

Re: Which Solr metrics do you find important?

2020-04-29 Thread Radu Gheorghe
Thanks Matthew and Walter. OK, so you both use the clusterstatus output in your regular monitoring. This seems to be missing from what we have now (we collect everything else you mentioned, like response time percentiles, disk IO, etc). So I guess clusterstatus deserves a priority bump :) Best

off-heap OOM

2020-04-29 Thread Raji N
Hi, We are using solrcloud 7.6.0 and we have containerized solr. We have around 30 collections and 7 solr nodes in the cluster. Though we have containerized , we have one zookeeper container and one solr container running in a host. We have 24GB heap and total container has memory 49GB , which

Hi Team Just to verify with respect to an Issue working on Solr

2020-04-29 Thread Gundala Narayana
Hi Team, Please Let me know. I have an issue working with Solr. I am importing data from Neo4j data to Solr. I am making use of Neo4j Cypher Query string to import data from Neo4j to Solr. The query string with all necessary credentials like Neo4j host, User & password is placed in a .xml file.

Re: Solr Ref Guide Redesign coming in 8.6

2020-04-29 Thread Colvin Cowie
In addition to those points, I think it generally does look good but the thing I've noticed is that increase in text size on rollover in the menu makes it quite jumpy: https://drive.google.com/open?id=15EF0T_C_l8OIDuW8QHOFunL4VzxtyVyb On Wed, 29 Apr 2020 at 08:15, Bernd Fehling wrote: > +1 > >

Re: Solr Ref Guide Redesign coming in 8.6

2020-04-29 Thread Bernd Fehling
+1 And a fully indexed search for the Ref Guide. I have to use Google to search for infos in Ref Guide of a search engine. :-( Am 29.04.20 um 02:11 schrieb matthew sporleder: > I highly recommend a version selector in the header! I am *always* > landing on 6.x docs from google. > > On Tue,