Re: Out of memory, not during import or updates of the index

2011-11-10 Thread Steve Fatula
From: Mark Miller >To: solr-user >Sent: Thursday, November 10, 2011 3:00 PM >Subject: Re: Out of memory, not during import or updates of the index > >How big is your index? > >The total for the data dir is 651M. >What kind of queries do you tend to see? Do you facet

Re: Out of memory, not during import or updates of the index

2011-11-10 Thread Mark Miller
How big is your index? What kind of queries do you tend to see? Do you facet on a lot of fields? Sort on a lot of fields? Before you get the OOM and are running along nicely, how much RAM is used? On Nov 9, 2011, at 3:33 PM, Steve Fatula wrote: > We get at rare times out of memory errors durin

Re: Out of memory, not during import or updates of the index

2011-11-10 Thread Steve Fatula
From: Andre Bois-Crettez >To: "solr-user@lucene.apache.org" >Sent: Thursday, November 10, 2011 7:02 AM >Subject: Re: Out of memory, not during import or updates of the index > >You can add JVM parameters to better trace the heap usage with >-XX:+PrintGCDetails

Re: Out of memory, not during import or updates of the index

2011-11-10 Thread Steve Fatula
From: Paul Libbrecht >To: solr-user@lucene.apache.org >Sent: Thursday, November 10, 2011 7:19 AM >Subject: Re: Out of memory, not during import or updates of the index > >do you have any custom code in your Solr? >We had out-of-memory errors just because of that, I was u

Re: Out of memory, not during import or updates of the index

2011-11-10 Thread Paul Libbrecht
Steve, do you have any custom code in your Solr? We had out-of-memory errors just because of that, I was using one method to obtain the request which was leaking... had not read javadoc carefully enough. Since then, no leak. What do you do after the OoME? paul Le 9 nov. 2011 à 21:33, Steve F

Re: Out of memory, not during import or updates of the index

2011-11-10 Thread Andre Bois-Crettez
Using Solr 3.4.0. That changelog actually says it should reduce memory usage for that version. We were on a much older version previously, 1.something. Norms are off on all fields that it can be turned off on. I'm just hoping this new version doesn't have any leaks. Does FastLRUCache vs LRUCache

Re: Out of memory, not during import or updates of the index

2011-11-09 Thread Steve Fatula
From: Otis Gospodnetic >To: "solr-user@lucene.apache.org" >Sent: Wednesday, November 9, 2011 2:51 PM >Subject: Re: Out of memory, not during import or updates of the index > >Hi, > >Some options: >* Yes, on the slave/search side you can reduce your cache size

Re: Out of memory, not during import or updates of the index

2011-11-09 Thread Otis Gospodnetic
_ >From: Steve Fatula >To: "solr-user@lucene.apache.org" >Sent: Wednesday, November 9, 2011 3:33 PM >Subject: Out of memory, not during import or updates of the index > >We get at rare times out of memory errors during the day. I know one reason >for this is d

Out of memory, not during import or updates of the index

2011-11-09 Thread Steve Fatula
We get at rare times out of memory errors during the day. I know one reason for this is data imports, none are going on. I see in the wiki, document adds have some quirks, not doing that. I don't know to to expect for memory use though. We had Solr running under Tomcat set to 2G ram. I presume c