Hi,

Does this happen while a new searcher is warming up by any chance?
Have you tried decreasing your document cache size?  Try that...

 Otis
--
Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch


----- Original Message ----
> From: gurudev <[EMAIL PROTECTED]>
> To: solr-user@lucene.apache.org
> Sent: Wednesday, May 21, 2008 7:46:15 AM
> Subject: Re: SOLR OOM (out of memory) problem
> 
> 
> Just to add more:
> 
> The JVM heap allocated is 6GB with initial heap size as 2GB. We use
> quadro(which is 8 cpus) on linux servers for SOLR slaves.
> We use facet searches, sorting.
> document cache is set to 7 million (which is total documents in index)
> filtercache 10000
> 
> 
> 
> 
> gurudev wrote:
> > 
> > Hi
> > 
> > We currently host index of size approx 12GB on 5 SOLR slaves machines,
> > which are load balanced under cluster. At some point of time, which is
> > after 8-10 hours, some SOLR slave would give Out of memory error, after
> > which it just stops responding, which then requires restart and after
> > restart it works perfectly. Sometimes we notice long query processing time
> > of specific SOLR slaves after which we restart just to avoid any
> > forthcoming problem. Can anyone suggest how to avoid OOM problem. Out
> > slave SOLR are read only and we do the incremental updations during night
> > only. Below is the snapshot of error we get as OOM: 
> > 
> > 
> > SEVERE: java.lang.OutOfMemoryError: Java heap space
> >         at org.apache.solr.util.OpenBitSet.(OpenBitSet.java:87)
> >         at
> > org.apache.solr.search.DocSetHitCollector.collect(DocSetHitCollector.java:61)
> >         at
> > 
> org.apache.solr.search.SolrIndexSearcher$9.collect(SolrIndexSearcher.java:1064)
> >         at
> > org.apache.lucene.search.BooleanScorer2.score(BooleanScorer2.java:292)
> >         at
> > org.apache.lucene.search.IndexSearcher.search(IndexSearcher.java:133)
> >         at org.apache.lucene.search.Searcher.search(Searcher.java:117)
> >         at org.apache.lucene.search.Searcher.search(Searcher.java:96)
> >         at
> > 
> org.apache.solr.search.SolrIndexSearcher.getDocListAndSetNC(SolrIndexSearcher.java:1061)
> >         at
> > 
> org.apache.solr.search.SolrIndexSearcher.getDocListC(SolrIndexSearcher.java:801)
> >         at
> > 
> org.apache.solr.search.SolrIndexSearcher.getDocListAndSet(SolrIndexSearcher.java:1237)
> >         at
> > 
> org.apache.solr.request.DisMaxRequestHandler.handleRequestBody(DisMaxRequestHandler.java:315)
> >         at
> > 
> org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:77)
> >         at org.apache.solr.core.SolrCore.execute(SolrCore.java:658)
> >         at
> > 
> org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:191)
> >         at
> > 
> org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:159)
> >         at
> > 
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:202)
> >         at
> > 
> org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173)
> >         at
> > 
> org.jboss.web.tomcat.filters.ReplyHeaderFilter.doFilter(ReplyHeaderFilter.java:96)
> >         at
> > 
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:202)
> >         at
> > 
> org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173)
> >         at
> > 
> org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:213)
> >         at
> > 
> org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:178)
> >         at
> > 
> org.jboss.web.tomcat.security.SecurityAssociationValve.invoke(SecurityAssociationValve.java:175)
> >         at
> > 
> org.jboss.web.tomcat.security.JaccContextValve.invoke(JaccContextValve.java:74)
> >         at
> > org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:126)
> >         at
> > org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:105)
> >         at
> > 
> org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:107)
> >         at
> > org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:148)
> >         at
> > org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:869)
> >         at
> > 
> org.apache.coyote.http11.Http11BaseProtocol$Http11ConnectionHandler.processConnection(Http11BaseProtocol.java:664)
> >         at
> > 
> org.apache.tomcat.util.net.PoolTcpEndpoint.processSocket(PoolTcpEndpoint.java:527)
> >         at
> > 
> org.apache.tomcat.util.net.MasterSlaveWorkerThread.run(MasterSlaveWorkerThread.java:112)
> > 
> > 
> > 
> > 
> 
> -- 
> View this message in context: 
> http://www.nabble.com/SOLR-OOM-%28out-of-memory%29-problem-tp17364146p17364150.html
> Sent from the Solr - User mailing list archive at Nabble.com.

Reply via email to