Hi,
Using this week's trunk we sometime see nodes entering a some funky state where
it continuously reports exceptions. Replication and query handling is still
possible but there is an increase in CPU time:
2012-11-01 09:24:28,337 INFO [solr.core.SolrCore] - [http-8080-exec-4] - :
[openindex_f] webapp=/solr path=/admin/ping params={} status=500 QTime=21
2012-11-01 09:24:28,337 ERROR [solr.core.SolrCore] - [http-8080-exec-4] - :
org.apache.solr.common.SolrException: Ping query caused exception:
java.util.concurrent.RejectedExecutionException
at
org.apache.solr.handler.PingRequestHandler.handlePing(PingRequestHandler.java:259)
at
org.apache.solr.handler.PingRequestHandler.handleRequestBody(PingRequestHandler.java:207)
at
org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:144)
at org.apache.solr.core.SolrCore.execute(SolrCore.java:1830)
at
org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:476)
at
org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:276)
at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
at
org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233)
at
org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191)
at
org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127)
at
org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102)
at
org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109)
at
org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:293)
at
org.apache.coyote.http11.Http11NioProcessor.process(Http11NioProcessor.java:889)
at
org.apache.coyote.http11.Http11NioProtocol$Http11ConnectionHandler.process(Http11NioProtocol.java:744)
at
org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.run(NioEndpoint.java:2274)
at
java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:662)
Caused by: org.apache.solr.common.SolrException:
java.util.concurrent.RejectedExecutionException
at org.apache.solr.core.SolrCore.getSearcher(SolrCore.java:1674)
at org.apache.solr.core.SolrCore.getSearcher(SolrCore.java:1330)
at org.apache.solr.core.SolrCore.getSearcher(SolrCore.java:1265)
at
org.apache.solr.request.SolrQueryRequestBase.getSearcher(SolrQueryRequestBase.java:88)
at
org.apache.solr.handler.component.QueryComponent.process(QueryComponent.java:214)
at
org.apache.solr.handler.component.SearchHandler.handleRequestBody(SearchHandler.java:206)
at
org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:144)
at org.apache.solr.core.SolrCore.execute(SolrCore.java:1830)
at
org.apache.solr.handler.PingRequestHandler.handlePing(PingRequestHandler.java:250)
... 19 more
Caused by: java.util.concurrent.RejectedExecutionException
at
java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:1768)
at
java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:767)
at
java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:658)
at
java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:92)
at
java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:603)
at org.apache.solr.core.SolrCore.getSearcher(SolrCore.java:1605)
... 27 more
This won't stop until i restart the servlet container but began in the first
place after restarting the servlet container. Any hints to share? File bug?
Thanks,
Markus
