Re: MetricRegistry instances for transient cores are not getting GC'd

[nandakishorek]

This is a duplicate of https://issues.apache.org/jira/browse/SOLR-11882.
The problem is fixed in 7.4.



--
Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f472068.html

MetricRegistry instances for transient cores are not getting GC'd

[nandakishorek]

I took a heap dump when Solr heap usage kept growing to 32GB and comes down
to 15GB after GC.
Heap dump analysis shows there are MetricRegistry instances for transient
cores.i.e., cores with "isLoaded" as false in STATUS output.


 

 

I validated that this problem happens on the default configset as well (I
tested it with 5 cores and transientCache size set to 2).

Please help.

My environment is as follows 
 * Solr 7.2.1 in standalone mode. 
 * 32GB heap 
 * 150 cores with data getting continuously ingested to ~10 cores and all of 
the cores queried. 
 * transient cache size is set to 30. 

The solr.xml is as follows 
 
 

  32 
  true 
  ${configSetBaseDir:configsets} 

   
${socketTimeout:60} 
${connTimeout:6} 
   




--
Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f472068.html

/solr/admin/metrics fails when there are transient cores

[nandakishorek]

My environment is as follows
 * Solr 7.2.1 in standalone mode.
 * 32GB heap
 * 150 cores with data getting continuously ingested to ~10 cores and all of
the cores queried.
 * transient cache size is set to 30.

The solr.xml is as follows



  32
  true
  ${configSetBaseDir:configsets}

  
${socketTimeout:60}
${connTimeout:6}
  


I get the following error when I request for "/solr/admin/metrics".
{
"responseHeader": {
"status": 500,
"QTime": 31
},
"error": {
"msg": "Already closed",
"trace": "org.apache.lucene.store.AlreadyClosedException: Already
closed\n\tat
org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:337)\n\tat
org.apache.solr.core.SolrCore.getNewIndexDir(SolrCore.java:351)\n\tat
org.apache.solr.core.SolrCore.getIndexDir(SolrCore.java:330)\n\tat
org.apache.solr.handler.ReplicationHandler.lambda$initializeMetrics$5(ReplicationHandler.java:849)\n\tat
org.apache.solr.util.stats.MetricUtils.convertGauge(MetricUtils.java:488)\n\tat
org.apache.solr.util.stats.MetricUtils.convertMetric(MetricUtils.java:274)\n\tat
org.apache.solr.util.stats.MetricUtils.lambda$toMaps$4(MetricUtils.java:213)\n\tat
java.util.stream.ForEachOps$ForEachOp$OfRef.accept(ForEachOps.java:184)\n\tat
java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:175)\n\tat
java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:175)\n\tat
java.util.TreeMap$KeySpliterator.forEachRemaining(TreeMap.java:2746)\n\tat
java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:481)\n\tat
java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:471)\n\tat
java.util.stream.ForEachOps$ForEachOp.evaluateSequential(ForEachOps.java:151)\n\tat
java.util.stream.ForEachOps$ForEachOp$OfRef.evaluateSequential(ForEachOps.java:174)\n\tat
java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)\n\tat
java.util.stream.ReferencePipeline.forEach(ReferencePipeline.java:418)\n\tat
org.apache.solr.util.stats.MetricUtils.toMaps(MetricUtils.java:211)\n\tat
org.apache.solr.handler.admin.MetricsHandler.handleRequestBody(MetricsHandler.java:108)\n\tat
org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:177)\n\tat
org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:735)\n\tat
org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:716)\n\tat
org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:497)\n\tat
org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:382)\n\tat
org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:326)\n\tat
org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1751)\n\tat
org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:582)\n\tat
org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143)\n\tat
org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:548)\n\tat
org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:226)\n\tat
org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180)\n\tat
org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:512)\n\tat
org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)\n\tat
org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112)\n\tat
org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)\n\tat
org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:213)\n\tat
org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:119)\n\tat
org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)\n\tat
org.eclipse.jetty.rewrite.handler.RewriteHandler.handle(RewriteHandler.java:335)\n\tat
org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)\n\tat
org.eclipse.jetty.server.Server.handle(Server.java:534)\n\tat
org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:320)\n\tat
org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:251)\n\tat
org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)\n\tat
org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)\n\tat
org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93)\n\tat
org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:303)\n\tat
org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)\n\tat
org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)\n\tat
org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)\n\tat
org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)\n\tat

Re: /export LongPointField

[nandakishorek]

I'm using 6.6.2.
I'll upgrade when to 7 when I can.
Thanks.



--
Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f472068.html

/export LongPointField

[nandakishorek]

My index has certain fields of type LongPointField with docValues=true i.e.,
they are not multivalued.
When I use the export handler to export the data, there is an exception
thrown 'Export fields must either be one of the following types:
int,float,long,double,string,date,boolean'.
I see the ExportWriter cannot write fields of type LongPointFields. Should I
raise a JIRA for this?






--
Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f472068.html