[
https://issues.apache.org/jira/browse/SOLR-5214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13758323#comment-13758323
]
Christine Poerschke commented on SOLR-5214:
-------------------------------------------
Hello. Here's one of the stack traces. And in case it's useful context, during
the shard split indexing into the cloud had been stopped but periodic
admin/luke and admin/mbeans cat=CACHE stats requests were happening.
{noformat}
2013-09-03 07:27:51,947 ERROR [qtp1533478516-49] o.a.s.s.SolrDispatchFilter
[SolrException.java:119] null:java.lang.OutOfMemoryError: Java heap space
at java.lang.StringCoding.decode(StringCoding.java:215)
at java.lang.String.<init>(String.java:453)
at java.lang.String.<init>(String.java:505)
at
org.apache.lucene.codecs.compressing.CompressingStoredFieldsReader.readField(CompressingStoredFieldsReader.java:154)
at
org.apache.lucene.codecs.compressing.CompressingStoredFieldsReader.visitDocument(CompressingStoredFieldsReader.java:272)
at
org.apache.lucene.index.SegmentReader.document(SegmentReader.java:133)
at
org.apache.lucene.index.FilterAtomicReader.document(FilterAtomicReader.java:365)
at org.apache.lucene.index.IndexReader.document(IndexReader.java:436)
at
org.apache.lucene.codecs.compressing.CompressingStoredFieldsWriter.merge(CompressingStoredFieldsWriter.java:332)
at
org.apache.lucene.index.SegmentMerger.mergeFields(SegmentMerger.java:298)
at org.apache.lucene.index.SegmentMerger.merge(SegmentMerger.java:86)
at org.apache.lucene.index.IndexWriter.addIndexes(IndexWriter.java:2448)
at
org.apache.solr.update.SolrIndexSplitter.split(SolrIndexSplitter.java:118)
at
org.apache.solr.update.DirectUpdateHandler2.split(DirectUpdateHandler2.java:749)
at
org.apache.solr.handler.admin.CoreAdminHandler.handleSplitAction(CoreAdminHandler.java:282)
at
org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:185)
at
org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135)
at
org.apache.solr.servlet.SolrDispatchFilter.handleAdminRequest(SolrDispatchFilter.java:608)
at
org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:206)
at
org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:155)
at
org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
at
org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:455)
at
org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)
at
org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:557)
at
org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:231)
at
org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1075)
at
org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384)
at
org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)
at
org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009)
at
org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
at
org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:255)
at
org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:154)
{noformat}
> collections?action=SPLITSHARD running out of heap space due to merge
> --------------------------------------------------------------------
>
> Key: SOLR-5214
> URL: https://issues.apache.org/jira/browse/SOLR-5214
> Project: Solr
> Issue Type: Improvement
> Components: update
> Affects Versions: 4.3
> Reporter: Christine Poerschke
> Assignee: Shalin Shekhar Mangar
> Attachments: SOLR-5214.patch
>
>
> The problem we saw was that splitting a shard with many segments and documents
> failed by running out of heap space.
> Increasing heap space so that all existing segments could be merged into one
> overall segment does not seem practical. Running the split without segment
> merging worked.
> Could split always run without merging, or merge=true/false be an optional
> parameter for the SPLITSHARD action?
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
