[
https://issues.apache.org/jira/browse/SOLR-5714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13898517#comment-13898517
]
Mark Miller commented on SOLR-5714:
-----------------------------------
This patch adds a new init param to HdfsDirectoryFactory that allows it to use
a global block cache rather than a block cache per SolrCore instance. It
defaults to false if not present in solrconfig.xml for back compatibility. The
latest solrconfig.xml will default it to true.
A future improvement I'd like to make is the ability to configure some of the
hdfs stuff at the solr.xml level, but I don't want to tie that into this issue.
First cut attached.
> You should be able to use one pool of memory for multiple collection's HDFS
> block caches.
> -----------------------------------------------------------------------------------------
>
> Key: SOLR-5714
> URL: https://issues.apache.org/jira/browse/SOLR-5714
> Project: Solr
> Issue Type: Improvement
> Reporter: Mark Miller
> Assignee: Mark Miller
> Fix For: 5.0, 4.7
>
> Attachments: SOLR-5714.patch
>
>
> Currently, you have to specify how much direct memory to allocate per
> SolrCore. This can be inefficient, and has some negative consequences - for
> instance, when replicating, many times two HDFS directories will exist for
> the same index briefly, which will double the RAM used for that SolrCore.
--
This message was sent by Atlassian JIRA
(v6.1.5#6160)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
