[
https://issues.apache.org/jira/browse/SOLR-4793?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16446404#comment-16446404
]
Jan Høydahl commented on SOLR-4793:
-----------------------------------
Yes, better start simple and choose one location for config sets. Blob, HDFS,
FileSystem...
Looks like we have a cleanup job with the SolrResourceLoader hierarchy, there
is a ton of zkSolrResourceLoader hardcoding, and we should probably generalise
some of the zkRL features up into SolrResourceLoader, or a new
SolrResourceLoaderBase.
> Solr Cloud can't upload large config files ( > 1MB) to Zookeeper
> -----------------------------------------------------------------
>
> Key: SOLR-4793
> URL: https://issues.apache.org/jira/browse/SOLR-4793
> Project: Solr
> Issue Type: Improvement
> Reporter: Son Nguyen
> Assignee: Steve Rowe
> Priority: Major
> Fix For: 7.4, master (8.0)
>
> Attachments: SOLR-4793.patch
>
>
> Zookeeper set znode size limit to 1MB by default. So we can't start Solr
> Cloud with some large config files, like synonyms.txt.
> Jan Høydahl has a good idea:
> "SolrCloud is designed with an assumption that you should be able to upload
> your whole disk-based conf folder into ZK, and that you should be able to add
> an empty Solr node to a cluster and it would download all config from ZK. So
> immediately a splitting strategy automatically handled by ZkSolresourceLoader
> for large files could be one way forward, i.e. store synonyms.txt as e.g.
> __001_synonyms.txt __002_synonyms.txt...."
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
