Justin Sweeney created SOLR-16608:
-------------------------------------
Summary: Enable ability to compress state.json in Zookeeper
Key: SOLR-16608
URL: https://issues.apache.org/jira/browse/SOLR-16608
Project: Solr
Issue Type: Improvement
Security Level: Public (Default Security Level. Issues are Public)
Reporter: Justin Sweeney
As noted in the Solr documentation, Zookeeper is intended to hold small files,
by default < 1MB:
[https://solr.apache.org/guide/7_4/setting-up-an-external-zookeeper-ensemble.html#increasing-the-file-size-limit.]
When creating collections with very large number of replicas, it is possible to
exceeded that size in the state.json that is created, which then requires Solr
operators to reconfigure Zookeeper to increase that limit and also has
performance implications.
I am proposing that we provide the ability to compress state.json using
standard ZLib compression. This will be based on a configuration parameter in
solr.xml which will provide a minimum size of state.json over which to use
compression. This will give Solr operators a better mechanism to handle
state.json for very large collections.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
