[
https://issues.apache.org/jira/browse/HELIX-573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14352346#comment-14352346
]
kishore gopalakrishna commented on HELIX-573:
---------------------------------------------
>From Kanaks's email:
I like this idea, but we would still need to support bucketizing either way
because we cannot guarantee that the compressed version will be compact enough
for every use case.
What types of compression schemes are you planning to support?
> Add support to compress/uncompress data on ZK
> ---------------------------------------------
>
> Key: HELIX-573
> URL: https://issues.apache.org/jira/browse/HELIX-573
> Project: Apache Helix
> Issue Type: Improvement
> Reporter: kishore gopalakrishna
> Assignee: kishore gopalakrishna
>
> Currently we have bucketing as one of the options when the number of
> partitions are large. We have couple of bugs with the handling of bucketized
> resources (one of them is fatal).
> One of the reasons to split the znode is because we use JSON to store the
> data in ZNode. While JSON is good for debugging, its space inefficient.
> A better option before going to bucketing is to support compression of Ideal
> state, current state and External View. This also gives good performance.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
