[
https://issues.apache.org/jira/browse/HBASE-5355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13204318#comment-13204318
]
ryan rawson commented on HBASE-5355:
------------------------------------
oh btw, on the custom-compression, it wasnt so much as compression but a new
form of serialization that did not duplicate fields. Figuring the
de-duplication, then writing it out ended up being as, or more, expensive than
just sending the data. Just the cost of re-copying the data appeared to be too
much. And even with the best compression algorithms, you'd still have to incur
the data copying cost at least 1x (even if its over previously used memory).
> Compressed RPC's for HBase
> --------------------------
>
> Key: HBASE-5355
> URL: https://issues.apache.org/jira/browse/HBASE-5355
> Project: HBase
> Issue Type: Improvement
> Components: ipc
> Affects Versions: 0.89.20100924
> Reporter: Karthik Ranganathan
> Assignee: Karthik Ranganathan
>
> Some application need ability to do large batched writes and reads from a
> remote MR cluster. These eventually get bottlenecked on the network. These
> results are also pretty compressible sometimes.
> The aim here is to add the ability to do compressed calls to the server on
> both the send and receive paths.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
