[
https://issues.apache.org/jira/browse/HBASE-4608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13176989#comment-13176989
]
Li Pi commented on HBASE-4608:
------------------------------
This should be a good time to mention that, at this point, the patch is working.
There is some refactoring to make it prettier, and room for
optimization, but please test out the compressor! (with a realistic
load and see how much improvement it gains.)
Compressor.java contains a command line compression tool that you can
use. Just run this against a HLog and check the differing sizes of the
outputs.
On Wed, Dec 28, 2011 at 8:38 PM, [email protected]
> HLog Compression
> ----------------
>
> Key: HBASE-4608
> URL: https://issues.apache.org/jira/browse/HBASE-4608
> Project: HBase
> Issue Type: New Feature
> Reporter: Li Pi
> Assignee: Li Pi
> Attachments: 4608v1.txt
>
>
> The current bottleneck to HBase write speed is replicating the WAL appends
> across different datanodes. We can speed up this process by compressing the
> HLog. Current plan involves using a dictionary to compress table name, region
> id, cf name, and possibly other bits of repeated data. Also, HLog format may
> be changed in other ways to produce a smaller HLog.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
