apurtell edited a comment on pull request #3730:
URL: https://github.com/apache/hbase/pull/3730#issuecomment-937381939
Confirmed functionality with a single host cluster:
hbase> create "IntegrationTestLoadCommonCrawl", \
{ NAME => 'c', VERSIONS => 1000, COMPRESSION => 'LZ4',
COMPRESSION_COMPACT => 'ZSTD', BLOCKSIZE => 131072 }, \
{ NAME => 'i', VERSIONS => 1000, COMPRESSION => 'LZ4',
COMPRESSION_COMPACT => 'ZSTD', BLOCKSIZE => 8192 }, \
CONFIGURATION => { 'hbase.io.compress.zstd.level' => '1' }
Loaded one WARC from common crawl.
Major compaction takes 11 seconds.
hbase> alter "IntegrationTestLoadCommonCrawl", \
CONFIGURATION => { 'hbase.io.compress.zstd.level' => '10' }
Major compaction now takes 42 seconds. Total size on disk reduced by 11.6%
vs level 1.
hbase> alter "IntegrationTestLoadCommonCrawl", \
CONFIGURATION => { 'hbase.io.compress.zstd.level' => '22' }
Major compaction now takes 17 minutes 15 seconds. Total size on disk reduced
by 13.3% vs level 1. (Sure, this level is crazy in practice.)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
