I agree. This looks as it should.You also mentioned that you have compactions
enabled.
If you force a major_compact through the HBase shell, will some space be
reclaimed? (careful, this will compact everything in the table, which can put
some load on the net/disks).Lastly, did you stop collecting new data? Are you
sure you're not just collecting more data? (just asking :) )
To verify whether old data is still there or not, you can also run a raw scan.
Something like this from the shell:
scan <table>, {RAW => true, VERSIONS => 10000, TIMERANGE => [0, 1408749519438]}
(1408749519438 is about 200 days ago from right now)
If that query returns anything, then we'd have a problem.
-- Lars
From: Jean-Marc Spaggiari <[email protected]>
To: user <[email protected]>
Sent: Monday, March 9, 2015 9:08 PM
Subject: Re: Re: Why can the capacity of a table with TTL grow continuously?
Ok, nothing wrong there.
Have you disabled the daily (or weekly) major compactions on your cluster?
Wich HBase version are you running?
JM
2015-03-09 23:53 GMT-04:00 David chen <[email protected]>:
> Thanks jean-marc, the table description is as following:
> 'tab_normal', {NAME => 'f1', DATA_BLOCK_ENCODING => 'NONE', BLOOMFILTER =>
> 'ROW', REPLICATION_SCOPE => '0', COMPRESSION => 'SNAPPY', VERSIONS =>
> '10000', TTL => '16070400 SECONDS (186 DAYS)', MIN_VERSIONS => '0',
> KEEP_DELETED_CELLS => 'false', BLOCKSIZE => '65536', IN_MEMORY => 'false',
> BLOCKCACHE => 'true'}, {NAME => 'f2', DATA_BLOCK_ENCODING => 'NONE',
> BLOOMFILTER => 'ROW', REPLICATION_SCOPE => '0', COMPRESSION => 'SNAPPY',
> VERSIONS => '10000', TTL => '16070400 SECONDS (186 DAYS)', MIN_VERSIONS =>
> '0', KEEP_DELETED_CELLS => 'false', BLOCKSIZE => '65536', IN_MEMORY =>
> 'false', BLOCKCACHE => 'true'}, {NAME => 'idx', DATA_BLOCK_ENCODING =>
> 'NONE', BLOOMFILTER => 'ROW', REPLICATION_SCOPE => '0', COMPRESSION =>
> 'SNAPPY', VERSIONS => '10000', TTL => '16070400 SECONDS (186 DAYS)',
> MIN_VERSIONS => '0', KEEP_DELETED_CELLS => 'false', BLOCKSIZE => '65536',
> IN_MEMORY => 'false', BLOCKCACHE => 'true'}
