[
https://issues.apache.org/jira/browse/HDFS-15812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17278578#comment-17278578
]
Satya Gaurav commented on HDFS-15812:
-------------------------------------
[~surendralilhore] We have created the table with the value of
KEEP_DELETED_CELLS =false .
So ideally it should be delete the data from HDFS also and snapshot is also not
enable.
We are just creating the tables and putting the data and after that we are
deleting the data of that column family.
The no of count has reduced in hbase table but when we have checked the hdfs
dircetory for the hbase the size is same even we ran major compaction also but
no impact on hdfs size.
Below is the query which we are using
create 'OBST:TEST',
{NAME => 'cfDocContent', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false',
NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE',
CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'FAST_DIFF', TTL =>
'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW',
CACHE_INDEX_ON_WRITE=> 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE =>
'false', PREFETCH_BLOCKS_ON_OPEN => 'false', IS_MOB => 'true', COMPRESSION =>
'SNAPPY', BLOCKCACHE=> 'true', BLOCKSIZE => '65536'}
,
{NAME => 'cfMetadata', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false',
NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE',
CACHE_DATA_ON_WRITE=> 'false', DATA_BLOCK_ENCODING => 'FAST_DIFF', TTL =>
'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW',
CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE =>
'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'SNAPPY',
BLOCKCACHE => 'true', BLOCKSIZE => '65536'}
put 'OBST:TEST','Test101','cfDocContent:doc','row101'
put 'OBST:TEST','Test102','cfDocContent:doc','row102'
put 'OBST:TEST','Test103','cfDocContent:doc','row103'
put 'OBST:TEST','Test106','cfMetadata:doc','row106'
put 'OBST:TEST','Test107','cfMetadata:doc','row107'
put 'OBST:TEST','Test108','cfMetadata:doc','row108'
delete 'OBST:TEST','Test101','cfDocContent:doc'
delete 'OBST:TEST','Test102','cfDocContent:doc'
delete 'OBST:TEST','Test103','cfDocContent:doc'
delete 'OBST:TEST','Test106','cfMetadata:doc'
delete 'OBST:TEST','Test107','cfMetadata:doc'
delete 'OBST:TEST','Test108','cfMetadata:doc'
flush 'OBST:TEST'
compact 'OBST:TEST'
major_compact 'OBST:TEST', 'cfDocContent', 'MOB'
major_compact 'OBST:TEST
_hbase(main):185:0>_ scan 'OBST:TEST', \{RAW => TRUE}
_ROW COLUMN+CELL_
_Test101 column=cfDocContent:doc, timestamp=1608282551809, type=Delete_
_Test102 column=cfDocContent:doc, timestamp=1608282551824, type=Delete_
_Test103 column=cfDocContent:doc, timestamp=1608282551838, type=Delete_
_Even the tombstone mark is also there and the size of hdfs directory didn't
reduce. It's not moving in to trash also._
_Let me know if you need some additional information_
Regards,
Satya
> after deleting data of hbase table hdfs size is not decreasing
> --------------------------------------------------------------
>
> Key: HDFS-15812
> URL: https://issues.apache.org/jira/browse/HDFS-15812
> Project: Hadoop HDFS
> Issue Type: Bug
> Components: hdfs
> Affects Versions: 2.0.2-alpha
> Environment: HDP 3.1.4.0-315
> Hbase 2.0.2.3.1.4.0-315
> Reporter: Satya Gaurav
> Priority: Major
>
> I am deleting the data from hbase table, it's deleting from hbase table but
> the size of the hdfs directory is not reducing. Even I ran the major
> compaction but after that also hdfs size didn't reduce. Any solution for this
> issue?
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
