Anoop Sam John created HBASE-24679:
--------------------------------------
Summary: HBase on Cloud Blob FS : Provide config to skip HFile
archival while table deletion
Key: HBASE-24679
URL: https://issues.apache.org/jira/browse/HBASE-24679
Project: HBase
Issue Type: Improvement
Reporter: Anoop Sam John
Assignee: Anoop Sam John
Fix For: 3.0.0-alpha-1, 2.4.0
When we delete a table as part of delete of table from FS, we do below things
1. Rename to table directory to come under /hbase/.tmp. This is an atomic
rename op
2. Go through each of HFiles under every region:cf and archive that one by one.
(Rename the file from .tmp path to go to /hbase/archive)
3. Delete the table dir under .tmp dir
In case of HDFS this is not a big deal as every rename op is just a meta op
(Though the HFiles archival is a costly only as there will be so many calls to
NN based the table's regions# and total storesfiles#) But on Cloud blob based
FS impl, this is a concerning op. Every rename will be a copy blob op. And we
are doing it twice per each of the HFiles in this table !
The proposal here is to provide a config option (default to false) to skip this
archival step.
We can provide another config to even avoid the .tmp rename? The atomicity of
the Table delete can be achieved by HM side procedure and proc WAL. In table
delete the 1st step is to delete the table form META anyways
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
